Skip to content

Conversation

@ValentinZakharov
Copy link
Contributor

What Does This Do

Fixed flaky Synapse passthru tracing by changing when we finish the HTTP span.
responseReady and responseReceived may be called before the HttpResponse (and status code) is available.
Instead of removing the stored context and finish span of the first callback, we keep the context until we see the real response status (or error), then finish the span once.

Motivation

Test test passthru request is traced was sometimes failing with, because the span was finishing too early, before status code was known

Additional Notes

With the passthru/NIO transport, SourceHandler.responseReady() and TargetHandler.responseReceived() can be called multiple times for the same connection
The first call can happen while the response is still null, and the actual 200 OK is set later.
Previously we removed the context and finished the span on that first call, so the later callback couldn’t tag the span

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@ValentinZakharov ValentinZakharov self-assigned this Jan 30, 2026
@ValentinZakharov ValentinZakharov added the type: enhancement Enhancements and improvements label Jan 30, 2026
@ValentinZakharov ValentinZakharov requested a review from a team as a code owner January 30, 2026 00:16
@ValentinZakharov ValentinZakharov added tag: flaky test Flaky tests inst: synapse Synapse Instrumentation labels Jan 30, 2026
@pr-commenter
Copy link

pr-commenter bot commented Jan 30, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vzakharov/synapse_passthru_fix
git_commit_date 1769704474 1769794674
git_commit_sha 02cc483 7bdce96
release_version 1.59.0-SNAPSHOT~02cc48359b 1.59.0-SNAPSHOT~7bdce96bb5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769796488 1769796488
ci_job_id 1390603435 1390603435
ci_pipeline_id 93864550 93864550
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-i569lep4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-i569lep4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~7bdce96bb5, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055905
Total [baseline] (10.923 s) : 0, 10923158
Agent [candidate] (1.059 s) : 0, 1058772
Total [candidate] (10.925 s) : 0, 10924978
section appsec
Agent [baseline] (1.23 s) : 0, 1229930
Total [baseline] (10.944 s) : 0, 10944242
Agent [candidate] (1.238 s) : 0, 1237873
Total [candidate] (10.946 s) : 0, 10946295
section iast
Agent [baseline] (1.226 s) : 0, 1226222
Total [baseline] (11.196 s) : 0, 11195816
Agent [candidate] (1.227 s) : 0, 1227055
Total [candidate] (11.182 s) : 0, 11181847
section profiling
Agent [baseline] (1.188 s) : 0, 1188379
Total [baseline] (10.909 s) : 0, 10908509
Agent [candidate] (1.19 s) : 0, 1190431
Total [candidate] (10.941 s) : 0, 10940665
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.23 s 174.025 ms (16.5%)
Agent iast 1.226 s 170.317 ms (16.1%)
Agent profiling 1.188 s 132.474 ms (12.5%)
Total tracing 10.923 s -
Total appsec 10.944 s 21.083 ms (0.2%)
Total iast 11.196 s 272.658 ms (2.5%)
Total profiling 10.909 s -14.649 ms (-0.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.238 s 179.1 ms (16.9%)
Agent iast 1.227 s 168.283 ms (15.9%)
Agent profiling 1.19 s 131.659 ms (12.4%)
Total tracing 10.925 s -
Total appsec 10.946 s 21.317 ms (0.2%)
Total iast 11.182 s 256.869 ms (2.4%)
Total profiling 10.941 s 15.688 ms (0.1%)
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~7bdce96bb5, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.171 ms) : 0, 1171
crashtracking [candidate] (1.17 ms) : 0, 1170
BytebuddyAgent [baseline] (623.125 ms) : 0, 623125
BytebuddyAgent [candidate] (622.164 ms) : 0, 622164
AgentMeter [baseline] (28.662 ms) : 0, 28662
AgentMeter [candidate] (28.706 ms) : 0, 28706
GlobalTracer [baseline] (256.623 ms) : 0, 256623
GlobalTracer [candidate] (256.938 ms) : 0, 256938
AppSec [baseline] (32.871 ms) : 0, 32871
AppSec [candidate] (32.775 ms) : 0, 32775
Debugger [baseline] (62.204 ms) : 0, 62204
Debugger [candidate] (60.418 ms) : 0, 60418
Remote Config [baseline] (613.589 µs) : 0, 614
Remote Config [candidate] (622.767 µs) : 0, 623
Telemetry [baseline] (9.099 ms) : 0, 9099
Telemetry [candidate] (10.697 ms) : 0, 10697
Flare Poller [baseline] (6.18 ms) : 0, 6180
Flare Poller [candidate] (9.889 ms) : 0, 9889
section appsec
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (651.144 ms) : 0, 651144
BytebuddyAgent [candidate] (656.083 ms) : 0, 656083
AgentMeter [baseline] (11.807 ms) : 0, 11807
AgentMeter [candidate] (11.901 ms) : 0, 11901
GlobalTracer [baseline] (257.272 ms) : 0, 257272
GlobalTracer [candidate] (258.824 ms) : 0, 258824
AppSec [baseline] (166.994 ms) : 0, 166994
AppSec [candidate] (167.837 ms) : 0, 167837
Debugger [baseline] (67.492 ms) : 0, 67492
Debugger [candidate] (67.364 ms) : 0, 67364
Remote Config [baseline] (658.736 µs) : 0, 659
Remote Config [candidate] (676.808 µs) : 0, 677
Telemetry [baseline] (9.189 ms) : 0, 9189
Telemetry [candidate] (9.291 ms) : 0, 9291
Flare Poller [baseline] (3.616 ms) : 0, 3616
Flare Poller [candidate] (3.616 ms) : 0, 3616
IAST [baseline] (25.363 ms) : 0, 25363
IAST [candidate] (25.722 ms) : 0, 25722
section iast
crashtracking [baseline] (1.171 ms) : 0, 1171
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (789.885 ms) : 0, 789885
BytebuddyAgent [candidate] (790.222 ms) : 0, 790222
AgentMeter [baseline] (11.187 ms) : 0, 11187
AgentMeter [candidate] (11.193 ms) : 0, 11193
GlobalTracer [baseline] (248.378 ms) : 0, 248378
GlobalTracer [candidate] (248.2 ms) : 0, 248200
AppSec [baseline] (32.12 ms) : 0, 32120
AppSec [candidate] (32.993 ms) : 0, 32993
Debugger [baseline] (68.706 ms) : 0, 68706
Debugger [candidate] (68.134 ms) : 0, 68134
Remote Config [baseline] (543.356 µs) : 0, 543
Remote Config [candidate] (552.888 µs) : 0, 553
Telemetry [baseline] (8.528 ms) : 0, 8528
Telemetry [candidate] (8.636 ms) : 0, 8636
Flare Poller [baseline] (3.535 ms) : 0, 3535
Flare Poller [candidate] (3.549 ms) : 0, 3549
IAST [baseline] (26.892 ms) : 0, 26892
IAST [candidate] (27.041 ms) : 0, 27041
section profiling
ProfilingAgent [baseline] (98.996 ms) : 0, 98996
ProfilingAgent [candidate] (99.673 ms) : 0, 99673
crashtracking [baseline] (1.214 ms) : 0, 1214
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (679.932 ms) : 0, 679932
BytebuddyAgent [candidate] (680.037 ms) : 0, 680037
AgentMeter [baseline] (8.653 ms) : 0, 8653
AgentMeter [candidate] (8.642 ms) : 0, 8642
GlobalTracer [baseline] (216.613 ms) : 0, 216613
GlobalTracer [candidate] (217.393 ms) : 0, 217393
AppSec [baseline] (32.372 ms) : 0, 32372
AppSec [candidate] (32.471 ms) : 0, 32471
Debugger [baseline] (67.473 ms) : 0, 67473
Debugger [candidate] (67.821 ms) : 0, 67821
Remote Config [baseline] (591.311 µs) : 0, 591
Remote Config [candidate] (594.843 µs) : 0, 595
Telemetry [baseline] (8.674 ms) : 0, 8674
Telemetry [candidate] (8.666 ms) : 0, 8666
Flare Poller [baseline] (3.787 ms) : 0, 3787
Flare Poller [candidate] (3.754 ms) : 0, 3754
Profiling [baseline] (99.562 ms) : 0, 99562
Profiling [candidate] (100.264 ms) : 0, 100264
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~7bdce96bb5, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055607
Total [baseline] (8.745 s) : 0, 8744692
Agent [candidate] (1.06 s) : 0, 1060059
Total [candidate] (8.728 s) : 0, 8727535
section iast
Agent [baseline] (1.223 s) : 0, 1222887
Total [baseline] (9.404 s) : 0, 9403867
Agent [candidate] (1.225 s) : 0, 1225097
Total [candidate] (9.399 s) : 0, 9399452
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.223 s 167.28 ms (15.8%)
Total tracing 8.745 s -
Total iast 9.404 s 659.175 ms (7.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.225 s 165.038 ms (15.6%)
Total tracing 8.728 s -
Total iast 9.399 s 671.917 ms (7.7%)
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~7bdce96bb5, baseline=1.59.0-SNAPSHOT~02cc48359b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.175 ms) : 0, 1175
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (622.009 ms) : 0, 622009
BytebuddyAgent [candidate] (625.27 ms) : 0, 625270
AgentMeter [baseline] (28.563 ms) : 0, 28563
AgentMeter [candidate] (28.791 ms) : 0, 28791
GlobalTracer [baseline] (256.882 ms) : 0, 256882
GlobalTracer [candidate] (258.225 ms) : 0, 258225
AppSec [baseline] (32.771 ms) : 0, 32771
AppSec [candidate] (32.779 ms) : 0, 32779
Debugger [baseline] (60.197 ms) : 0, 60197
Debugger [candidate] (60.881 ms) : 0, 60881
Remote Config [baseline] (607.69 µs) : 0, 608
Remote Config [candidate] (606.067 µs) : 0, 606
Telemetry [baseline] (9.781 ms) : 0, 9781
Telemetry [candidate] (9.112 ms) : 0, 9112
Flare Poller [baseline] (8.313 ms) : 0, 8313
Flare Poller [candidate] (7.663 ms) : 0, 7663
section iast
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (788.77 ms) : 0, 788770
BytebuddyAgent [candidate] (790.123 ms) : 0, 790123
AgentMeter [baseline] (11.192 ms) : 0, 11192
AgentMeter [candidate] (11.153 ms) : 0, 11153
GlobalTracer [baseline] (247.78 ms) : 0, 247780
GlobalTracer [candidate] (247.989 ms) : 0, 247989
AppSec [baseline] (32.811 ms) : 0, 32811
AppSec [candidate] (33.331 ms) : 0, 33331
Debugger [baseline] (66.626 ms) : 0, 66626
Debugger [candidate] (66.698 ms) : 0, 66698
Remote Config [baseline] (541.651 µs) : 0, 542
Remote Config [candidate] (543.439 µs) : 0, 543
Telemetry [baseline] (8.451 ms) : 0, 8451
Telemetry [candidate] (8.453 ms) : 0, 8453
Flare Poller [baseline] (3.457 ms) : 0, 3457
Flare Poller [candidate] (3.473 ms) : 0, 3473
IAST [baseline] (26.881 ms) : 0, 26881
IAST [candidate] (26.798 ms) : 0, 26798
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vzakharov/synapse_passthru_fix
git_commit_date 1769704474 1769794674
git_commit_sha 02cc483 7bdce96
release_version 1.59.0-SNAPSHOT~02cc48359b 1.59.0-SNAPSHOT~7bdce96bb5
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769796995 1769796995
ci_job_id 1390603436 1390603436
ci_pipeline_id 93864550 93864550
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-23slseqe 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-23slseqe 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+59.326µs; +186.201µs] or [+2.174%; +6.825%]
unsure
[+9.086µs; +352.523µs] or [+0.117%; +4.538%]
unstable
[-166.321op/s; +91.883op/s] or [-12.691%; +7.011%]
2.851ms 7.950ms 1273.312op/s 2.728ms 7.769ms 1310.531op/s
scenario:load:petclinic:appsec:high_load worse
[+510.779µs; +1181.743µs] or [+2.789%; +6.452%]
unsure
[+104.065µs; +1335.339µs] or [+0.346%; +4.443%]
unstable
[-32.743op/s; +11.243op/s] or [-13.092%; +4.495%]
19.162ms 30.771ms 239.344op/s 18.316ms 30.052ms 250.094op/s
scenario:load:petclinic:code_origins:high_load better
[-740.401µs; -411.912µs] or [-4.214%; -2.344%]
same
[-634.167µs; +357.959µs] or [-2.223%; +1.255%]
unstable
[-16.584op/s; +30.272op/s] or [-6.361%; +11.611%]
16.995ms 28.389ms 267.562op/s 17.571ms 28.527ms 260.719op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~7bdce96bb5, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.208 ms) : 1196, 1220
.   : milestone, 1208,
iast (3.128 ms) : 3089, 3166
.   : milestone, 3128,
iast_FULL (5.912 ms) : 5852, 5973
.   : milestone, 5912,
iast_GLOBAL (3.497 ms) : 3436, 3558
.   : milestone, 3497,
profiling (2.348 ms) : 2323, 2373
.   : milestone, 2348,
tracing (1.796 ms) : 1781, 1812
.   : milestone, 1796,
section candidate
no_agent (1.181 ms) : 1169, 1193
.   : milestone, 1181,
iast (3.174 ms) : 3127, 3222
.   : milestone, 3174,
iast_FULL (5.97 ms) : 5909, 6030
.   : milestone, 5970,
iast_GLOBAL (3.602 ms) : 3544, 3660
.   : milestone, 3602,
profiling (2.157 ms) : 2138, 2177
.   : milestone, 2157,
tracing (1.885 ms) : 1869, 1902
.   : milestone, 1885,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.208 ms [1.196 ms, 1.22 ms] -
iast 3.128 ms [3.089 ms, 3.166 ms] 1.92 ms (158.9%)
iast_FULL 5.912 ms [5.852 ms, 5.973 ms] 4.704 ms (389.4%)
iast_GLOBAL 3.497 ms [3.436 ms, 3.558 ms] 2.289 ms (189.4%)
profiling 2.348 ms [2.323 ms, 2.373 ms] 1.14 ms (94.4%)
tracing 1.796 ms [1.781 ms, 1.812 ms] 588.364 µs (48.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.181 ms [1.169 ms, 1.193 ms] -
iast 3.174 ms [3.127 ms, 3.222 ms] 1.993 ms (168.8%)
iast_FULL 5.97 ms [5.909 ms, 6.03 ms] 4.789 ms (405.5%)
iast_GLOBAL 3.602 ms [3.544 ms, 3.66 ms] 2.421 ms (205.0%)
profiling 2.157 ms [2.138 ms, 2.177 ms] 976.345 µs (82.7%)
tracing 1.885 ms [1.869 ms, 1.902 ms] 704.314 µs (59.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~7bdce96bb5, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.853 ms) : 17669, 18036
.   : milestone, 17853,
appsec (18.664 ms) : 18473, 18855
.   : milestone, 18664,
code_origins (17.895 ms) : 17717, 18073
.   : milestone, 17895,
iast (17.655 ms) : 17481, 17829
.   : milestone, 17655,
profiling (18.793 ms) : 18602, 18985
.   : milestone, 18793,
tracing (17.457 ms) : 17284, 17631
.   : milestone, 17457,
section candidate
no_agent (18.433 ms) : 18240, 18627
.   : milestone, 18433,
appsec (19.502 ms) : 19308, 19695
.   : milestone, 19502,
code_origins (17.435 ms) : 17263, 17607
.   : milestone, 17435,
iast (17.791 ms) : 17612, 17970
.   : milestone, 17791,
profiling (18.8 ms) : 18609, 18990
.   : milestone, 18800,
tracing (17.531 ms) : 17358, 17704
.   : milestone, 17531,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.853 ms [17.669 ms, 18.036 ms] -
appsec 18.664 ms [18.473 ms, 18.855 ms] 811.606 µs (4.5%)
code_origins 17.895 ms [17.717 ms, 18.073 ms] 42.061 µs (0.2%)
iast 17.655 ms [17.481 ms, 17.829 ms] -197.734 µs (-1.1%)
profiling 18.793 ms [18.602 ms, 18.985 ms] 940.84 µs (5.3%)
tracing 17.457 ms [17.284 ms, 17.631 ms] -395.301 µs (-2.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.433 ms [18.24 ms, 18.627 ms] -
appsec 19.502 ms [19.308 ms, 19.695 ms] 1.069 ms (5.8%)
code_origins 17.435 ms [17.263 ms, 17.607 ms] -997.945 µs (-5.4%)
iast 17.791 ms [17.612 ms, 17.97 ms] -642.067 µs (-3.5%)
profiling 18.8 ms [18.609 ms, 18.99 ms] 366.512 µs (2.0%)
tracing 17.531 ms [17.358 ms, 17.704 ms] -902.097 µs (-4.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master vzakharov/synapse_passthru_fix
git_commit_date 1769704474 1769794674
git_commit_sha 02cc483 7bdce96
release_version 1.59.0-SNAPSHOT~02cc48359b 1.59.0-SNAPSHOT~7bdce96bb5
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769796651 1769796651
ci_job_id 1390603437 1390603437
ci_pipeline_id 93864550 93864550
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-z9bdrxrv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-z9bdrxrv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~7bdce96bb5, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1494
.   : milestone, 1482,
appsec (2.498 ms) : 2444, 2552
.   : milestone, 2498,
iast (2.247 ms) : 2178, 2316
.   : milestone, 2247,
iast_GLOBAL (2.286 ms) : 2217, 2355
.   : milestone, 2286,
profiling (2.074 ms) : 2020, 2129
.   : milestone, 2074,
tracing (2.061 ms) : 2008, 2114
.   : milestone, 2061,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.656 ms) : 3438, 3873
.   : milestone, 3656,
iast (2.257 ms) : 2188, 2326
.   : milestone, 2257,
iast_GLOBAL (2.307 ms) : 2238, 2377
.   : milestone, 2307,
profiling (2.094 ms) : 2039, 2149
.   : milestone, 2094,
tracing (2.079 ms) : 2025, 2133
.   : milestone, 2079,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.494 ms] -
appsec 2.498 ms [2.444 ms, 2.552 ms] 1.016 ms (68.5%)
iast 2.247 ms [2.178 ms, 2.316 ms] 764.665 µs (51.6%)
iast_GLOBAL 2.286 ms [2.217 ms, 2.355 ms] 803.611 µs (54.2%)
profiling 2.074 ms [2.02 ms, 2.129 ms] 592.262 µs (40.0%)
tracing 2.061 ms [2.008 ms, 2.114 ms] 578.745 µs (39.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 3.656 ms [3.438 ms, 3.873 ms] 2.179 ms (147.6%)
iast 2.257 ms [2.188 ms, 2.326 ms] 780.418 µs (52.9%)
iast_GLOBAL 2.307 ms [2.238 ms, 2.377 ms] 831.051 µs (56.3%)
profiling 2.094 ms [2.039 ms, 2.149 ms] 618.178 µs (41.9%)
tracing 2.079 ms [2.025 ms, 2.133 ms] 602.542 µs (40.8%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~7bdce96bb5, baseline=1.59.0-SNAPSHOT~02cc48359b
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.695 s) : 14695000, 14695000
.   : milestone, 14695000,
appsec (14.981 s) : 14981000, 14981000
.   : milestone, 14981000,
iast (18.058 s) : 18058000, 18058000
.   : milestone, 18058000,
iast_GLOBAL (17.746 s) : 17746000, 17746000
.   : milestone, 17746000,
profiling (15.129 s) : 15129000, 15129000
.   : milestone, 15129000,
tracing (15.086 s) : 15086000, 15086000
.   : milestone, 15086000,
section candidate
no_agent (15.073 s) : 15073000, 15073000
.   : milestone, 15073000,
appsec (15.105 s) : 15105000, 15105000
.   : milestone, 15105000,
iast (18.015 s) : 18015000, 18015000
.   : milestone, 18015000,
iast_GLOBAL (17.703 s) : 17703000, 17703000
.   : milestone, 17703000,
profiling (14.995 s) : 14995000, 14995000
.   : milestone, 14995000,
tracing (14.738 s) : 14738000, 14738000
.   : milestone, 14738000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.695 s [14.695 s, 14.695 s] -
appsec 14.981 s [14.981 s, 14.981 s] 286.0 ms (1.9%)
iast 18.058 s [18.058 s, 18.058 s] 3.363 s (22.9%)
iast_GLOBAL 17.746 s [17.746 s, 17.746 s] 3.051 s (20.8%)
profiling 15.129 s [15.129 s, 15.129 s] 434.0 ms (3.0%)
tracing 15.086 s [15.086 s, 15.086 s] 391.0 ms (2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.073 s [15.073 s, 15.073 s] -
appsec 15.105 s [15.105 s, 15.105 s] 32.0 ms (0.2%)
iast 18.015 s [18.015 s, 18.015 s] 2.942 s (19.5%)
iast_GLOBAL 17.703 s [17.703 s, 17.703 s] 2.63 s (17.4%)
profiling 14.995 s [14.995 s, 14.995 s] -78.0 ms (-0.5%)
tracing 14.738 s [14.738 s, 14.738 s] -335.0 ms (-2.2%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

inst: synapse Synapse Instrumentation tag: flaky test Flaky tests type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants