Skip to content

Parallelize test jobs result download aggegation#10668

Draft
bric3 wants to merge 2 commits intomasterfrom
bdu/faster-aggregate
Draft

Parallelize test jobs result download aggegation#10668
bric3 wants to merge 2 commits intomasterfrom
bdu/faster-aggregate

Conversation

@bric3
Copy link
Contributor

@bric3 bric3 commented Feb 24, 2026

What Does This Do

Gitlab download job artifacts sequentially. Which might be slow, this PR proposes to download artifact directly but in parallel, using the GNU parallel tool so that it maintains a steady 8 "working" download.

Motivation

Most of the job duration spent on downloading these artifacts. Reducing this part should improve the jobs duration.

@bric3 bric3 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Feb 24, 2026
@pr-commenter
Copy link

pr-commenter bot commented Feb 24, 2026 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/faster-aggregate
git_commit_date 1771927866 1771949503
git_commit_sha d77d632 7d0f2ca
release_version 1.60.0-SNAPSHOT~d77d632808 1.60.0-SNAPSHOT~7d0f2ca778
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771951344 1771951344
ci_job_id 1452169850 1452169850
ci_pipeline_id 98602384 98602384
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-8y2qrsvm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-8y2qrsvm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~7d0f2ca778, baseline=1.60.0-SNAPSHOT~d77d632808

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1064845
Total [baseline] (10.828 s) : 0, 10827594
Agent [candidate] (1.068 s) : 0, 1068053
Total [candidate] (10.952 s) : 0, 10951912
section appsec
Agent [baseline] (1.239 s) : 0, 1238549
Total [baseline] (11.062 s) : 0, 11062244
Agent [candidate] (1.244 s) : 0, 1244354
Total [candidate] (11.046 s) : 0, 11045852
section iast
Agent [baseline] (1.234 s) : 0, 1234434
Total [baseline] (11.227 s) : 0, 11227275
Agent [candidate] (1.241 s) : 0, 1240603
Total [candidate] (11.27 s) : 0, 11269921
section profiling
Agent [baseline] (1.199 s) : 0, 1198547
Total [baseline] (10.921 s) : 0, 10921314
Agent [candidate] (1.191 s) : 0, 1190555
Total [candidate] (10.932 s) : 0, 10931512
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.239 s 173.704 ms (16.3%)
Agent iast 1.234 s 169.589 ms (15.9%)
Agent profiling 1.199 s 133.702 ms (12.6%)
Total tracing 10.828 s -
Total appsec 11.062 s 234.65 ms (2.2%)
Total iast 11.227 s 399.681 ms (3.7%)
Total profiling 10.921 s 93.72 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.244 s 176.3 ms (16.5%)
Agent iast 1.241 s 172.55 ms (16.2%)
Agent profiling 1.191 s 122.502 ms (11.5%)
Total tracing 10.952 s -
Total appsec 11.046 s 93.94 ms (0.9%)
Total iast 11.27 s 318.009 ms (2.9%)
Total profiling 10.932 s -20.4 ms (-0.2%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~7d0f2ca778, baseline=1.60.0-SNAPSHOT~d77d632808

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (626.648 ms) : 0, 626648
BytebuddyAgent [candidate] (628.866 ms) : 0, 628866
AgentMeter [baseline] (29.048 ms) : 0, 29048
AgentMeter [candidate] (29.043 ms) : 0, 29043
GlobalTracer [baseline] (256.949 ms) : 0, 256949
GlobalTracer [candidate] (257.588 ms) : 0, 257588
AppSec [baseline] (32.968 ms) : 0, 32968
AppSec [candidate] (32.939 ms) : 0, 32939
Debugger [baseline] (65.259 ms) : 0, 65259
Debugger [candidate] (65.516 ms) : 0, 65516
Remote Config [baseline] (611.209 µs) : 0, 611
Remote Config [candidate] (667.015 µs) : 0, 667
Telemetry [baseline] (10.662 ms) : 0, 10662
Telemetry [candidate] (10.831 ms) : 0, 10831
Flare Poller [baseline] (5.32 ms) : 0, 5320
Flare Poller [candidate] (5.401 ms) : 0, 5401
section appsec
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (657.06 ms) : 0, 657060
BytebuddyAgent [candidate] (658.732 ms) : 0, 658732
AgentMeter [baseline] (11.973 ms) : 0, 11973
AgentMeter [candidate] (11.998 ms) : 0, 11998
GlobalTracer [baseline] (258.626 ms) : 0, 258626
GlobalTracer [candidate] (260.174 ms) : 0, 260174
IAST [baseline] (25.126 ms) : 0, 25126
IAST [candidate] (25.814 ms) : 0, 25814
AppSec [baseline] (168.149 ms) : 0, 168149
AppSec [candidate] (169.181 ms) : 0, 169181
Debugger [baseline] (66.892 ms) : 0, 66892
Debugger [candidate] (67.242 ms) : 0, 67242
Remote Config [baseline] (642.369 µs) : 0, 642
Remote Config [candidate] (648.909 µs) : 0, 649
Telemetry [baseline] (9.265 ms) : 0, 9265
Telemetry [candidate] (9.623 ms) : 0, 9623
Flare Poller [baseline] (3.66 ms) : 0, 3660
Flare Poller [candidate] (3.724 ms) : 0, 3724
section iast
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.208 ms) : 0, 1208
BytebuddyAgent [baseline] (797.79 ms) : 0, 797790
BytebuddyAgent [candidate] (801.948 ms) : 0, 801948
AgentMeter [baseline] (11.283 ms) : 0, 11283
AgentMeter [candidate] (11.54 ms) : 0, 11540
GlobalTracer [baseline] (247.837 ms) : 0, 247837
GlobalTracer [candidate] (248.456 ms) : 0, 248456
IAST [baseline] (27.105 ms) : 0, 27105
IAST [candidate] (27.272 ms) : 0, 27272
AppSec [baseline] (35.864 ms) : 0, 35864
AppSec [candidate] (33.229 ms) : 0, 33229
Debugger [baseline] (64.704 ms) : 0, 64704
Debugger [candidate] (67.932 ms) : 0, 67932
Remote Config [baseline] (532.767 µs) : 0, 533
Remote Config [candidate] (557.625 µs) : 0, 558
Telemetry [baseline] (8.719 ms) : 0, 8719
Telemetry [candidate] (8.824 ms) : 0, 8824
Flare Poller [baseline] (3.448 ms) : 0, 3448
Flare Poller [candidate] (3.538 ms) : 0, 3538
section profiling
crashtracking [baseline] (1.184 ms) : 0, 1184
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (687.359 ms) : 0, 687359
BytebuddyAgent [candidate] (682.349 ms) : 0, 682349
AgentMeter [baseline] (8.62 ms) : 0, 8620
AgentMeter [candidate] (8.606 ms) : 0, 8606
GlobalTracer [baseline] (217.176 ms) : 0, 217176
GlobalTracer [candidate] (216.084 ms) : 0, 216084
AppSec [baseline] (32.96 ms) : 0, 32960
AppSec [candidate] (32.716 ms) : 0, 32716
Debugger [baseline] (67.479 ms) : 0, 67479
Debugger [candidate] (67.241 ms) : 0, 67241
Remote Config [baseline] (644.657 µs) : 0, 645
Remote Config [candidate] (623.877 µs) : 0, 624
Telemetry [baseline] (9.0 ms) : 0, 9000
Telemetry [candidate] (9.002 ms) : 0, 9002
Flare Poller [baseline] (3.739 ms) : 0, 3739
Flare Poller [candidate] (3.697 ms) : 0, 3697
ProfilingAgent [baseline] (99.394 ms) : 0, 99394
ProfilingAgent [candidate] (98.433 ms) : 0, 98433
Profiling [baseline] (99.976 ms) : 0, 99976
Profiling [candidate] (99.006 ms) : 0, 99006
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~7d0f2ca778, baseline=1.60.0-SNAPSHOT~d77d632808

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1069369
Total [baseline] (8.774 s) : 0, 8774416
Agent [candidate] (1.08 s) : 0, 1079693
Total [candidate] (8.778 s) : 0, 8778497
section iast
Agent [baseline] (1.232 s) : 0, 1231832
Total [baseline] (9.361 s) : 0, 9360810
Agent [candidate] (1.228 s) : 0, 1228463
Total [candidate] (9.366 s) : 0, 9365976
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.232 s 162.464 ms (15.2%)
Total tracing 8.774 s -
Total iast 9.361 s 586.394 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent iast 1.228 s 148.77 ms (13.8%)
Total tracing 8.778 s -
Total iast 9.366 s 587.479 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~7d0f2ca778, baseline=1.60.0-SNAPSHOT~d77d632808

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.214 ms) : 0, 1214
BytebuddyAgent [baseline] (631.442 ms) : 0, 631442
BytebuddyAgent [candidate] (636.749 ms) : 0, 636749
AgentMeter [baseline] (29.2 ms) : 0, 29200
AgentMeter [candidate] (29.503 ms) : 0, 29503
GlobalTracer [baseline] (258.754 ms) : 0, 258754
GlobalTracer [candidate] (260.712 ms) : 0, 260712
AppSec [baseline] (33.166 ms) : 0, 33166
AppSec [candidate] (33.801 ms) : 0, 33801
Debugger [baseline] (63.183 ms) : 0, 63183
Debugger [candidate] (67.24 ms) : 0, 67240
Remote Config [baseline] (624.375 µs) : 0, 624
Remote Config [candidate] (612.972 µs) : 0, 613
Telemetry [baseline] (10.746 ms) : 0, 10746
Telemetry [candidate] (9.128 ms) : 0, 9128
Flare Poller [baseline] (4.703 ms) : 0, 4703
Flare Poller [candidate] (4.527 ms) : 0, 4527
section iast
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (796.13 ms) : 0, 796130
BytebuddyAgent [candidate] (794.136 ms) : 0, 794136
AgentMeter [baseline] (11.313 ms) : 0, 11313
AgentMeter [candidate] (11.271 ms) : 0, 11271
GlobalTracer [baseline] (247.581 ms) : 0, 247581
GlobalTracer [candidate] (246.858 ms) : 0, 246858
IAST [baseline] (27.208 ms) : 0, 27208
IAST [candidate] (26.808 ms) : 0, 26808
AppSec [baseline] (34.959 ms) : 0, 34959
AppSec [candidate] (35.477 ms) : 0, 35477
Debugger [baseline] (64.736 ms) : 0, 64736
Debugger [candidate] (64.176 ms) : 0, 64176
Remote Config [baseline] (535.49 µs) : 0, 535
Remote Config [candidate] (527.44 µs) : 0, 527
Telemetry [baseline] (8.676 ms) : 0, 8676
Telemetry [candidate] (8.598 ms) : 0, 8598
Flare Poller [baseline] (3.471 ms) : 0, 3471
Flare Poller [candidate] (3.457 ms) : 0, 3457
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/faster-aggregate
git_commit_date 1771927866 1771949503
git_commit_sha d77d632 7d0f2ca
release_version 1.60.0-SNAPSHOT~d77d632808 1.60.0-SNAPSHOT~7d0f2ca778
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771951841 1771951841
ci_job_id 1452169851 1452169851
ci_pipeline_id 98602384 98602384
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-3deyf2h9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-3deyf2h9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 3 performance regressions! Performance is the same for 15 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load better
[-217.997µs; -115.298µs] or [-7.619%; -4.030%]		 unsure
[-554.368µs; -153.023µs] or [-6.883%; -1.900%]		 unstable
[-78.945op/s; +180.195op/s] or [-6.233%; +14.228%]		 2.695ms 7.701ms 1317.094op/s 2.861ms 8.054ms 1266.469op/s
scenario:load:insecure-bank:iast_FULL:high_load worse
[+149.765µs; +418.332µs] or [+2.974%; +8.307%]		 worse
[+340.318µs; +1027.707µs] or [+2.814%; +8.497%]		 unstable
[-109.903op/s; +35.091op/s] or [-13.601%; +4.343%]		 5.320ms 12.779ms 770.625op/s 5.036ms 12.095ms 808.031op/s
scenario:load:petclinic:tracing:high_load worse
[+505.814µs; +1486.596µs] or [+2.927%; +8.604%]		 same
[-151.823µs; +1447.087µs] or [-0.525%; +5.007%]		 unstable
[-35.393op/s; +11.830op/s] or [-13.462%; +4.500%]		 18.275ms 29.548ms 251.125op/s 17.278ms 28.900ms 262.906op/s
scenario:load:petclinic:profiling:high_load better
[-1.599ms; -0.788ms] or [-8.205%; -4.045%]		 unsure
[-1.902ms; -0.415ms] or [-6.066%; -1.323%]		 unstable
[-8.052op/s; +36.052op/s] or [-3.420%; +15.313%]		 18.295ms 30.191ms 249.438op/s 19.488ms 31.349ms 235.438op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~7d0f2ca778, baseline=1.60.0-SNAPSHOT~d77d632808
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.375 ms) : 17200, 17550
.   : milestone, 17375,
appsec (18.637 ms) : 18451, 18823
.   : milestone, 18637,
code_origins (17.694 ms) : 17520, 17869
.   : milestone, 17694,
iast (17.37 ms) : 17197, 17543
.   : milestone, 17370,
profiling (19.826 ms) : 19626, 20026
.   : milestone, 19826,
tracing (17.748 ms) : 17570, 17927
.   : milestone, 17748,
section candidate
no_agent (17.526 ms) : 17348, 17704
.   : milestone, 17526,
appsec (18.559 ms) : 18368, 18750
.   : milestone, 18559,
code_origins (17.828 ms) : 17651, 18005
.   : milestone, 17828,
iast (17.536 ms) : 17362, 17711
.   : milestone, 17536,
profiling (18.71 ms) : 18518, 18902
.   : milestone, 18710,
tracing (18.585 ms) : 18398, 18771
.   : milestone, 18585,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.375 ms [17.2 ms, 17.55 ms] -
appsec 18.637 ms [18.451 ms, 18.823 ms] 1.262 ms (7.3%)
code_origins 17.694 ms [17.52 ms, 17.869 ms] 319.194 µs (1.8%)
iast 17.37 ms [17.197 ms, 17.543 ms] -4.638 µs (-0.0%)
profiling 19.826 ms [19.626 ms, 20.026 ms] 2.451 ms (14.1%)
tracing 17.748 ms [17.57 ms, 17.927 ms] 373.27 µs (2.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.526 ms [17.348 ms, 17.704 ms] -
appsec 18.559 ms [18.368 ms, 18.75 ms] 1.033 ms (5.9%)
code_origins 17.828 ms [17.651 ms, 18.005 ms] 301.949 µs (1.7%)
iast 17.536 ms [17.362 ms, 17.711 ms] 10.121 µs (0.1%)
profiling 18.71 ms [18.518 ms, 18.902 ms] 1.184 ms (6.8%)
tracing 18.585 ms [18.398 ms, 18.771 ms] 1.059 ms (6.0%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~7d0f2ca778, baseline=1.60.0-SNAPSHOT~d77d632808
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.236 ms) : 1223, 1249
.   : milestone, 1236,
iast (3.268 ms) : 3225, 3311
.   : milestone, 3268,
iast_FULL (5.721 ms) : 5663, 5778
.   : milestone, 5721,
iast_GLOBAL (3.623 ms) : 3566, 3680
.   : milestone, 3623,
profiling (1.98 ms) : 1963, 1998
.   : milestone, 1980,
tracing (1.795 ms) : 1780, 1810
.   : milestone, 1795,
section candidate
no_agent (1.185 ms) : 1174, 1196
.   : milestone, 1185,
iast (3.226 ms) : 3182, 3269
.   : milestone, 3226,
iast_FULL (6.003 ms) : 5942, 6064
.   : milestone, 6003,
iast_GLOBAL (3.479 ms) : 3416, 3543
.   : milestone, 3479,
profiling (2.046 ms) : 2028, 2064
.   : milestone, 2046,
tracing (1.799 ms) : 1783, 1815
.   : milestone, 1799,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.236 ms [1.223 ms, 1.249 ms] -
iast 3.268 ms [3.225 ms, 3.311 ms] 2.032 ms (164.4%)
iast_FULL 5.721 ms [5.663 ms, 5.778 ms] 4.485 ms (362.9%)
iast_GLOBAL 3.623 ms [3.566 ms, 3.68 ms] 2.387 ms (193.1%)
profiling 1.98 ms [1.963 ms, 1.998 ms] 744.317 µs (60.2%)
tracing 1.795 ms [1.78 ms, 1.81 ms] 558.856 µs (45.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.174 ms, 1.196 ms] -
iast 3.226 ms [3.182 ms, 3.269 ms] 2.041 ms (172.2%)
iast_FULL 6.003 ms [5.942 ms, 6.064 ms] 4.818 ms (406.6%)
iast_GLOBAL 3.479 ms [3.416 ms, 3.543 ms] 2.294 ms (193.6%)
profiling 2.046 ms [2.028 ms, 2.064 ms] 861.286 µs (72.7%)
tracing 1.799 ms [1.783 ms, 1.815 ms] 614.164 µs (51.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bdu/faster-aggregate
git_commit_date 1771927866 1771949503
git_commit_sha d77d632 7d0f2ca
release_version 1.60.0-SNAPSHOT~d77d632808 1.60.0-SNAPSHOT~7d0f2ca778
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771951496 1771951496
ci_job_id 1452169852 1452169852
ci_pipeline_id 98602384 98602384
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-4q3qfcao 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-4q3qfcao 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~7d0f2ca778, baseline=1.60.0-SNAPSHOT~d77d632808
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.577 ms) : 2519, 2635
.   : milestone, 2577,
iast (2.256 ms) : 2187, 2325
.   : milestone, 2256,
iast_GLOBAL (2.298 ms) : 2229, 2368
.   : milestone, 2298,
profiling (2.492 ms) : 2276, 2708
.   : milestone, 2492,
tracing (2.073 ms) : 2019, 2126
.   : milestone, 2073,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.779 ms) : 3558, 4001
.   : milestone, 3779,
iast (2.251 ms) : 2182, 2320
.   : milestone, 2251,
iast_GLOBAL (2.307 ms) : 2237, 2377
.   : milestone, 2307,
profiling (2.079 ms) : 2025, 2134
.   : milestone, 2079,
tracing (2.075 ms) : 2022, 2129
.   : milestone, 2075,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.577 ms [2.519 ms, 2.635 ms] 1.101 ms (74.6%)
iast 2.256 ms [2.187 ms, 2.325 ms] 780.471 µs (52.9%)
iast_GLOBAL 2.298 ms [2.229 ms, 2.368 ms] 822.67 µs (55.7%)
profiling 2.492 ms [2.276 ms, 2.708 ms] 1.017 ms (68.9%)
tracing 2.073 ms [2.019 ms, 2.126 ms] 596.925 µs (40.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 3.779 ms [3.558 ms, 4.001 ms] 2.303 ms (156.0%)
iast 2.251 ms [2.182 ms, 2.32 ms] 774.817 µs (52.5%)
iast_GLOBAL 2.307 ms [2.237 ms, 2.377 ms] 831.12 µs (56.3%)
profiling 2.079 ms [2.025 ms, 2.134 ms] 603.182 µs (40.9%)
tracing 2.075 ms [2.022 ms, 2.129 ms] 599.422 µs (40.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~7d0f2ca778, baseline=1.60.0-SNAPSHOT~d77d632808
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.352 s) : 15352000, 15352000
.   : milestone, 15352000,
appsec (14.786 s) : 14786000, 14786000
.   : milestone, 14786000,
iast (18.082 s) : 18082000, 18082000
.   : milestone, 18082000,
iast_GLOBAL (17.704 s) : 17704000, 17704000
.   : milestone, 17704000,
profiling (14.963 s) : 14963000, 14963000
.   : milestone, 14963000,
tracing (14.664 s) : 14664000, 14664000
.   : milestone, 14664000,
section candidate
no_agent (15.716 s) : 15716000, 15716000
.   : milestone, 15716000,
appsec (14.951 s) : 14951000, 14951000
.   : milestone, 14951000,
iast (18.01 s) : 18010000, 18010000
.   : milestone, 18010000,
iast_GLOBAL (18.071 s) : 18071000, 18071000
.   : milestone, 18071000,
profiling (14.643 s) : 14643000, 14643000
.   : milestone, 14643000,
tracing (15.029 s) : 15029000, 15029000
.   : milestone, 15029000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.352 s [15.352 s, 15.352 s] -
appsec 14.786 s [14.786 s, 14.786 s] -566.0 ms (-3.7%)
iast 18.082 s [18.082 s, 18.082 s] 2.73 s (17.8%)
iast_GLOBAL 17.704 s [17.704 s, 17.704 s] 2.352 s (15.3%)
profiling 14.963 s [14.963 s, 14.963 s] -389.0 ms (-2.5%)
tracing 14.664 s [14.664 s, 14.664 s] -688.0 ms (-4.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.716 s [15.716 s, 15.716 s] -
appsec 14.951 s [14.951 s, 14.951 s] -765.0 ms (-4.9%)
iast 18.01 s [18.01 s, 18.01 s] 2.294 s (14.6%)
iast_GLOBAL 18.071 s [18.071 s, 18.071 s] 2.355 s (15.0%)
profiling 14.643 s [14.643 s, 14.643 s] -1.073 s (-6.8%)
tracing 15.029 s [15.029 s, 15.029 s] -687.0 ms (-4.4%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD Awaiting requested review from AlexeyKuznetsov-DD

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@bric3