Skip to content

Spark Launcher instrumentation: Capture time app-related metrics#10708

Draft
aboitreaud wants to merge 1 commit intomasterfrom
adrien.boitreaud/spark-launcher-metrics
Draft

Spark Launcher instrumentation: Capture time app-related metrics#10708
aboitreaud wants to merge 1 commit intomasterfrom
adrien.boitreaud/spark-launcher-metrics

Conversation

@aboitreaud
Copy link
Contributor

@aboitreaud aboitreaud commented Mar 1, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@pr-commenter
Copy link

pr-commenter bot commented Mar 1, 2026

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/spark-launcher-metrics
git_commit_date 1772385877 1772400496
git_commit_sha b0ab971 4cbda77
release_version 1.60.0-SNAPSHOT~b0ab971941 1.60.0-SNAPSHOT~4cbda770c9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772402300 1772402300
ci_job_id 1465644949 1465644949
ci_pipeline_id 99666940 99666940
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-om9brgq6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-om9brgq6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~4cbda770c9, baseline=1.60.0-SNAPSHOT~b0ab971941

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.066 s) : 0, 1066015
Total [baseline] (8.742 s) : 0, 8741751
Agent [candidate] (1.064 s) : 0, 1064177
Total [candidate] (8.733 s) : 0, 8732913
section iast
Agent [baseline] (1.236 s) : 0, 1236259
Total [baseline] (9.362 s) : 0, 9362288
Agent [candidate] (1.248 s) : 0, 1247807
Total [candidate] (9.375 s) : 0, 9375470
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.236 s 170.245 ms (16.0%)
Total tracing 8.742 s -
Total iast 9.362 s 620.537 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.248 s 183.631 ms (17.3%)
Total tracing 8.733 s -
Total iast 9.375 s 642.557 ms (7.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~4cbda770c9, baseline=1.60.0-SNAPSHOT~b0ab971941

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (628.686 ms) : 0, 628686
BytebuddyAgent [candidate] (628.27 ms) : 0, 628270
AgentMeter [baseline] (29.176 ms) : 0, 29176
AgentMeter [candidate] (28.991 ms) : 0, 28991
GlobalTracer [baseline] (257.483 ms) : 0, 257483
GlobalTracer [candidate] (257.914 ms) : 0, 257914
AppSec [baseline] (33.165 ms) : 0, 33165
AppSec [candidate] (32.795 ms) : 0, 32795
Debugger [baseline] (62.721 ms) : 0, 62721
Debugger [candidate] (65.493 ms) : 0, 65493
Remote Config [baseline] (606.604 µs) : 0, 607
Remote Config [candidate] (605.35 µs) : 0, 605
Telemetry [baseline] (10.673 ms) : 0, 10673
Telemetry [candidate] (9.013 ms) : 0, 9013
Flare Poller [baseline] (6.248 ms) : 0, 6248
Flare Poller [candidate] (3.797 ms) : 0, 3797
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.204 ms) : 0, 1204
BytebuddyAgent [baseline] (800.233 ms) : 0, 800233
BytebuddyAgent [candidate] (808.359 ms) : 0, 808359
AgentMeter [baseline] (11.529 ms) : 0, 11529
AgentMeter [candidate] (11.826 ms) : 0, 11826
GlobalTracer [baseline] (248.151 ms) : 0, 248151
GlobalTracer [candidate] (250.088 ms) : 0, 250088
IAST [baseline] (27.168 ms) : 0, 27168
IAST [candidate] (27.486 ms) : 0, 27486
AppSec [baseline] (35.064 ms) : 0, 35064
AppSec [candidate] (34.487 ms) : 0, 34487
Debugger [baseline] (64.375 ms) : 0, 64375
Debugger [candidate] (65.532 ms) : 0, 65532
Remote Config [baseline] (544.029 µs) : 0, 544
Remote Config [candidate] (526.727 µs) : 0, 527
Telemetry [baseline] (8.575 ms) : 0, 8575
Telemetry [candidate] (8.569 ms) : 0, 8569
Flare Poller [baseline] (3.425 ms) : 0, 3425
Flare Poller [candidate] (3.452 ms) : 0, 3452
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~4cbda770c9, baseline=1.60.0-SNAPSHOT~b0ab971941

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1065138
Total [baseline] (10.885 s) : 0, 10885427
Agent [candidate] (1.073 s) : 0, 1072573
Total [candidate] (10.888 s) : 0, 10888086
section appsec
Agent [baseline] (1.246 s) : 0, 1246442
Total [baseline] (11.01 s) : 0, 11010283
Agent [candidate] (1.237 s) : 0, 1237383
Total [candidate] (11.027 s) : 0, 11026729
section iast
Agent [baseline] (1.233 s) : 0, 1232722
Total [baseline] (11.368 s) : 0, 11368383
Agent [candidate] (1.229 s) : 0, 1228505
Total [candidate] (11.226 s) : 0, 11226139
section profiling
Agent [baseline] (1.19 s) : 0, 1189530
Total [baseline] (10.963 s) : 0, 10963122
Agent [candidate] (1.189 s) : 0, 1189157
Total [candidate] (10.892 s) : 0, 10892218
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.065 s -
Agent appsec 1.246 s 181.304 ms (17.0%)
Agent iast 1.233 s 167.584 ms (15.7%)
Agent profiling 1.19 s 124.391 ms (11.7%)
Total tracing 10.885 s -
Total appsec 11.01 s 124.856 ms (1.1%)
Total iast 11.368 s 482.956 ms (4.4%)
Total profiling 10.963 s 77.695 ms (0.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.073 s -
Agent appsec 1.237 s 164.81 ms (15.4%)
Agent iast 1.229 s 155.932 ms (14.5%)
Agent profiling 1.189 s 116.584 ms (10.9%)
Total tracing 10.888 s -
Total appsec 11.027 s 138.643 ms (1.3%)
Total iast 11.226 s 338.053 ms (3.1%)
Total profiling 10.892 s 4.133 ms (0.0%) 
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~4cbda770c9, baseline=1.60.0-SNAPSHOT~b0ab971941

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (626.68 ms) : 0, 626680
BytebuddyAgent [candidate] (631.589 ms) : 0, 631589
AgentMeter [baseline] (29.048 ms) : 0, 29048
AgentMeter [candidate] (29.277 ms) : 0, 29277
GlobalTracer [baseline] (257.523 ms) : 0, 257523
GlobalTracer [candidate] (259.067 ms) : 0, 259067
AppSec [baseline] (32.946 ms) : 0, 32946
AppSec [candidate] (33.16 ms) : 0, 33160
Debugger [baseline] (65.791 ms) : 0, 65791
Debugger [candidate] (66.269 ms) : 0, 66269
Remote Config [baseline] (607.174 µs) : 0, 607
Remote Config [candidate] (614.14 µs) : 0, 614
Telemetry [baseline] (9.88 ms) : 0, 9880
Telemetry [candidate] (9.886 ms) : 0, 9886
Flare Poller [baseline] (5.407 ms) : 0, 5407
Flare Poller [candidate] (5.311 ms) : 0, 5311
section appsec
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (662.82 ms) : 0, 662820
BytebuddyAgent [candidate] (656.872 ms) : 0, 656872
AgentMeter [baseline] (12.059 ms) : 0, 12059
AgentMeter [candidate] (11.957 ms) : 0, 11957
GlobalTracer [baseline] (259.735 ms) : 0, 259735
GlobalTracer [candidate] (258.235 ms) : 0, 258235
IAST [baseline] (25.761 ms) : 0, 25761
IAST [candidate] (25.332 ms) : 0, 25332
AppSec [baseline] (168.305 ms) : 0, 168305
AppSec [candidate] (168.285 ms) : 0, 168285
Debugger [baseline] (66.675 ms) : 0, 66675
Debugger [candidate] (65.803 ms) : 0, 65803
Remote Config [baseline] (686.072 µs) : 0, 686
Remote Config [candidate] (680.548 µs) : 0, 681
Telemetry [baseline] (9.339 ms) : 0, 9339
Telemetry [candidate] (9.36 ms) : 0, 9360
Flare Poller [baseline] (3.616 ms) : 0, 3616
Flare Poller [candidate] (3.671 ms) : 0, 3671
section iast
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (795.762 ms) : 0, 795762
BytebuddyAgent [candidate] (793.578 ms) : 0, 793578
AgentMeter [baseline] (11.304 ms) : 0, 11304
AgentMeter [candidate] (11.304 ms) : 0, 11304
GlobalTracer [baseline] (247.626 ms) : 0, 247626
GlobalTracer [candidate] (246.666 ms) : 0, 246666
IAST [baseline] (27.099 ms) : 0, 27099
IAST [candidate] (27.006 ms) : 0, 27006
AppSec [baseline] (34.846 ms) : 0, 34846
AppSec [candidate] (33.19 ms) : 0, 33190
Debugger [baseline] (66.172 ms) : 0, 66172
Debugger [candidate] (67.288 ms) : 0, 67288
Remote Config [baseline] (543.345 µs) : 0, 543
Remote Config [candidate] (536.829 µs) : 0, 537
Telemetry [baseline] (8.677 ms) : 0, 8677
Telemetry [candidate] (8.502 ms) : 0, 8502
Flare Poller [baseline] (3.545 ms) : 0, 3545
Flare Poller [candidate] (3.436 ms) : 0, 3436
section profiling
crashtracking [baseline] (1.163 ms) : 0, 1163
crashtracking [candidate] (1.169 ms) : 0, 1169
BytebuddyAgent [baseline] (681.424 ms) : 0, 681424
BytebuddyAgent [candidate] (681.908 ms) : 0, 681908
AgentMeter [baseline] (8.539 ms) : 0, 8539
AgentMeter [candidate] (8.567 ms) : 0, 8567
GlobalTracer [baseline] (215.57 ms) : 0, 215570
GlobalTracer [candidate] (215.847 ms) : 0, 215847
AppSec [baseline] (32.517 ms) : 0, 32517
AppSec [candidate] (32.369 ms) : 0, 32369
Debugger [baseline] (67.038 ms) : 0, 67038
Debugger [candidate] (66.658 ms) : 0, 66658
Remote Config [baseline] (625.793 µs) : 0, 626
Remote Config [candidate] (622.632 µs) : 0, 623
Telemetry [baseline] (8.818 ms) : 0, 8818
Telemetry [candidate] (8.844 ms) : 0, 8844
Flare Poller [baseline] (3.813 ms) : 0, 3813
Flare Poller [candidate] (3.705 ms) : 0, 3705
ProfilingAgent [baseline] (99.399 ms) : 0, 99399
ProfilingAgent [candidate] (98.602 ms) : 0, 98602
Profiling [baseline] (99.982 ms) : 0, 99982
Profiling [candidate] (99.198 ms) : 0, 99198
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/spark-launcher-metrics
git_commit_date 1772385877 1772400496
git_commit_sha b0ab971 4cbda77
release_version 1.60.0-SNAPSHOT~b0ab971941 1.60.0-SNAPSHOT~4cbda770c9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1772402787 1772402787
ci_job_id 1465644950 1465644950
ci_pipeline_id 99666940 99666940
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-b0zzq8sr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-b0zzq8sr 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-137.018µs; -61.826µs] or [-5.578%; -2.517%]		 unsure
[-448.956µs; -8.897µs] or [-6.161%; -0.122%]		 unstable
[-110.987op/s; +217.675op/s] or [-7.728%; +15.157%]		 2.357ms 7.058ms 1489.500op/s 2.457ms 7.287ms 1436.156op/s
scenario:load:petclinic:profiling:high_load better
[-1.821ms; -0.822ms] or [-9.263%; -4.180%]		 better
[-2.737ms; -0.910ms] or [-8.659%; -2.879%]		 unstable
[-10.102op/s; +42.164op/s] or [-4.322%; +18.038%]		 18.337ms 29.779ms 249.781op/s 19.658ms 31.603ms 233.750op/s
scenario:load:petclinic:no_agent:high_load worse
[+1.252ms; +2.498ms] or [+7.452%; +14.872%]		 unstable
[+0.172ms; +3.502ms] or [+0.598%; +12.148%]		 unstable
[-54.079op/s; +3.516op/s] or [-20.083%; +1.306%]		 18.669ms 30.661ms 244.000op/s 16.794ms 28.824ms 269.281op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~4cbda770c9, baseline=1.60.0-SNAPSHOT~b0ab971941
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.325 ms) : 17151, 17499
.   : milestone, 17325,
appsec (18.38 ms) : 18194, 18566
.   : milestone, 18380,
code_origins (17.717 ms) : 17543, 17892
.   : milestone, 17717,
iast (17.598 ms) : 17424, 17772
.   : milestone, 17598,
profiling (19.976 ms) : 19770, 20182
.   : milestone, 19976,
tracing (17.715 ms) : 17540, 17889
.   : milestone, 17715,
section candidate
no_agent (19.134 ms) : 18937, 19332
.   : milestone, 19134,
appsec (18.559 ms) : 18373, 18744
.   : milestone, 18559,
code_origins (17.793 ms) : 17619, 17966
.   : milestone, 17793,
iast (17.529 ms) : 17355, 17704
.   : milestone, 17529,
profiling (18.683 ms) : 18497, 18870
.   : milestone, 18683,
tracing (17.849 ms) : 17672, 18025
.   : milestone, 17849,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.325 ms [17.151 ms, 17.499 ms] -
appsec 18.38 ms [18.194 ms, 18.566 ms] 1.055 ms (6.1%)
code_origins 17.717 ms [17.543 ms, 17.892 ms] 392.029 µs (2.3%)
iast 17.598 ms [17.424 ms, 17.772 ms] 272.966 µs (1.6%)
profiling 19.976 ms [19.77 ms, 20.182 ms] 2.651 ms (15.3%)
tracing 17.715 ms [17.54 ms, 17.889 ms] 389.405 µs (2.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.134 ms [18.937 ms, 19.332 ms] -
appsec 18.559 ms [18.373 ms, 18.744 ms] -575.643 µs (-3.0%)
code_origins 17.793 ms [17.619 ms, 17.966 ms] -1.342 ms (-7.0%)
iast 17.529 ms [17.355 ms, 17.704 ms] -1.605 ms (-8.4%)
profiling 18.683 ms [18.497 ms, 18.87 ms] -451.269 µs (-2.4%)
tracing 17.849 ms [17.672 ms, 18.025 ms] -1.286 ms (-6.7%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~4cbda770c9, baseline=1.60.0-SNAPSHOT~b0ab971941
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.183 ms) : 1172, 1195
.   : milestone, 1183,
iast (3.185 ms) : 3142, 3227
.   : milestone, 3185,
iast_FULL (5.77 ms) : 5712, 5829
.   : milestone, 5770,
iast_GLOBAL (3.566 ms) : 3513, 3619
.   : milestone, 3566,
profiling (2.114 ms) : 2095, 2134
.   : milestone, 2114,
tracing (1.782 ms) : 1767, 1797
.   : milestone, 1782,
section candidate
no_agent (1.169 ms) : 1158, 1180
.   : milestone, 1169,
iast (3.068 ms) : 3025, 3111
.   : milestone, 3068,
iast_FULL (5.939 ms) : 5878, 5999
.   : milestone, 5939,
iast_GLOBAL (3.593 ms) : 3538, 3648
.   : milestone, 3593,
profiling (2.291 ms) : 2267, 2314
.   : milestone, 2291,
tracing (1.782 ms) : 1768, 1797
.   : milestone, 1782,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.183 ms [1.172 ms, 1.195 ms] -
iast 3.185 ms [3.142 ms, 3.227 ms] 2.001 ms (169.1%)
iast_FULL 5.77 ms [5.712 ms, 5.829 ms] 4.587 ms (387.6%)
iast_GLOBAL 3.566 ms [3.513 ms, 3.619 ms] 2.382 ms (201.3%)
profiling 2.114 ms [2.095 ms, 2.134 ms] 930.837 µs (78.7%)
tracing 1.782 ms [1.767 ms, 1.797 ms] 598.637 µs (50.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.169 ms [1.158 ms, 1.18 ms] -
iast 3.068 ms [3.025 ms, 3.111 ms] 1.899 ms (162.5%)
iast_FULL 5.939 ms [5.878 ms, 5.999 ms] 4.77 ms (408.1%)
iast_GLOBAL 3.593 ms [3.538 ms, 3.648 ms] 2.424 ms (207.4%)
profiling 2.291 ms [2.267 ms, 2.314 ms] 1.122 ms (96.0%)
tracing 1.782 ms [1.768 ms, 1.797 ms] 613.738 µs (52.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master adrien.boitreaud/spark-launcher-metrics
git_commit_date 1772385877 1772400496
git_commit_sha b0ab971 4cbda77
release_version 1.60.0-SNAPSHOT~b0ab971941 1.60.0-SNAPSHOT~4cbda770c9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1772402588 1772402588
ci_job_id 1465644951 1465644951
ci_pipeline_id 99666940 99666940
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qu13ekjs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qu13ekjs 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~4cbda770c9, baseline=1.60.0-SNAPSHOT~b0ab971941
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (3.79 ms) : 3568, 4013
.   : milestone, 3790,
iast (2.264 ms) : 2194, 2333
.   : milestone, 2264,
iast_GLOBAL (2.305 ms) : 2236, 2375
.   : milestone, 2305,
profiling (2.108 ms) : 2052, 2164
.   : milestone, 2108,
tracing (2.067 ms) : 2014, 2120
.   : milestone, 2067,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (3.781 ms) : 3558, 4004
.   : milestone, 3781,
iast (2.254 ms) : 2186, 2323
.   : milestone, 2254,
iast_GLOBAL (2.298 ms) : 2229, 2367
.   : milestone, 2298,
profiling (2.099 ms) : 2043, 2155
.   : milestone, 2099,
tracing (2.064 ms) : 2011, 2117
.   : milestone, 2064,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.469 ms, 1.492 ms] -
appsec 3.79 ms [3.568 ms, 4.013 ms] 2.31 ms (156.1%)
iast 2.264 ms [2.194 ms, 2.333 ms] 783.395 µs (52.9%)
iast_GLOBAL 2.305 ms [2.236 ms, 2.375 ms] 825.303 µs (55.8%)
profiling 2.108 ms [2.052 ms, 2.164 ms] 627.975 µs (42.4%)
tracing 2.067 ms [2.014 ms, 2.12 ms] 586.993 µs (39.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 3.781 ms [3.558 ms, 4.004 ms] 2.307 ms (156.5%)
iast 2.254 ms [2.186 ms, 2.323 ms] 780.305 µs (52.9%)
iast_GLOBAL 2.298 ms [2.229 ms, 2.367 ms] 823.775 µs (55.9%)
profiling 2.099 ms [2.043 ms, 2.155 ms] 624.978 µs (42.4%)
tracing 2.064 ms [2.011 ms, 2.117 ms] 590.04 µs (40.0%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~4cbda770c9, baseline=1.60.0-SNAPSHOT~b0ab971941
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.625 s) : 15625000, 15625000
.   : milestone, 15625000,
appsec (15.122 s) : 15122000, 15122000
.   : milestone, 15122000,
iast (18.295 s) : 18295000, 18295000
.   : milestone, 18295000,
iast_GLOBAL (17.66 s) : 17660000, 17660000
.   : milestone, 17660000,
profiling (14.728 s) : 14728000, 14728000
.   : milestone, 14728000,
tracing (14.909 s) : 14909000, 14909000
.   : milestone, 14909000,
section candidate
no_agent (15.716 s) : 15716000, 15716000
.   : milestone, 15716000,
appsec (14.949 s) : 14949000, 14949000
.   : milestone, 14949000,
iast (17.955 s) : 17955000, 17955000
.   : milestone, 17955000,
iast_GLOBAL (17.522 s) : 17522000, 17522000
.   : milestone, 17522000,
profiling (14.956 s) : 14956000, 14956000
.   : milestone, 14956000,
tracing (14.814 s) : 14814000, 14814000
.   : milestone, 14814000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.625 s [15.625 s, 15.625 s] -
appsec 15.122 s [15.122 s, 15.122 s] -503.0 ms (-3.2%)
iast 18.295 s [18.295 s, 18.295 s] 2.67 s (17.1%)
iast_GLOBAL 17.66 s [17.66 s, 17.66 s] 2.035 s (13.0%)
profiling 14.728 s [14.728 s, 14.728 s] -897.0 ms (-5.7%)
tracing 14.909 s [14.909 s, 14.909 s] -716.0 ms (-4.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.716 s [15.716 s, 15.716 s] -
appsec 14.949 s [14.949 s, 14.949 s] -767.0 ms (-4.9%)
iast 17.955 s [17.955 s, 17.955 s] 2.239 s (14.2%)
iast_GLOBAL 17.522 s [17.522 s, 17.522 s] 1.806 s (11.5%)
profiling 14.956 s [14.956 s, 14.956 s] -760.0 ms (-4.8%)
tracing 14.814 s [14.814 s, 14.814 s] -902.0 ms (-5.7%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@aboitreaud