Skip to content

Trying out duckdb-1.5#6627

Draft
myrrc wants to merge 3 commits intodevelopfrom
myrrc/duckdbfs-perf-regression
Draft

Trying out duckdb-1.5#6627
myrrc wants to merge 3 commits intodevelopfrom
myrrc/duckdbfs-perf-regression

Conversation

@myrrc
Copy link
Contributor

@myrrc myrrc commented Feb 20, 2026 •
edited
Loading

Porting #6627 to latest develop + bumping to latest 1.5 commit

#5767

@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR do not merge Pull requests that are not intended to merge action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Feb 20, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Feb 20, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on NVME

Summary

  • Overall: 0.946x ➖
  • Vortex: 0.944x ➖
  • duckdb:vortex: 0.911x ➖
  • datafusion:vortex: 0.978x ➖
  • Best: tpch_q08/duckdb:vortex-compact (0.708x)
  • Worst: tpch_q19/duckdb:vortex-compact (1.040x)
  • Significant (>10%): 17↑ 0↓
Detailed Results Table
name PR 6f212f6 base fb71117 ratio (PR/base) unit remark
tpch_q01/datafusion:arrow 719350715 7.19488e+08 0.999809 ns
tpch_q02/datafusion:arrow 208074850 2.14926e+08 0.968125 ns
tpch_q03/datafusion:arrow 559201048 5.67459e+08 0.985447 ns
tpch_q04/datafusion:arrow 400090755 4.16304e+08 0.961054 ns
tpch_q05/datafusion:arrow 1090509737 1.13508e+09 0.960732 ns
tpch_q06/datafusion:arrow 315407346 3.24268e+08 0.972675 ns
tpch_q07/datafusion:arrow 1371809843 1.41933e+09 0.966518 ns
tpch_q08/datafusion:arrow 1335496206 1.36811e+09 0.976163 ns
tpch_q09/datafusion:arrow 1595926025 1.63624e+09 0.975364 ns
tpch_q10/datafusion:arrow 679033720 6.86487e+08 0.989143 ns
tpch_q11/datafusion:arrow 188587315 1.95803e+08 0.963147 ns
tpch_q12/datafusion:arrow 858531866 7.63366e+08 1.12467 ns 🚨
tpch_q13/datafusion:arrow 517183298 5.26371e+08 0.982544 ns
tpch_q14/datafusion:arrow 362804242 3.71832e+08 0.975721 ns
tpch_q15/datafusion:arrow 756929161 7.99945e+08 0.946227 ns
tpch_q16/datafusion:arrow 127356894 1.33374e+08 0.954887 ns
tpch_q17/datafusion:arrow 1638004050 1.67985e+09 0.975088 ns
tpch_q18/datafusion:arrow 2196287398 2.20296e+09 0.996969 ns
tpch_q19/datafusion:arrow 583289495 6.01345e+08 0.969975 ns
tpch_q20/datafusion:arrow 564152998 5.99551e+08 0.94096 ns
tpch_q21/datafusion:arrow 3830948015 3.94378e+09 0.97139 ns
tpch_q22/datafusion:arrow 184828371 1.91721e+08 0.96405 ns
tpch_q01/datafusion:parquet 461607116 4.72535e+08 0.976873 ns
tpch_q02/datafusion:parquet 270502876 2.69669e+08 1.00309 ns
tpch_q03/datafusion:parquet 402331686 4.06311e+08 0.990206 ns
tpch_q04/datafusion:parquet 153849332 1.57734e+08 0.975373 ns
tpch_q05/datafusion:parquet 592348224 6.00296e+08 0.98676 ns
tpch_q06/datafusion:parquet 135386180 1.22174e+08 1.10814 ns 🚨
tpch_q07/datafusion:parquet 803184430 8.22498e+08 0.976518 ns
tpch_q08/datafusion:parquet 662071572 6.79952e+08 0.973704 ns
tpch_q09/datafusion:parquet 1004533208 9.99005e+08 1.00553 ns
tpch_q10/datafusion:parquet 603002511 6.12536e+08 0.984436 ns
tpch_q11/datafusion:parquet 196981433 2.09195e+08 0.941617 ns
tpch_q12/datafusion:parquet 252376614 2.4375e+08 1.03539 ns
tpch_q13/datafusion:parquet 339690974 3.44347e+08 0.986479 ns
tpch_q14/datafusion:parquet 202238908 2.05205e+08 0.985547 ns
tpch_q15/datafusion:parquet 259924318 2.62658e+08 0.989591 ns
tpch_q16/datafusion:parquet 183310343 1.86261e+08 0.984159 ns
tpch_q17/datafusion:parquet 857284207 8.9632e+08 0.956449 ns
tpch_q18/datafusion:parquet 1071538548 1.06368e+09 1.00739 ns
tpch_q19/datafusion:parquet 360729163 3.36371e+08 1.07241 ns
tpch_q20/datafusion:parquet 375651782 3.87352e+08 0.969794 ns
tpch_q21/datafusion:parquet 910359346 9.32768e+08 0.975976 ns
tpch_q22/datafusion:parquet 223017718 2.28813e+08 0.974673 ns
tpch_q01/datafusion:vortex-file-compressed 423265504 4.36985e+08 0.968604 ns
tpch_q02/datafusion:vortex-file-compressed 167019932 1.7338e+08 0.963318 ns
tpch_q03/datafusion:vortex-file-compressed 258088620 2.69671e+08 0.95705 ns
tpch_q04/datafusion:vortex-file-compressed 111200861 1.13416e+08 0.980473 ns
tpch_q05/datafusion:vortex-file-compressed 470775943 4.7632e+08 0.988361 ns
tpch_q06/datafusion:vortex-file-compressed 41714915 4.30252e+07 0.969546 ns
tpch_q07/datafusion:vortex-file-compressed 658327449 6.72102e+08 0.979505 ns
tpch_q08/datafusion:vortex-file-compressed 489204960 4.96147e+08 0.986007 ns
tpch_q09/datafusion:vortex-file-compressed 834325002 8.48489e+08 0.983307 ns
tpch_q10/datafusion:vortex-file-compressed 299870160 3.06304e+08 0.978995 ns
tpch_q11/datafusion:vortex-file-compressed 121709587 1.2661e+08 0.961298 ns
tpch_q12/datafusion:vortex-file-compressed 128381944 1.35428e+08 0.947969 ns
tpch_q13/datafusion:vortex-file-compressed 229932141 2.32213e+08 0.990179 ns
tpch_q14/datafusion:vortex-file-compressed 74133468 7.50053e+07 0.988377 ns
tpch_q15/datafusion:vortex-file-compressed 108882039 1.13403e+08 0.960137 ns
tpch_q16/datafusion:vortex-file-compressed 97178963 9.7409e+07 0.997639 ns
tpch_q17/datafusion:vortex-file-compressed 760687015 7.77634e+08 0.978207 ns
tpch_q18/datafusion:vortex-file-compressed 979058781 9.97364e+08 0.981646 ns
tpch_q19/datafusion:vortex-file-compressed 133403350 1.29798e+08 1.02777 ns
tpch_q20/datafusion:vortex-file-compressed 207036697 2.13704e+08 0.968802 ns
tpch_q21/datafusion:vortex-file-compressed 781638145 7.98817e+08 0.978495 ns
tpch_q22/datafusion:vortex-file-compressed 65336381 6.51445e+07 1.00295 ns
tpch_q01/datafusion:vortex-compact 465289098 4.61816e+08 1.00752 ns
tpch_q02/datafusion:vortex-compact 170951089 1.76431e+08 0.968942 ns
tpch_q03/datafusion:vortex-compact 281212376 2.87892e+08 0.976799 ns
tpch_q04/datafusion:vortex-compact 132737697 1.41338e+08 0.93915 ns
tpch_q05/datafusion:vortex-compact 482001843 4.93891e+08 0.975927 ns
tpch_q06/datafusion:vortex-compact 63005156 6.4716e+07 0.973564 ns
tpch_q07/datafusion:vortex-compact 691378571 7.05962e+08 0.979343 ns
tpch_q08/datafusion:vortex-compact 499565700 5.17755e+08 0.964869 ns
tpch_q09/datafusion:vortex-compact 848943509 8.51429e+08 0.997081 ns
tpch_q10/datafusion:vortex-compact 329961087 3.45056e+08 0.956255 ns
tpch_q11/datafusion:vortex-compact 126792531 1.30402e+08 0.97232 ns
tpch_q12/datafusion:vortex-compact 194580771 1.96382e+08 0.990826 ns
tpch_q13/datafusion:vortex-compact 273886748 2.81151e+08 0.974161 ns
tpch_q14/datafusion:vortex-compact 94402690 9.37391e+07 1.00708 ns
tpch_q15/datafusion:vortex-compact 166006727 1.69898e+08 0.977098 ns
tpch_q16/datafusion:vortex-compact 102694074 1.05416e+08 0.974182 ns
tpch_q17/datafusion:vortex-compact 761977915 7.91543e+08 0.962649 ns
tpch_q18/datafusion:vortex-compact 995024211 1.01677e+09 0.978615 ns
tpch_q19/datafusion:vortex-compact 229005671 2.41034e+08 0.950095 ns
tpch_q20/datafusion:vortex-compact 233839435 2.40938e+08 0.970539 ns
tpch_q21/datafusion:vortex-compact 821870162 8.37578e+08 0.981247 ns
tpch_q22/datafusion:vortex-compact 76132699 7.49084e+07 1.01634 ns
tpch_q01/duckdb:parquet 262366510 2.69942e+08 0.971938 ns
tpch_q02/duckdb:parquet 107448213 1.31003e+08 0.820199 ns 🚀
tpch_q03/duckdb:parquet 211171660 2.25895e+08 0.934822 ns
tpch_q04/duckdb:parquet 135589926 1.54897e+08 0.875357 ns 🚀
tpch_q05/duckdb:parquet 219185650 2.33381e+08 0.939174 ns
tpch_q06/duckdb:parquet 66339515 7.04823e+07 0.941222 ns
tpch_q07/duckdb:parquet 178782887 2.21947e+08 0.805522 ns 🚀
tpch_q08/duckdb:parquet 252604093 3.33106e+08 0.75833 ns 🚀
tpch_q09/duckdb:parquet 460551306 4.95191e+08 0.930047 ns
tpch_q10/duckdb:parquet 614236060 6.38216e+08 0.962427 ns
tpch_q11/duckdb:parquet 42823945 5.84346e+07 0.732852 ns 🚀
tpch_q12/duckdb:parquet 125465947 1.42142e+08 0.882683 ns 🚀
tpch_q13/duckdb:parquet 422324418 4.2251e+08 0.99956 ns
tpch_q14/duckdb:parquet 176279428 1.81423e+08 0.971648 ns
tpch_q15/duckdb:parquet 95326763 1.09903e+08 0.867374 ns 🚀
tpch_q16/duckdb:parquet 158405140 1.69591e+08 0.934044 ns
tpch_q17/duckdb:parquet 177344456 2.05889e+08 0.861362 ns 🚀
tpch_q18/duckdb:parquet 353768860 3.67485e+08 0.962676 ns
tpch_q19/duckdb:parquet 300551961 2.92233e+08 1.02847 ns
tpch_q20/duckdb:parquet 232187609 2.66319e+08 0.87184 ns 🚀
tpch_q21/duckdb:parquet 566318118 5.9687e+08 0.948814 ns
tpch_q22/duckdb:parquet 299695987 3.02071e+08 0.992137 ns
tpch_q01/duckdb:vortex-file-compressed 180386877 1.90264e+08 0.948086 ns
tpch_q02/duckdb:vortex-file-compressed 54230640 6.63538e+07 0.817295 ns 🚀
tpch_q03/duckdb:vortex-file-compressed 128542019 1.45294e+08 0.884703 ns 🚀
tpch_q04/duckdb:vortex-file-compressed 149045010 1.6851e+08 0.884488 ns 🚀
tpch_q05/duckdb:vortex-file-compressed 129851909 1.50355e+08 0.863635 ns 🚀
tpch_q06/duckdb:vortex-file-compressed 48063595 5.11229e+07 0.940157 ns
tpch_q07/duckdb:vortex-file-compressed 146433386 1.5732e+08 0.930797 ns
tpch_q08/duckdb:vortex-file-compressed 173428799 2.26542e+08 0.765548 ns 🚀
tpch_q09/duckdb:vortex-file-compressed 337516688 3.73098e+08 0.904633 ns
tpch_q10/duckdb:vortex-file-compressed 150266286 1.72237e+08 0.872439 ns 🚀
tpch_q11/duckdb:vortex-file-compressed 35547872 4.23415e+07 0.839553 ns 🚀
tpch_q12/duckdb:vortex-file-compressed 92917201 1.00426e+08 0.92523 ns
tpch_q13/duckdb:vortex-file-compressed 248776252 2.5022e+08 0.994231 ns
tpch_q14/duckdb:vortex-file-compressed 67597685 7.27002e+07 0.929814 ns
tpch_q15/duckdb:vortex-file-compressed 95402777 9.75854e+07 0.977634 ns
tpch_q16/duckdb:vortex-file-compressed 80318656 8.69578e+07 0.92365 ns
tpch_q17/duckdb:vortex-file-compressed 100576070 1.23185e+08 0.816467 ns 🚀
tpch_q18/duckdb:vortex-file-compressed 274772114 2.96902e+08 0.925463 ns
tpch_q19/duckdb:vortex-file-compressed 92387874 9.03578e+07 1.02247 ns
tpch_q20/duckdb:vortex-file-compressed 162542660 1.74617e+08 0.930855 ns
tpch_q21/duckdb:vortex-file-compressed 561158420 5.89666e+08 0.951655 ns
tpch_q22/duckdb:vortex-file-compressed 78297856 7.87216e+07 0.994618 ns
tpch_q01/duckdb:vortex-compact 233005604 2.45219e+08 0.950193 ns
tpch_q02/duckdb:vortex-compact 59175243 7.38237e+07 0.801575 ns 🚀
tpch_q03/duckdb:vortex-compact 138784253 1.70036e+08 0.816207 ns 🚀
tpch_q04/duckdb:vortex-compact 175357255 2.05206e+08 0.854541 ns 🚀
tpch_q05/duckdb:vortex-compact 146087514 1.83081e+08 0.797939 ns 🚀
tpch_q06/duckdb:vortex-compact 85792625 8.61714e+07 0.995604 ns
tpch_q07/duckdb:vortex-compact 208335412 2.20428e+08 0.945142 ns
tpch_q08/duckdb:vortex-compact 190572761 2.69317e+08 0.707614 ns 🚀
tpch_q09/duckdb:vortex-compact 368268180 4.1285e+08 0.892014 ns 🚀
tpch_q10/duckdb:vortex-compact 186848867 2.11322e+08 0.884191 ns 🚀
tpch_q11/duckdb:vortex-compact 42672131 4.40693e+07 0.968297 ns
tpch_q12/duckdb:vortex-compact 210142057 2.15955e+08 0.973081 ns
tpch_q13/duckdb:vortex-compact 294258989 2.97868e+08 0.987884 ns
tpch_q14/duckdb:vortex-compact 105335305 1.02436e+08 1.02831 ns
tpch_q15/duckdb:vortex-compact 119090598 1.20088e+08 0.991694 ns
tpch_q16/duckdb:vortex-compact 87707154 9.4553e+07 0.927598 ns
tpch_q17/duckdb:vortex-compact 118472543 1.35784e+08 0.872508 ns 🚀
tpch_q18/duckdb:vortex-compact 289232938 3.30438e+08 0.875301 ns 🚀
tpch_q19/duckdb:vortex-compact 116623440 1.12091e+08 1.04043 ns
tpch_q20/duckdb:vortex-compact 206668396 2.1662e+08 0.954061 ns
tpch_q21/duckdb:vortex-compact 647184870 6.87741e+08 0.94103 ns
tpch_q22/duckdb:vortex-compact 90483484 9.36267e+07 0.966428 ns
tpch_q01/duckdb:duckdb 118096510 1.17087e+08 1.00862 ns
tpch_q02/duckdb:duckdb 49675592 4.83808e+07 1.02676 ns
tpch_q03/duckdb:duckdb 96095744 1.01876e+08 0.943263 ns
tpch_q04/duckdb:duckdb 133621870 1.32539e+08 1.00817 ns
tpch_q05/duckdb:duckdb 111919379 1.10956e+08 1.00868 ns
tpch_q06/duckdb:duckdb 39259627 4.41703e+07 0.888824 ns 🚀
tpch_q07/duckdb:duckdb 86644268 1.10644e+08 0.783088 ns 🚀
tpch_q08/duckdb:duckdb 110094858 1.41403e+08 0.778592 ns 🚀
tpch_q09/duckdb:duckdb 280066549 3.09806e+08 0.904007 ns
tpch_q10/duckdb:duckdb 207703068 2.15747e+08 0.962718 ns
tpch_q11/duckdb:duckdb 15260215 2.29163e+07 0.66591 ns 🚀
tpch_q12/duckdb:duckdb 84405385 8.6802e+07 0.97239 ns
tpch_q13/duckdb:duckdb 244052620 2.38972e+08 1.02126 ns
tpch_q14/duckdb:duckdb 72230468 7.7162e+07 0.936089 ns
tpch_q15/duckdb:duckdb 75970124 8.11037e+07 0.936703 ns
tpch_q16/duckdb:duckdb 74266130 7.40918e+07 1.00235 ns
tpch_q17/duckdb:duckdb 84026754 9.99084e+07 0.841038 ns 🚀
tpch_q18/duckdb:duckdb 215046004 2.20962e+08 0.973227 ns
tpch_q19/duckdb:duckdb 115680698 1.28466e+08 0.90048 ns
tpch_q20/duckdb:duckdb 113398997 1.24019e+08 0.914369 ns
tpch_q21/duckdb:duckdb 303844100 3.29733e+08 0.921486 ns
tpch_q22/duckdb:duckdb 65369144 7.42776e+07 0.880065 ns 🚀

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Benchmarks: FineWeb S3

Summary

  • Overall: 0.991x ➖
  • Vortex: 1.018x ➖
  • duckdb:vortex: 1.024x ➖
  • datafusion:vortex: 1.012x ➖
  • Best: fineweb_q00/duckdb:vortex-compact (0.606x)
  • Worst: fineweb_q00/duckdb:vortex-file-compressed (1.439x)
  • Significant (>30%): 1↑ 1↓
Detailed Results Table
name PR 6f212f6 base fb71117 ratio (PR/base) unit remark
fineweb_q00/datafusion:parquet 975791384 8.76252e+08 1.1136 ns
fineweb_q01/datafusion:parquet 1601770387 1.55003e+09 1.03338 ns
fineweb_q02/datafusion:parquet 1725956138 1.64098e+09 1.05178 ns
fineweb_q03/datafusion:parquet 1664637441 1.56297e+09 1.06505 ns
fineweb_q04/datafusion:parquet 1646448764 1.62078e+09 1.01584 ns
fineweb_q05/datafusion:parquet 1711640090 1.60924e+09 1.06363 ns
fineweb_q06/datafusion:parquet 1703345836 1.57191e+09 1.08361 ns
fineweb_q07/datafusion:parquet 1699987282 1.58458e+09 1.07283 ns
fineweb_q08/datafusion:parquet 1678893824 1.53303e+09 1.09515 ns
fineweb_q00/datafusion:vortex-file-compressed 37910329 3.30907e+07 1.14565 ns
fineweb_q01/datafusion:vortex-file-compressed 489317418 4.56945e+08 1.07084 ns
fineweb_q02/datafusion:vortex-file-compressed 457607273 4.65014e+08 0.984072 ns
fineweb_q03/datafusion:vortex-file-compressed 1372417087 1.39361e+09 0.98479 ns
fineweb_q04/datafusion:vortex-file-compressed 1370509598 1.41235e+09 0.970374 ns
fineweb_q05/datafusion:vortex-file-compressed 1350322950 1.37186e+09 0.984302 ns
fineweb_q06/datafusion:vortex-file-compressed 1461130333 1.47141e+09 0.993014 ns
fineweb_q07/datafusion:vortex-file-compressed 1442184065 1.37198e+09 1.05117 ns
fineweb_q08/datafusion:vortex-file-compressed 526774799 5.39794e+08 0.975882 ns
fineweb_q00/datafusion:vortex-compact 33553342 3.13986e+07 1.06863 ns
fineweb_q01/datafusion:vortex-compact 563070769 4.78993e+08 1.17553 ns
fineweb_q02/datafusion:vortex-compact 583998939 6.00547e+08 0.972445 ns
fineweb_q03/datafusion:vortex-compact 1718741382 1.6963e+09 1.01323 ns
fineweb_q04/datafusion:vortex-compact 2154460185 2.19466e+09 0.981683 ns
fineweb_q05/datafusion:vortex-compact 1642110712 1.63216e+09 1.0061 ns
fineweb_q06/datafusion:vortex-compact 1382350957 1.39834e+09 0.988568 ns
fineweb_q07/datafusion:vortex-compact 1213023889 1.35847e+09 0.892933 ns
fineweb_q08/datafusion:vortex-compact 386708066 3.87565e+08 0.99779 ns
fineweb_q00/duckdb:parquet 1167993100 9.92059e+08 1.17734 ns
fineweb_q01/duckdb:parquet 1650622715 2.19476e+09 0.752075 ns
fineweb_q02/duckdb:parquet 1685381647 2.22523e+09 0.757396 ns
fineweb_q03/duckdb:parquet 4008207043 7.14845e+09 0.56071 ns 🚀
fineweb_q04/duckdb:parquet 1960852233 1.7044e+09 1.15046 ns
fineweb_q05/duckdb:parquet 2715337620 3.82765e+09 0.709401 ns
fineweb_q06/duckdb:parquet 3450400713 5.03914e+09 0.68472 ns 🚀
fineweb_q07/duckdb:parquet 3975251282 5.4504e+09 0.729351 ns
fineweb_q08/duckdb:parquet 1153628910 9.85111e+08 1.17106 ns
fineweb_q00/duckdb:vortex-file-compressed 85100495 5.91361e+07 1.43906 ns 🚨
fineweb_q01/duckdb:vortex-file-compressed 587512315 5.06353e+08 1.16028 ns
fineweb_q02/duckdb:vortex-file-compressed 442547410 3.99122e+08 1.1088 ns
fineweb_q03/duckdb:vortex-file-compressed 1683619846 1.51861e+09 1.10866 ns
fineweb_q04/duckdb:vortex-file-compressed 1621152580 1.54193e+09 1.05138 ns
fineweb_q05/duckdb:vortex-file-compressed 1424759920 1.46221e+09 0.97439 ns
fineweb_q06/duckdb:vortex-file-compressed 1622422854 1.67292e+09 0.969815 ns
fineweb_q07/duckdb:vortex-file-compressed 1655920233 1.50673e+09 1.09902 ns
fineweb_q08/duckdb:vortex-file-compressed 688409805 5.83374e+08 1.18005 ns
fineweb_q00/duckdb:vortex-compact 66568525 1.09792e+08 0.606314 ns 🚀
fineweb_q01/duckdb:vortex-compact 473895392 4.95293e+08 0.956798 ns
fineweb_q02/duckdb:vortex-compact 548911725 5.29732e+08 1.03621 ns
fineweb_q03/duckdb:vortex-compact 1699276425 1.65909e+09 1.02422 ns
fineweb_q04/duckdb:vortex-compact 1850925491 1.67309e+09 1.10629 ns
fineweb_q05/duckdb:vortex-compact 1649105207 1.6307e+09 1.01129 ns
fineweb_q06/duckdb:vortex-compact 1439552939 1.60271e+09 0.8982 ns
fineweb_q07/duckdb:vortex-compact 1431619751 1.48985e+09 0.960913 ns
fineweb_q08/duckdb:vortex-compact 493616362 5.08701e+08 0.970346 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Benchmarks: Statistical and Population Genetics

Summary

  • Overall: 1.173x ❌
  • Vortex: 1.045x ➖
  • duckdb:vortex: 1.045x ➖
  • Best: statpopgen_q01/duckdb:vortex-file-compressed (0.307x)
  • Worst: statpopgen_q01/duckdb:vortex-compact (1.361x)
  • Significant (>10%): 1↑ 12↓
Detailed Results Table
name PR 6f212f6 base fb71117 ratio (PR/base) unit remark
statpopgen_q00/duckdb:parquet 340861986 2.34595e+08 1.45298 ns 🚨
statpopgen_q01/duckdb:parquet 428856642 3.72258e+08 1.15204 ns 🚨
statpopgen_q02/duckdb:parquet 1012337564 6.84313e+08 1.47935 ns 🚨
statpopgen_q03/duckdb:parquet 1545454570 1.1122e+09 1.38954 ns 🚨
statpopgen_q04/duckdb:parquet 1573307987 1.1246e+09 1.39899 ns 🚨
statpopgen_q05/duckdb:parquet 1043315681 7.45681e+08 1.39915 ns 🚨
statpopgen_q06/duckdb:parquet 1510659446 1.32848e+09 1.13713 ns 🚨
statpopgen_q07/duckdb:parquet 1928514991 8.5813e+08 2.24735 ns 🚨
statpopgen_q08/duckdb:parquet 1911208568 8.58615e+08 2.22592 ns 🚨
statpopgen_q09/duckdb:parquet 1404854936 9.29296e+08 1.51174 ns 🚨
statpopgen_q10/duckdb:parquet 2712838638 2.15052e+09 1.26148 ns 🚨
statpopgen_q00/duckdb:vortex-file-compressed 11012248 1.11946e+07 0.983712 ns
statpopgen_q01/duckdb:vortex-file-compressed 29486585 9.61058e+07 0.306814 ns 🚀
statpopgen_q02/duckdb:vortex-file-compressed 1329969783 1.18406e+09 1.12323 ns 🚨
statpopgen_q03/duckdb:vortex-file-compressed 3202602838 2.77036e+09 1.15603 ns 🚨
statpopgen_q04/duckdb:vortex-file-compressed 3162684268 2.76756e+09 1.14277 ns 🚨
statpopgen_q05/duckdb:vortex-file-compressed 1402053432 1.2864e+09 1.0899 ns
statpopgen_q06/duckdb:vortex-file-compressed 2054239918 1.92648e+09 1.06632 ns
statpopgen_q07/duckdb:vortex-file-compressed 201278682 1.97056e+08 1.02143 ns
statpopgen_q08/duckdb:vortex-file-compressed 213385552 2.08813e+08 1.0219 ns
statpopgen_q09/duckdb:vortex-file-compressed 2879528449 2.5062e+09 1.14896 ns 🚨
statpopgen_q10/duckdb:vortex-file-compressed 4666114742 3.9669e+09 1.17626 ns 🚨
statpopgen_q00/duckdb:vortex-compact 11448322 1.11831e+07 1.02371 ns
statpopgen_q01/duckdb:vortex-compact 169158000 1.24335e+08 1.3605 ns 🚨
statpopgen_q02/duckdb:vortex-compact 1820722094 1.57616e+09 1.15516 ns 🚨
statpopgen_q03/duckdb:vortex-compact 3514482264 3.1476e+09 1.11656 ns 🚨
statpopgen_q04/duckdb:vortex-compact 3535501210 3.15651e+09 1.12007 ns 🚨
statpopgen_q05/duckdb:vortex-compact 1850519476 1.57807e+09 1.17265 ns 🚨
statpopgen_q06/duckdb:vortex-compact 2693823774 2.45752e+09 1.09615 ns
statpopgen_q07/duckdb:vortex-compact 957794242 9.5991e+08 0.997795 ns
statpopgen_q08/duckdb:vortex-compact 995938437 9.90466e+08 1.00553 ns
statpopgen_q09/duckdb:vortex-compact 3389877198 2.90999e+09 1.16491 ns 🚨
statpopgen_q10/duckdb:vortex-compact 5465020933 4.57653e+09 1.19414 ns 🚨

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on S3

Summary

  • Overall: 1.156x ➖
  • Vortex: 1.073x ➖
  • duckdb:vortex: 1.046x ➖
  • datafusion:vortex: 1.100x ➖
  • Best: tpch_q18/duckdb:vortex-compact (0.829x)
  • Worst: tpch_q06/datafusion:vortex-file-compressed (1.596x)
  • Significant (>30%): 0↑ 5↓
Detailed Results Table
name PR 6f212f6 base fb71117 ratio (PR/base) unit remark
tpch_q01/datafusion:parquet 198939650 2.38064e+08 0.835655 ns
tpch_q02/datafusion:parquet 467999129 4.1944e+08 1.11577 ns
tpch_q03/datafusion:parquet 318566241 2.85222e+08 1.11691 ns
tpch_q04/datafusion:parquet 153875054 1.35998e+08 1.13145 ns
tpch_q05/datafusion:parquet 543038156 4.93183e+08 1.10109 ns
tpch_q06/datafusion:parquet 139464162 1.31361e+08 1.06169 ns
tpch_q07/datafusion:parquet 533966392 5.27977e+08 1.01134 ns
tpch_q08/datafusion:parquet 639969195 6.09302e+08 1.05033 ns
tpch_q09/datafusion:parquet 580237228 5.32941e+08 1.08875 ns
tpch_q10/datafusion:parquet 559998520 5.53311e+08 1.01209 ns
tpch_q11/datafusion:parquet 377586652 3.42232e+08 1.10331 ns
tpch_q12/datafusion:parquet 290101351 2.51519e+08 1.1534 ns
tpch_q13/datafusion:parquet 434393995 4.31566e+08 1.00655 ns
tpch_q14/datafusion:parquet 224577030 1.97014e+08 1.1399 ns
tpch_q15/datafusion:parquet 291975982 2.86871e+08 1.01779 ns
tpch_q16/datafusion:parquet 185179498 1.69316e+08 1.09369 ns
tpch_q17/datafusion:parquet 422300026 3.64824e+08 1.15755 ns
tpch_q18/datafusion:parquet 530108889 4.77473e+08 1.11024 ns
tpch_q19/datafusion:parquet 352734425 3.05421e+08 1.15491 ns
tpch_q20/datafusion:parquet 387988077 3.61054e+08 1.0746 ns
tpch_q21/datafusion:parquet 574579589 5.00665e+08 1.14763 ns
tpch_q22/datafusion:parquet 126162096 1.17411e+08 1.07454 ns
tpch_q01/datafusion:vortex-file-compressed 179055456 1.82075e+08 0.983417 ns
tpch_q02/datafusion:vortex-file-compressed 433034006 4.18394e+08 1.03499 ns
tpch_q03/datafusion:vortex-file-compressed 305773108 3.2101e+08 0.952534 ns
tpch_q04/datafusion:vortex-file-compressed 180893622 1.91783e+08 0.94322 ns
tpch_q05/datafusion:vortex-file-compressed 436259239 3.81275e+08 1.14421 ns
tpch_q06/datafusion:vortex-file-compressed 328733021 2.06026e+08 1.59559 ns 🚨
tpch_q07/datafusion:vortex-file-compressed 370307426 3.45286e+08 1.07246 ns
tpch_q08/datafusion:vortex-file-compressed 566056209 5.21509e+08 1.08542 ns
tpch_q09/datafusion:vortex-file-compressed 484262730 4.85035e+08 0.998407 ns
tpch_q10/datafusion:vortex-file-compressed 477411101 4.07363e+08 1.17196 ns
tpch_q11/datafusion:vortex-file-compressed 303813184 2.9198e+08 1.04053 ns
tpch_q12/datafusion:vortex-file-compressed 366409629 3.03618e+08 1.20681 ns
tpch_q13/datafusion:vortex-file-compressed 206721777 2.21184e+08 0.934613 ns
tpch_q14/datafusion:vortex-file-compressed 187442901 1.64981e+08 1.13615 ns
tpch_q15/datafusion:vortex-file-compressed 332602859 2.74357e+08 1.2123 ns
tpch_q16/datafusion:vortex-file-compressed 173735327 1.61319e+08 1.07697 ns
tpch_q17/datafusion:vortex-file-compressed 332555696 2.72506e+08 1.22036 ns
tpch_q18/datafusion:vortex-file-compressed 353929528 2.6244e+08 1.34861 ns 🚨
tpch_q19/datafusion:vortex-file-compressed 339046570 3.05802e+08 1.10871 ns
tpch_q20/datafusion:vortex-file-compressed 406222811 3.29876e+08 1.23144 ns
tpch_q21/datafusion:vortex-file-compressed 499753655 4.43398e+08 1.1271 ns
tpch_q22/datafusion:vortex-file-compressed 188031620 1.42428e+08 1.32019 ns 🚨
tpch_q01/datafusion:vortex-compact 233893340 2.46268e+08 0.94975 ns
tpch_q02/datafusion:vortex-compact 441319360 4.07722e+08 1.0824 ns
tpch_q03/datafusion:vortex-compact 322078011 3.16596e+08 1.01732 ns
tpch_q04/datafusion:vortex-compact 217460058 2.10131e+08 1.03488 ns
tpch_q05/datafusion:vortex-compact 389075212 3.68674e+08 1.05534 ns
tpch_q06/datafusion:vortex-compact 308417821 2.62089e+08 1.17677 ns
tpch_q07/datafusion:vortex-compact 372809736 3.70749e+08 1.00556 ns
tpch_q08/datafusion:vortex-compact 447854093 4.57987e+08 0.977875 ns
tpch_q09/datafusion:vortex-compact 447620214 3.21705e+08 1.3914 ns 🚨
tpch_q10/datafusion:vortex-compact 441039834 4.23494e+08 1.04143 ns
tpch_q11/datafusion:vortex-compact 274685146 2.35241e+08 1.16768 ns
tpch_q12/datafusion:vortex-compact 385418021 3.50414e+08 1.09989 ns
tpch_q13/datafusion:vortex-compact 208783218 1.70056e+08 1.22773 ns
tpch_q14/datafusion:vortex-compact 250209752 2.55244e+08 0.980275 ns
tpch_q15/datafusion:vortex-compact 432069438 4.36109e+08 0.990738 ns
tpch_q16/datafusion:vortex-compact 170478719 1.66032e+08 1.02678 ns
tpch_q17/datafusion:vortex-compact 323649870 3.51138e+08 0.921717 ns
tpch_q18/datafusion:vortex-compact 330446459 2.68165e+08 1.23225 ns
tpch_q19/datafusion:vortex-compact 406335247 3.66062e+08 1.11002 ns
tpch_q20/datafusion:vortex-compact 494250300 4.61846e+08 1.07016 ns
tpch_q21/datafusion:vortex-compact 508666172 4.54266e+08 1.11975 ns
tpch_q22/datafusion:vortex-compact 114352018 1.04886e+08 1.09025 ns
tpch_q01/duckdb:parquet 586369562 4.74177e+08 1.23661 ns
tpch_q02/duckdb:parquet 1931893615 1.06817e+09 1.80859 ns 🚨
tpch_q03/duckdb:parquet 1320386006 7.73189e+08 1.70771 ns 🚨
tpch_q04/duckdb:parquet 873315471 5.16248e+08 1.69166 ns 🚨
tpch_q05/duckdb:parquet 2222362090 1.22004e+09 1.82155 ns 🚨
tpch_q06/duckdb:parquet 548171303 3.17278e+08 1.72773 ns 🚨
tpch_q07/duckdb:parquet 1852871331 9.68151e+08 1.91382 ns 🚨
tpch_q08/duckdb:parquet 2323058610 1.23156e+09 1.88627 ns 🚨
tpch_q09/duckdb:parquet 1961163769 1.13391e+09 1.72956 ns 🚨
tpch_q10/duckdb:parquet 1688171000 1.09045e+09 1.54814 ns 🚨
tpch_q11/duckdb:parquet 1315882781 6.23624e+08 2.11006 ns 🚨
tpch_q12/duckdb:parquet 829002047 4.82864e+08 1.71685 ns 🚨
tpch_q13/duckdb:parquet 1134437012 7.7985e+08 1.45469 ns 🚨
tpch_q14/duckdb:parquet 839111457 5.3145e+08 1.57891 ns 🚨
tpch_q15/duckdb:parquet 670769622 6.02769e+08 1.11281 ns
tpch_q16/duckdb:parquet 798267362 4.1468e+08 1.92502 ns 🚨
tpch_q17/duckdb:parquet 990783049 6.41579e+08 1.54429 ns 🚨
tpch_q18/duckdb:parquet 1211263253 6.91998e+08 1.75038 ns 🚨
tpch_q19/duckdb:parquet 960486528 6.79686e+08 1.41313 ns 🚨
tpch_q20/duckdb:parquet 1586707013 8.34814e+08 1.90067 ns 🚨
tpch_q21/duckdb:parquet 1644660649 9.17198e+08 1.79314 ns 🚨
tpch_q22/duckdb:parquet 722036649 3.92712e+08 1.83859 ns 🚨
tpch_q01/duckdb:vortex-file-compressed 324259196 2.15335e+08 1.50583 ns 🚨
tpch_q02/duckdb:vortex-file-compressed 807453383 7.09967e+08 1.13731 ns
tpch_q03/duckdb:vortex-file-compressed 543268375 5.00566e+08 1.08531 ns
tpch_q04/duckdb:vortex-file-compressed 319392668 3.44939e+08 0.925939 ns
tpch_q05/duckdb:vortex-file-compressed 769789049 7.57163e+08 1.01668 ns
tpch_q06/duckdb:vortex-file-compressed 386507177 3.11203e+08 1.24198 ns
tpch_q07/duckdb:vortex-file-compressed 711264699 6.8907e+08 1.03221 ns
tpch_q08/duckdb:vortex-file-compressed 814714274 8.9249e+08 0.912855 ns
tpch_q09/duckdb:vortex-file-compressed 789938080 7.64058e+08 1.03387 ns
tpch_q10/duckdb:vortex-file-compressed 660521917 6.59216e+08 1.00198 ns
tpch_q11/duckdb:vortex-file-compressed 412246277 4.34885e+08 0.947944 ns
tpch_q12/duckdb:vortex-file-compressed 416158564 4.6074e+08 0.90324 ns
tpch_q13/duckdb:vortex-file-compressed 468271617 4.40031e+08 1.06418 ns
tpch_q14/duckdb:vortex-file-compressed 438667519 3.5191e+08 1.24653 ns
tpch_q15/duckdb:vortex-file-compressed 255415790 2.68772e+08 0.950307 ns
tpch_q16/duckdb:vortex-file-compressed 325479204 3.12459e+08 1.04167 ns
tpch_q17/duckdb:vortex-file-compressed 573837189 4.88551e+08 1.17457 ns
tpch_q18/duckdb:vortex-file-compressed 497336110 5.29163e+08 0.939854 ns
tpch_q19/duckdb:vortex-file-compressed 418457262 3.89206e+08 1.07516 ns
tpch_q20/duckdb:vortex-file-compressed 696663788 6.81903e+08 1.02165 ns
tpch_q21/duckdb:vortex-file-compressed 957577435 8.96926e+08 1.06762 ns
tpch_q22/duckdb:vortex-file-compressed 330746719 2.93307e+08 1.12765 ns
tpch_q01/duckdb:vortex-compact 276139773 2.4531e+08 1.12568 ns
tpch_q02/duckdb:vortex-compact 724785477 7.09383e+08 1.02171 ns
tpch_q03/duckdb:vortex-compact 485860406 4.28349e+08 1.13426 ns
tpch_q04/duckdb:vortex-compact 317577494 3.0079e+08 1.05581 ns
tpch_q05/duckdb:vortex-compact 713958461 6.82324e+08 1.04636 ns
tpch_q06/duckdb:vortex-compact 334497940 3.23025e+08 1.03552 ns
tpch_q07/duckdb:vortex-compact 594830481 6.1199e+08 0.971961 ns
tpch_q08/duckdb:vortex-compact 835357265 8.45401e+08 0.988119 ns
tpch_q09/duckdb:vortex-compact 763424282 6.88845e+08 1.10827 ns
tpch_q10/duckdb:vortex-compact 604133240 6.3006e+08 0.958851 ns
tpch_q11/duckdb:vortex-compact 453398488 4.62157e+08 0.981048 ns
tpch_q12/duckdb:vortex-compact 380502012 4.04076e+08 0.941659 ns
tpch_q13/duckdb:vortex-compact 424865856 3.86639e+08 1.09887 ns
tpch_q14/duckdb:vortex-compact 405688173 3.62042e+08 1.12055 ns
tpch_q15/duckdb:vortex-compact 247788947 2.86564e+08 0.864689 ns
tpch_q16/duckdb:vortex-compact 316623403 2.96621e+08 1.06743 ns
tpch_q17/duckdb:vortex-compact 564249319 4.92831e+08 1.14491 ns
tpch_q18/duckdb:vortex-compact 409317173 4.93628e+08 0.829201 ns
tpch_q19/duckdb:vortex-compact 430581729 3.6711e+08 1.1729 ns
tpch_q20/duckdb:vortex-compact 671803987 6.04181e+08 1.11192 ns
tpch_q21/duckdb:vortex-compact 872942583 8.50087e+08 1.02689 ns
tpch_q22/duckdb:vortex-compact 296449928 2.85977e+08 1.03662 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Benchmarks: TPC-H SF=10 on S3

Summary

  • Overall: 1.112x ➖
  • Vortex: 1.035x ➖
  • duckdb:vortex: 1.006x ➖
  • datafusion:vortex: 1.064x ➖
  • Best: tpch_q15/duckdb:vortex-compact (0.799x)
  • Worst: tpch_q22/duckdb:vortex-compact (1.304x)
  • Significant (>30%): 0↑ 1↓
Detailed Results Table
name PR 6f212f6 base fb71117 ratio (PR/base) unit remark
tpch_q01/datafusion:parquet 899608816 8.66083e+08 1.03871 ns
tpch_q02/datafusion:parquet 695777192 6.72629e+08 1.03441 ns
tpch_q03/datafusion:parquet 952430630 9.37947e+08 1.01544 ns
tpch_q04/datafusion:parquet 508347654 4.48443e+08 1.13358 ns
tpch_q05/datafusion:parquet 1197940365 1.19508e+09 1.0024 ns
tpch_q06/datafusion:parquet 527639797 5.09473e+08 1.03566 ns
tpch_q07/datafusion:parquet 1392490338 1.33762e+09 1.04102 ns
tpch_q08/datafusion:parquet 1659250917 1.50379e+09 1.10338 ns
tpch_q09/datafusion:parquet 1896726594 1.72684e+09 1.09838 ns
tpch_q10/datafusion:parquet 1999016935 1.94939e+09 1.02546 ns
tpch_q11/datafusion:parquet 674394047 5.25714e+08 1.28281 ns
tpch_q12/datafusion:parquet 717267814 7.27871e+08 0.985433 ns
tpch_q13/datafusion:parquet 667317842 6.55055e+08 1.01872 ns
tpch_q14/datafusion:parquet 813066759 7.80066e+08 1.0423 ns
tpch_q15/datafusion:parquet 1255134842 1.13243e+09 1.10836 ns
tpch_q16/datafusion:parquet 378980793 3.84031e+08 0.986849 ns
tpch_q17/datafusion:parquet 1456917100 1.33197e+09 1.09381 ns
tpch_q18/datafusion:parquet 1603411781 1.59233e+09 1.00696 ns
tpch_q19/datafusion:parquet 1001404331 9.61545e+08 1.04145 ns
tpch_q20/datafusion:parquet 1159211783 1.12188e+09 1.03327 ns
tpch_q21/datafusion:parquet 1771693511 1.72113e+09 1.02938 ns
tpch_q22/datafusion:parquet 647030167 6.37927e+08 1.01427 ns
tpch_q01/datafusion:vortex-file-compressed 674943781 7.00097e+08 0.964072 ns
tpch_q02/datafusion:vortex-file-compressed 782118703 7.5159e+08 1.04062 ns
tpch_q03/datafusion:vortex-file-compressed 742862764 7.45021e+08 0.997103 ns
tpch_q04/datafusion:vortex-file-compressed 569799807 5.53667e+08 1.02914 ns
tpch_q05/datafusion:vortex-file-compressed 1119584923 1.01498e+09 1.10306 ns
tpch_q06/datafusion:vortex-file-compressed 676262977 5.88142e+08 1.14983 ns
tpch_q07/datafusion:vortex-file-compressed 1133440442 1.06649e+09 1.06278 ns
tpch_q08/datafusion:vortex-file-compressed 1294876797 1.15351e+09 1.12255 ns
tpch_q09/datafusion:vortex-file-compressed 1706373945 1.51847e+09 1.12375 ns
tpch_q10/datafusion:vortex-file-compressed 1066316352 1.07866e+09 0.988559 ns
tpch_q11/datafusion:vortex-file-compressed 480926888 5.1293e+08 0.937607 ns
tpch_q12/datafusion:vortex-file-compressed 870154192 8.15367e+08 1.06719 ns
tpch_q13/datafusion:vortex-file-compressed 430823954 4.31612e+08 0.998174 ns
tpch_q14/datafusion:vortex-file-compressed 582066481 5.64386e+08 1.03133 ns
tpch_q15/datafusion:vortex-file-compressed 1051524762 1.0424e+09 1.00875 ns
tpch_q16/datafusion:vortex-file-compressed 328413487 2.69281e+08 1.21959 ns
tpch_q17/datafusion:vortex-file-compressed 1193565469 1.1715e+09 1.01884 ns
tpch_q18/datafusion:vortex-file-compressed 1344868565 1.33231e+09 1.00943 ns
tpch_q19/datafusion:vortex-file-compressed 709648171 6.91105e+08 1.02683 ns
tpch_q20/datafusion:vortex-file-compressed 882130825 8.70633e+08 1.01321 ns
tpch_q21/datafusion:vortex-file-compressed 1595705839 1.53938e+09 1.03659 ns
tpch_q22/datafusion:vortex-file-compressed 329012752 3.10038e+08 1.0612 ns
tpch_q01/datafusion:vortex-compact 708087354 6.9689e+08 1.01607 ns
tpch_q02/datafusion:vortex-compact 707821429 5.82997e+08 1.21411 ns
tpch_q03/datafusion:vortex-compact 786600605 6.70378e+08 1.17337 ns
tpch_q04/datafusion:vortex-compact 563459356 4.871e+08 1.15676 ns
tpch_q05/datafusion:vortex-compact 997762976 9.16289e+08 1.08892 ns
tpch_q06/datafusion:vortex-compact 595428601 5.84813e+08 1.01815 ns
tpch_q07/datafusion:vortex-compact 1111331028 1.06396e+09 1.04452 ns
tpch_q08/datafusion:vortex-compact 1127473862 1.07575e+09 1.04808 ns
tpch_q09/datafusion:vortex-compact 1431319419 1.28582e+09 1.11316 ns
tpch_q10/datafusion:vortex-compact 1016671610 8.41073e+08 1.20878 ns
tpch_q11/datafusion:vortex-compact 465735130 3.8123e+08 1.22166 ns
tpch_q12/datafusion:vortex-compact 772309000 7.31434e+08 1.05588 ns
tpch_q13/datafusion:vortex-compact 416036354 4.15753e+08 1.00068 ns
tpch_q14/datafusion:vortex-compact 559926273 5.5554e+08 1.0079 ns
tpch_q15/datafusion:vortex-compact 980882320 9.55484e+08 1.02658 ns
tpch_q16/datafusion:vortex-compact 323493128 2.70709e+08 1.19498 ns
tpch_q17/datafusion:vortex-compact 1229780352 1.19373e+09 1.0302 ns
tpch_q18/datafusion:vortex-compact 1190397315 1.15889e+09 1.02719 ns
tpch_q19/datafusion:vortex-compact 638343356 6.0374e+08 1.05731 ns
tpch_q20/datafusion:vortex-compact 829232355 8.05917e+08 1.02893 ns
tpch_q21/datafusion:vortex-compact 1530334261 1.42417e+09 1.07455 ns
tpch_q22/datafusion:vortex-compact 341762991 3.12286e+08 1.09439 ns
tpch_q01/duckdb:parquet 1150678512 9.03045e+08 1.27422 ns
tpch_q02/duckdb:parquet 2163048880 1.20676e+09 1.79245 ns 🚨
tpch_q03/duckdb:parquet 2015121788 1.29003e+09 1.56208 ns 🚨
tpch_q04/duckdb:parquet 1380328401 8.21498e+08 1.68026 ns 🚨
tpch_q05/duckdb:parquet 2662291396 1.59037e+09 1.67401 ns 🚨
tpch_q06/duckdb:parquet 898834538 5.71668e+08 1.5723 ns 🚨
tpch_q07/duckdb:parquet 2463934580 1.50023e+09 1.64237 ns 🚨
tpch_q08/duckdb:parquet 3113272074 1.90597e+09 1.63344 ns 🚨
tpch_q09/duckdb:parquet 2902242934 1.88239e+09 1.54179 ns 🚨
tpch_q10/duckdb:parquet 3473110180 2.64671e+09 1.31224 ns 🚨
tpch_q11/duckdb:parquet 1360933425 6.81621e+08 1.99661 ns 🚨
tpch_q12/duckdb:parquet 1318159812 7.49914e+08 1.75775 ns 🚨
tpch_q13/duckdb:parquet 1392400824 9.37686e+08 1.48493 ns 🚨
tpch_q14/duckdb:parquet 1453958037 1.04195e+09 1.39542 ns 🚨
tpch_q15/duckdb:parquet 1113902822 8.74125e+08 1.27431 ns
tpch_q16/duckdb:parquet 1074200619 5.83372e+08 1.84137 ns 🚨
tpch_q17/duckdb:parquet 1570002268 1.03743e+09 1.51335 ns 🚨
tpch_q18/duckdb:parquet 1785318788 1.05813e+09 1.68724 ns 🚨
tpch_q19/duckdb:parquet 1726738550 1.24042e+09 1.39206 ns 🚨
tpch_q20/duckdb:parquet 2219195975 1.45638e+09 1.52378 ns 🚨
tpch_q21/duckdb:parquet 2412160687 1.44802e+09 1.66584 ns 🚨
tpch_q22/duckdb:parquet 1259705575 7.95532e+08 1.58348 ns 🚨
tpch_q01/duckdb:vortex-file-compressed 618686799 6.13486e+08 1.00848 ns
tpch_q02/duckdb:vortex-file-compressed 988452919 9.49112e+08 1.04145 ns
tpch_q03/duckdb:vortex-file-compressed 915412189 9.24551e+08 0.990115 ns
tpch_q04/duckdb:vortex-file-compressed 604497721 5.59466e+08 1.08049 ns
tpch_q05/duckdb:vortex-file-compressed 1050345239 1.12653e+09 0.932376 ns
tpch_q06/duckdb:vortex-file-compressed 794575173 7.76317e+08 1.02352 ns
tpch_q07/duckdb:vortex-file-compressed 1089374455 1.08226e+09 1.00657 ns
tpch_q08/duckdb:vortex-file-compressed 1421391063 1.40423e+09 1.01222 ns
tpch_q09/duckdb:vortex-file-compressed 1430498732 1.31064e+09 1.09145 ns
tpch_q10/duckdb:vortex-file-compressed 1077670547 1.29083e+09 0.834869 ns
tpch_q11/duckdb:vortex-file-compressed 518200719 5.80649e+08 0.892451 ns
tpch_q12/duckdb:vortex-file-compressed 654057486 6.42077e+08 1.01866 ns
tpch_q13/duckdb:vortex-file-compressed 994034630 9.26277e+08 1.07315 ns
tpch_q14/duckdb:vortex-file-compressed 932366770 8.19445e+08 1.1378 ns
tpch_q15/duckdb:vortex-file-compressed 604256398 6.30149e+08 0.95891 ns
tpch_q16/duckdb:vortex-file-compressed 342197795 4.10834e+08 0.832934 ns
tpch_q17/duckdb:vortex-file-compressed 995108207 9.47381e+08 1.05038 ns
tpch_q18/duckdb:vortex-file-compressed 888503560 1.00602e+09 0.88319 ns
tpch_q19/duckdb:vortex-file-compressed 757762214 6.74505e+08 1.12344 ns
tpch_q20/duckdb:vortex-file-compressed 1131499778 1.11782e+09 1.01224 ns
tpch_q21/duckdb:vortex-file-compressed 1916440408 1.74825e+09 1.09621 ns
tpch_q22/duckdb:vortex-file-compressed 503613501 4.52602e+08 1.11271 ns
tpch_q01/duckdb:vortex-compact 657724282 5.86412e+08 1.12161 ns
tpch_q02/duckdb:vortex-compact 831288352 8.26414e+08 1.0059 ns
tpch_q03/duckdb:vortex-compact 748226323 7.45831e+08 1.00321 ns
tpch_q04/duckdb:vortex-compact 484998213 4.6489e+08 1.04325 ns
tpch_q05/duckdb:vortex-compact 1033850135 1.04421e+09 0.990076 ns
tpch_q06/duckdb:vortex-compact 788793265 7.21867e+08 1.09271 ns
tpch_q07/duckdb:vortex-compact 950957752 9.92642e+08 0.958006 ns
tpch_q08/duckdb:vortex-compact 1265498031 1.29353e+09 0.978333 ns
tpch_q09/duckdb:vortex-compact 1268253204 1.24631e+09 1.0176 ns
tpch_q10/duckdb:vortex-compact 1022542778 1.11229e+09 0.919315 ns
tpch_q11/duckdb:vortex-compact 601935442 6.11966e+08 0.98361 ns
tpch_q12/duckdb:vortex-compact 640891329 5.98771e+08 1.07034 ns
tpch_q13/duckdb:vortex-compact 774139602 7.56052e+08 1.02392 ns
tpch_q14/duckdb:vortex-compact 825153094 7.4952e+08 1.10091 ns
tpch_q15/duckdb:vortex-compact 507099606 6.34559e+08 0.799137 ns
tpch_q16/duckdb:vortex-compact 352645410 3.94282e+08 0.894398 ns
tpch_q17/duckdb:vortex-compact 896873709 8.8007e+08 1.01909 ns
tpch_q18/duckdb:vortex-compact 685679305 8.35925e+08 0.820264 ns
tpch_q19/duckdb:vortex-compact 679296972 6.41984e+08 1.05812 ns
tpch_q20/duckdb:vortex-compact 1004319121 1.00428e+09 1.00004 ns
tpch_q21/duckdb:vortex-compact 1614425202 1.53875e+09 1.04918 ns
tpch_q22/duckdb:vortex-compact 620948431 4.76341e+08 1.30358 ns 🚨

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Benchmarks: Clickbench on NVME

Summary

  • Overall: 1.025x ➖
  • Vortex: 1.002x ➖
  • duckdb:vortex: 0.979x ➖
  • datafusion:vortex: 1.025x ➖
  • Best: clickbench_q17/duckdb:vortex-compact (0.595x)
  • Worst: clickbench_q23/duckdb:vortex-compact (2.197x)
  • Significant (>10%): 17↑ 39↓
Detailed Results Table
name PR 6f212f6 base fb71117 ratio (PR/base) unit remark
clickbench_q00/datafusion:parquet 1741524 1.79696e+06 0.969153 ns
clickbench_q01/datafusion:parquet 20077075 2.09269e+07 0.95939 ns
clickbench_q02/datafusion:parquet 52892588 5.57992e+07 0.947909 ns
clickbench_q03/datafusion:parquet 42768605 4.40612e+07 0.970664 ns
clickbench_q04/datafusion:parquet 346312864 3.77244e+08 0.918008 ns
clickbench_q05/datafusion:parquet 349913158 3.61513e+08 0.967914 ns
clickbench_q06/datafusion:parquet 1576375 1.66945e+06 0.944248 ns
clickbench_q07/datafusion:parquet 25810243 2.56821e+07 1.00499 ns
clickbench_q08/datafusion:parquet 441364325 4.73661e+08 0.931815 ns
clickbench_q09/datafusion:parquet 656280122 7.13645e+08 0.919618 ns
clickbench_q10/datafusion:parquet 113559645 1.19489e+08 0.950374 ns
clickbench_q11/datafusion:parquet 140546860 1.50437e+08 0.934257 ns
clickbench_q12/datafusion:parquet 346163095 3.69643e+08 0.93648 ns
clickbench_q13/datafusion:parquet 499802841 5.41051e+08 0.923763 ns
clickbench_q14/datafusion:parquet 342236683 3.56414e+08 0.960222 ns
clickbench_q15/datafusion:parquet 406443338 4.36355e+08 0.931451 ns
clickbench_q16/datafusion:parquet 721479600 7.81675e+08 0.922992 ns
clickbench_q17/datafusion:parquet 714255846 7.50068e+08 0.952254 ns
clickbench_q18/datafusion:parquet 1398444340 1.46505e+09 0.954537 ns
clickbench_q19/datafusion:parquet 36852029 3.61312e+07 1.01995 ns
clickbench_q20/datafusion:parquet 550792726 5.73926e+08 0.959693 ns
clickbench_q21/datafusion:parquet 641393480 6.57987e+08 0.974781 ns
clickbench_q22/datafusion:parquet 939502521 9.84391e+08 0.9544 ns
clickbench_q23/datafusion:parquet 3761872668 3.88184e+09 0.969096 ns
clickbench_q24/datafusion:parquet 101916814 1.07739e+08 0.945958 ns
clickbench_q25/datafusion:parquet 137290010 1.44597e+08 0.949464 ns
clickbench_q26/datafusion:parquet 101645449 1.06208e+08 0.95704 ns
clickbench_q27/datafusion:parquet 970300979 9.99546e+08 0.970742 ns
clickbench_q28/datafusion:parquet 5737180017 5.91182e+09 0.97046 ns
clickbench_q29/datafusion:parquet 215869487 2.15766e+08 1.00048 ns
clickbench_q30/datafusion:parquet 345906279 3.62016e+08 0.9555 ns
clickbench_q31/datafusion:parquet 401394383 4.16415e+08 0.963929 ns
clickbench_q32/datafusion:parquet 1296903589 1.45517e+09 0.891238 ns 🚀
clickbench_q33/datafusion:parquet 1491488682 1.55058e+09 0.96189 ns
clickbench_q34/datafusion:parquet 1519970709 1.54896e+09 0.981283 ns
clickbench_q35/datafusion:parquet 696850513 5.89764e+08 1.18157 ns 🚨
clickbench_q36/datafusion:parquet 173804688 1.55962e+08 1.11441 ns 🚨
clickbench_q37/datafusion:parquet 61017899 6.21593e+07 0.981638 ns
clickbench_q38/datafusion:parquet 100449149 9.6029e+07 1.04603 ns
clickbench_q39/datafusion:parquet 334316336 2.85146e+08 1.17244 ns 🚨
clickbench_q40/datafusion:parquet 39959390 3.59377e+07 1.11191 ns 🚨
clickbench_q41/datafusion:parquet 35068201 3.38966e+07 1.03456 ns
clickbench_q42/datafusion:parquet 35781558 3.45655e+07 1.03518 ns
clickbench_q00/datafusion:vortex-file-compressed 2180467 1.70796e+06 1.27665 ns 🚨
clickbench_q01/datafusion:vortex-file-compressed 16005427 1.40257e+07 1.14115 ns 🚨
clickbench_q02/datafusion:vortex-file-compressed 36427654 3.23944e+07 1.1245 ns 🚨
clickbench_q03/datafusion:vortex-file-compressed 43506832 3.68429e+07 1.18087 ns 🚨
clickbench_q04/datafusion:vortex-file-compressed 381069708 3.34107e+08 1.14056 ns 🚨
clickbench_q05/datafusion:vortex-file-compressed 377766654 3.27069e+08 1.15501 ns 🚨
clickbench_q06/datafusion:vortex-file-compressed 2103278 1.74569e+06 1.20484 ns 🚨
clickbench_q07/datafusion:vortex-file-compressed 21661698 1.92708e+07 1.12407 ns 🚨
clickbench_q08/datafusion:vortex-file-compressed 463058197 3.96524e+08 1.16779 ns 🚨
clickbench_q09/datafusion:vortex-file-compressed 710903384 5.93808e+08 1.19719 ns 🚨
clickbench_q10/datafusion:vortex-file-compressed 83400447 7.39735e+07 1.12744 ns 🚨
clickbench_q11/datafusion:vortex-file-compressed 93993217 8.31478e+07 1.13044 ns 🚨
clickbench_q12/datafusion:vortex-file-compressed 334008810 2.80191e+08 1.19208 ns 🚨
clickbench_q13/datafusion:vortex-file-compressed 484307928 4.25604e+08 1.13793 ns 🚨
clickbench_q14/datafusion:vortex-file-compressed 293331888 2.6184e+08 1.12027 ns 🚨
clickbench_q15/datafusion:vortex-file-compressed 442599976 3.87247e+08 1.14294 ns 🚨
clickbench_q16/datafusion:vortex-file-compressed 848709667 7.41887e+08 1.14399 ns 🚨
clickbench_q17/datafusion:vortex-file-compressed 834438266 7.27619e+08 1.14681 ns 🚨
clickbench_q18/datafusion:vortex-file-compressed 1603271774 1.43104e+09 1.12035 ns 🚨
clickbench_q19/datafusion:vortex-file-compressed 26642887 2.50686e+07 1.0628 ns
clickbench_q20/datafusion:vortex-file-compressed 414397373 3.50878e+08 1.18103 ns 🚨
clickbench_q21/datafusion:vortex-file-compressed 479078107 4.0902e+08 1.17128 ns 🚨
clickbench_q22/datafusion:vortex-file-compressed 664175241 5.709e+08 1.16338 ns 🚨
clickbench_q23/datafusion:vortex-file-compressed 722280035 6.03541e+08 1.19674 ns 🚨
clickbench_q24/datafusion:vortex-file-compressed 58772974 4.94822e+07 1.18776 ns 🚨
clickbench_q25/datafusion:vortex-file-compressed 94086183 7.19289e+07 1.30804 ns 🚨
clickbench_q26/datafusion:vortex-file-compressed 56793773 5.07874e+07 1.11826 ns 🚨
clickbench_q27/datafusion:vortex-file-compressed 919573684 8.26288e+08 1.1129 ns 🚨
clickbench_q28/datafusion:vortex-file-compressed 6722047787 6.77857e+09 0.991662 ns
clickbench_q29/datafusion:vortex-file-compressed 237010750 2.30434e+08 1.02854 ns
clickbench_q30/datafusion:vortex-file-compressed 254164838 2.61172e+08 0.973169 ns
clickbench_q31/datafusion:vortex-file-compressed 291978942 2.99113e+08 0.97615 ns
clickbench_q32/datafusion:vortex-file-compressed 1279003856 1.47259e+09 0.868538 ns 🚀
clickbench_q33/datafusion:vortex-file-compressed 1469800119 1.42963e+09 1.0281 ns
clickbench_q34/datafusion:vortex-file-compressed 1445823395 1.44499e+09 1.00058 ns
clickbench_q35/datafusion:vortex-file-compressed 524693879 5.45093e+08 0.962577 ns
clickbench_q36/datafusion:vortex-file-compressed 78282918 8.19031e+07 0.955799 ns
clickbench_q37/datafusion:vortex-file-compressed 37613934 3.89596e+07 0.965459 ns
clickbench_q38/datafusion:vortex-file-compressed 23763057 2.48926e+07 0.954622 ns
clickbench_q39/datafusion:vortex-file-compressed 145853989 1.67361e+08 0.871495 ns 🚀
clickbench_q40/datafusion:vortex-file-compressed 20210163 2.1086e+07 0.958462 ns
clickbench_q41/datafusion:vortex-file-compressed 18759817 2.05094e+07 0.914693 ns
clickbench_q42/datafusion:vortex-file-compressed 22187017 2.25033e+07 0.985945 ns
clickbench_q00/datafusion:vortex-compact 1697045 1.74882e+06 0.970395 ns
clickbench_q01/datafusion:vortex-compact 17722698 1.8996e+07 0.932972 ns
clickbench_q02/datafusion:vortex-compact 42524673 4.29179e+07 0.990838 ns
clickbench_q03/datafusion:vortex-compact 40842176 4.11814e+07 0.991763 ns
clickbench_q04/datafusion:vortex-compact 338376917 3.51037e+08 0.963936 ns
clickbench_q05/datafusion:vortex-compact 334380180 3.55288e+08 0.941153 ns
clickbench_q06/datafusion:vortex-compact 1724087 1.78677e+06 0.964918 ns
clickbench_q07/datafusion:vortex-compact 27665511 2.81788e+07 0.981784 ns
clickbench_q08/datafusion:vortex-compact 426839861 4.36958e+08 0.976844 ns
clickbench_q09/datafusion:vortex-compact 651607936 6.83258e+08 0.953678 ns
clickbench_q10/datafusion:vortex-compact 134547723 1.34915e+08 0.997276 ns
clickbench_q11/datafusion:vortex-compact 173342329 1.78499e+08 0.97111 ns
clickbench_q12/datafusion:vortex-compact 291088047 3.03435e+08 0.959309 ns
clickbench_q13/datafusion:vortex-compact 530131775 5.47525e+08 0.968233 ns
clickbench_q14/datafusion:vortex-compact 303363014 3.172e+08 0.956378 ns
clickbench_q15/datafusion:vortex-compact 393304488 4.04742e+08 0.97174 ns
clickbench_q16/datafusion:vortex-compact 790479861 8.14834e+08 0.970112 ns
clickbench_q17/datafusion:vortex-compact 789866765 8.10185e+08 0.974921 ns
clickbench_q18/datafusion:vortex-compact 1463583025 1.51601e+09 0.965417 ns
clickbench_q19/datafusion:vortex-compact 32125084 3.15303e+07 1.01887 ns
clickbench_q20/datafusion:vortex-compact 426183561 4.22144e+08 1.00957 ns
clickbench_q21/datafusion:vortex-compact 604298090 6.31883e+08 0.956344 ns
clickbench_q22/datafusion:vortex-compact 1005680887 1.04033e+09 0.966691 ns
clickbench_q23/datafusion:vortex-compact 2806957152 3.20427e+09 0.876006 ns 🚀
clickbench_q24/datafusion:vortex-compact 94094101 9.46534e+07 0.994092 ns
clickbench_q25/datafusion:vortex-compact 115274808 1.19898e+08 0.961444 ns
clickbench_q26/datafusion:vortex-compact 94775113 9.68999e+07 0.978073 ns
clickbench_q27/datafusion:vortex-compact 879363383 8.88366e+08 0.989866 ns
clickbench_q28/datafusion:vortex-compact 6174114333 6.09611e+09 1.0128 ns
clickbench_q29/datafusion:vortex-compact 227904641 2.21523e+08 1.02881 ns
clickbench_q30/datafusion:vortex-compact 390627619 4.0174e+08 0.972339 ns
clickbench_q31/datafusion:vortex-compact 463065621 4.73369e+08 0.978234 ns
clickbench_q32/datafusion:vortex-compact 1326233421 1.47408e+09 0.899705 ns 🚀
clickbench_q33/datafusion:vortex-compact 1569073512 1.58624e+09 0.989176 ns
clickbench_q34/datafusion:vortex-compact 1515897287 1.53544e+09 0.987275 ns
clickbench_q35/datafusion:vortex-compact 573024365 5.77862e+08 0.991628 ns
clickbench_q36/datafusion:vortex-compact 85846275 9.28526e+07 0.924544 ns
clickbench_q37/datafusion:vortex-compact 41094396 4.25253e+07 0.966353 ns
clickbench_q38/datafusion:vortex-compact 31571642 3.35259e+07 0.941708 ns
clickbench_q39/datafusion:vortex-compact 160198980 1.75067e+08 0.915074 ns
clickbench_q40/datafusion:vortex-compact 26205683 2.81026e+07 0.9325 ns
clickbench_q41/datafusion:vortex-compact 26880279 2.70053e+07 0.995372 ns
clickbench_q42/datafusion:vortex-compact 22257208 2.28656e+07 0.973393 ns
clickbench_q00/duckdb:parquet 223140112 1.27044e+08 1.7564 ns 🚨
clickbench_q01/duckdb:parquet 50617903 5.22061e+07 0.969578 ns
clickbench_q02/duckdb:parquet 67013485 6.62387e+07 1.0117 ns
clickbench_q03/duckdb:parquet 65948105 6.42273e+07 1.02679 ns
clickbench_q04/duckdb:parquet 203171940 2.0725e+08 0.980324 ns
clickbench_q05/duckdb:parquet 278710376 2.74941e+08 1.01371 ns
clickbench_q06/duckdb:parquet 61716877 6.12613e+07 1.00744 ns
clickbench_q07/duckdb:parquet 51315303 5.65435e+07 0.907536 ns
clickbench_q08/duckdb:parquet 260862359 2.69179e+08 0.969103 ns
clickbench_q09/duckdb:parquet 386923249 3.96232e+08 0.976507 ns
clickbench_q10/duckdb:parquet 96456941 9.70691e+07 0.993693 ns
clickbench_q11/duckdb:parquet 108405258 1.06938e+08 1.01372 ns
clickbench_q12/duckdb:parquet 293655146 2.8989e+08 1.01299 ns
clickbench_q13/duckdb:parquet 505265885 4.84185e+08 1.04354 ns
clickbench_q14/duckdb:parquet 329935397 3.22599e+08 1.02274 ns
clickbench_q15/duckdb:parquet 243555636 2.40849e+08 1.01124 ns
clickbench_q16/duckdb:parquet 597011026 5.75659e+08 1.03709 ns
clickbench_q17/duckdb:parquet 501082499 4.86855e+08 1.02922 ns
clickbench_q18/duckdb:parquet 1039053894 9.98251e+08 1.04087 ns
clickbench_q19/duckdb:parquet 49079083 5.02164e+07 0.977351 ns
clickbench_q20/duckdb:parquet 434269903 4.06672e+08 1.06786 ns
clickbench_q21/duckdb:parquet 555166103 5.26464e+08 1.05452 ns
clickbench_q22/duckdb:parquet 921958939 9.16569e+08 1.00588 ns
clickbench_q23/duckdb:parquet 311661576 2.77684e+08 1.12236 ns 🚨
clickbench_q24/duckdb:parquet 78678131 7.88797e+07 0.997444 ns
clickbench_q25/duckdb:parquet 138137031 1.40366e+08 0.984119 ns
clickbench_q26/duckdb:parquet 54303720 5.44799e+07 0.996767 ns
clickbench_q27/duckdb:parquet 638534462 6.194e+08 1.03089 ns
clickbench_q28/duckdb:parquet 5028813272 4.89955e+09 1.02638 ns
clickbench_q29/duckdb:parquet 61866891 6.21068e+07 0.996138 ns
clickbench_q30/duckdb:parquet 299451018 3.09154e+08 0.968613 ns
clickbench_q31/duckdb:parquet 343106401 3.51011e+08 0.977479 ns
clickbench_q32/duckdb:parquet 1069570652 1.05962e+09 1.00939 ns
clickbench_q33/duckdb:parquet 1151124358 1.07435e+09 1.07146 ns
clickbench_q34/duckdb:parquet 1239934201 1.12538e+09 1.10179 ns 🚨
clickbench_q35/duckdb:parquet 366950602 3.51651e+08 1.04351 ns
clickbench_q36/duckdb:parquet 64053367 6.10819e+07 1.04865 ns
clickbench_q37/duckdb:parquet 53339208 4.95282e+07 1.07695 ns
clickbench_q38/duckdb:parquet 59772099 5.17154e+07 1.15579 ns 🚨
clickbench_q39/duckdb:parquet 99353557 9.43508e+07 1.05302 ns
clickbench_q40/duckdb:parquet 57797510 5.36557e+07 1.07719 ns
clickbench_q41/duckdb:parquet 60831003 5.56636e+07 1.09283 ns
clickbench_q42/duckdb:parquet 52404334 4.48359e+07 1.1688 ns 🚨
clickbench_q00/duckdb:vortex-file-compressed 6351867 5.45315e+06 1.16481 ns 🚨
clickbench_q01/duckdb:vortex-file-compressed 12775538 1.392e+07 0.917781 ns
clickbench_q02/duckdb:vortex-file-compressed 24332158 2.35801e+07 1.0319 ns
clickbench_q03/duckdb:vortex-file-compressed 30333345 2.94445e+07 1.03019 ns
clickbench_q04/duckdb:vortex-file-compressed 172234776 1.73508e+08 0.992664 ns
clickbench_q05/duckdb:vortex-file-compressed 197432695 1.92406e+08 1.02613 ns
clickbench_q06/duckdb:vortex-file-compressed 19554556 2.06061e+07 0.948972 ns
clickbench_q07/duckdb:vortex-file-compressed 16223530 1.74261e+07 0.930989 ns
clickbench_q08/duckdb:vortex-file-compressed 257378062 2.62857e+08 0.979156 ns
clickbench_q09/duckdb:vortex-file-compressed 368645165 3.71612e+08 0.992017 ns
clickbench_q10/duckdb:vortex-file-compressed 71638017 7.72314e+07 0.927577 ns
clickbench_q11/duckdb:vortex-file-compressed 77508922 8.20966e+07 0.944118 ns
clickbench_q12/duckdb:vortex-file-compressed 206857542 2.04877e+08 1.00967 ns
clickbench_q13/duckdb:vortex-file-compressed 422171767 4.80272e+08 0.879027 ns 🚀
clickbench_q14/duckdb:vortex-file-compressed 234223220 2.93878e+08 0.797009 ns 🚀
clickbench_q15/duckdb:vortex-file-compressed 209546001 2.18063e+08 0.960942 ns
clickbench_q16/duckdb:vortex-file-compressed 654772337 9.93583e+08 0.659001 ns 🚀
clickbench_q17/duckdb:vortex-file-compressed 513730792 8.5399e+08 0.601565 ns 🚀
clickbench_q18/duckdb:vortex-file-compressed 1206524868 1.41892e+09 0.850315 ns 🚀
clickbench_q19/duckdb:vortex-file-compressed 21149135 2.36687e+07 0.89355 ns 🚀
clickbench_q20/duckdb:vortex-file-compressed 357197310 3.69092e+08 0.967773 ns
clickbench_q21/duckdb:vortex-file-compressed 383033985 3.97431e+08 0.963775 ns
clickbench_q22/duckdb:vortex-file-compressed 587887852 7.5135e+08 0.782442 ns 🚀
clickbench_q23/duckdb:vortex-file-compressed 1081088517 7.69332e+08 1.40523 ns 🚨
clickbench_q24/duckdb:vortex-file-compressed 52434347 5.71639e+07 0.917263 ns
clickbench_q25/duckdb:vortex-file-compressed 74846143 7.34826e+07 1.01856 ns
clickbench_q26/duckdb:vortex-file-compressed 42149365 4.74281e+07 0.888699 ns 🚀
clickbench_q27/duckdb:vortex-file-compressed 512119075 5.35938e+08 0.955556 ns
clickbench_q28/duckdb:vortex-file-compressed 3086808705 3.06318e+09 1.00771 ns
clickbench_q29/duckdb:vortex-file-compressed 27773624 2.91606e+07 0.952437 ns
clickbench_q30/duckdb:vortex-file-compressed 189441727 1.96598e+08 0.963601 ns
clickbench_q31/duckdb:vortex-file-compressed 261588486 2.77587e+08 0.942366 ns
clickbench_q32/duckdb:vortex-file-compressed 1204292869 1.06842e+09 1.12717 ns 🚨
clickbench_q33/duckdb:vortex-file-compressed 1451691256 1.09196e+09 1.32944 ns 🚨
clickbench_q34/duckdb:vortex-file-compressed 1508015382 1.55093e+09 0.972328 ns
clickbench_q35/duckdb:vortex-file-compressed 386235083 3.60757e+08 1.07062 ns
clickbench_q36/duckdb:vortex-file-compressed 31198299 2.93323e+07 1.06362 ns
clickbench_q37/duckdb:vortex-file-compressed 23612933 2.09921e+07 1.12485 ns 🚨
clickbench_q38/duckdb:vortex-file-compressed 23550993 2.30318e+07 1.02254 ns
clickbench_q39/duckdb:vortex-file-compressed 45315600 4.92683e+07 0.919772 ns
clickbench_q40/duckdb:vortex-file-compressed 23018936 2.17831e+07 1.05674 ns
clickbench_q41/duckdb:vortex-file-compressed 21210579 2.05935e+07 1.02996 ns
clickbench_q42/duckdb:vortex-file-compressed 23185938 2.38248e+07 0.973186 ns
clickbench_q00/duckdb:vortex-compact 5792246 5.27587e+06 1.09788 ns
clickbench_q01/duckdb:vortex-compact 14630395 1.55266e+07 0.94228 ns
clickbench_q02/duckdb:vortex-compact 35079382 3.67418e+07 0.954753 ns
clickbench_q03/duckdb:vortex-compact 39164336 3.90799e+07 1.00216 ns
clickbench_q04/duckdb:vortex-compact 192433061 1.9926e+08 0.965736 ns
clickbench_q05/duckdb:vortex-compact 227400866 2.28827e+08 0.993769 ns
clickbench_q06/duckdb:vortex-compact 19248784 2.07134e+07 0.92929 ns
clickbench_q07/duckdb:vortex-compact 20110548 2.13596e+07 0.941523 ns
clickbench_q08/duckdb:vortex-compact 295364338 3.0334e+08 0.973707 ns
clickbench_q09/duckdb:vortex-compact 451520120 4.63156e+08 0.974877 ns
clickbench_q10/duckdb:vortex-compact 122928663 1.29196e+08 0.951493 ns
clickbench_q11/duckdb:vortex-compact 160969766 1.6469e+08 0.977408 ns
clickbench_q12/duckdb:vortex-compact 253222481 2.50226e+08 1.01198 ns
clickbench_q13/duckdb:vortex-compact 531442740 5.9791e+08 0.888834 ns 🚀
clickbench_q14/duckdb:vortex-compact 297632007 3.73322e+08 0.797252 ns 🚀
clickbench_q15/duckdb:vortex-compact 235426441 2.39445e+08 0.983218 ns
clickbench_q16/duckdb:vortex-compact 663815786 1.06309e+09 0.624424 ns 🚀
clickbench_q17/duckdb:vortex-compact 570736818 9.59694e+08 0.594707 ns 🚀
clickbench_q18/duckdb:vortex-compact 1129870603 1.56141e+09 0.723621 ns 🚀
clickbench_q19/duckdb:vortex-compact 27047629 2.8613e+07 0.945293 ns
clickbench_q20/duckdb:vortex-compact 425914638 4.6918e+08 0.907785 ns
clickbench_q21/duckdb:vortex-compact 644467778 6.61688e+08 0.973975 ns
clickbench_q22/duckdb:vortex-compact 1024429246 1.13261e+09 0.904489 ns
clickbench_q23/duckdb:vortex-compact 4453312495 2.02717e+09 2.19681 ns 🚨
clickbench_q24/duckdb:vortex-compact 96045653 8.20679e+07 1.17032 ns 🚨
clickbench_q25/duckdb:vortex-compact 138473962 1.21745e+08 1.13741 ns 🚨
clickbench_q26/duckdb:vortex-compact 88335939 8.15983e+07 1.08257 ns
clickbench_q27/duckdb:vortex-compact 660784076 5.99021e+08 1.10311 ns 🚨
clickbench_q28/duckdb:vortex-compact 3535906126 3.17432e+09 1.11391 ns 🚨
clickbench_q29/duckdb:vortex-compact 33450448 3.41182e+07 0.980428 ns
clickbench_q30/duckdb:vortex-compact 335891365 3.47955e+08 0.965331 ns
clickbench_q31/duckdb:vortex-compact 442738874 4.56543e+08 0.969763 ns
clickbench_q32/duckdb:vortex-compact 1319084581 1.13914e+09 1.15797 ns 🚨
clickbench_q33/duckdb:vortex-compact 1432443216 1.13489e+09 1.26218 ns 🚨
clickbench_q34/duckdb:vortex-compact 1506575786 1.62763e+09 0.925628 ns
clickbench_q35/duckdb:vortex-compact 394472104 3.70165e+08 1.06567 ns
clickbench_q36/duckdb:vortex-compact 34374686 3.49712e+07 0.982942 ns
clickbench_q37/duckdb:vortex-compact 29009511 2.6842e+07 1.08075 ns
clickbench_q38/duckdb:vortex-compact 28329908 2.73492e+07 1.03586 ns
clickbench_q39/duckdb:vortex-compact 56190388 5.84143e+07 0.961928 ns
clickbench_q40/duckdb:vortex-compact 25002296 2.34878e+07 1.06448 ns
clickbench_q41/duckdb:vortex-compact 25156444 2.41501e+07 1.04167 ns
clickbench_q42/duckdb:vortex-compact 25028329 2.32958e+07 1.07437 ns
clickbench_q00/duckdb:duckdb 20753267 1.90683e+07 1.08836 ns
clickbench_q01/duckdb:duckdb 36990326 3.75126e+07 0.986077 ns
clickbench_q02/duckdb:duckdb 48793963 4.60235e+07 1.0602 ns
clickbench_q03/duckdb:duckdb 51353507 4.72613e+07 1.08659 ns
clickbench_q04/duckdb:duckdb 201941586 1.92854e+08 1.04712 ns
clickbench_q05/duckdb:duckdb 325567427 3.02074e+08 1.07778 ns
clickbench_q06/duckdb:duckdb 38924833 3.64454e+07 1.06803 ns
clickbench_q07/duckdb:duckdb 39091826 3.86758e+07 1.01076 ns
clickbench_q08/duckdb:duckdb 267287134 2.53055e+08 1.05624 ns
clickbench_q09/duckdb:duckdb 434224377 3.68208e+08 1.17929 ns 🚨
clickbench_q10/duckdb:duckdb 107617249 1.1415e+08 0.942769 ns
clickbench_q11/duckdb:duckdb 113895329 1.22024e+08 0.933386 ns
clickbench_q12/duckdb:duckdb 290253449 2.70451e+08 1.07322 ns
clickbench_q13/duckdb:duckdb 515322839 4.55998e+08 1.1301 ns 🚨
clickbench_q14/duckdb:duckdb 336221399 2.92423e+08 1.14978 ns 🚨
clickbench_q15/duckdb:duckdb 233639918 2.21871e+08 1.05305 ns
clickbench_q16/duckdb:duckdb 603172845 5.5254e+08 1.09164 ns
clickbench_q17/duckdb:duckdb 516195488 4.63955e+08 1.1126 ns 🚨
clickbench_q18/duckdb:duckdb 1268973510 9.94905e+08 1.27547 ns 🚨
clickbench_q19/duckdb:duckdb 39897264 3.72643e+07 1.07066 ns
clickbench_q20/duckdb:duckdb 930868929 4.52878e+08 2.05545 ns 🚨
clickbench_q21/duckdb:duckdb 975479685 4.73368e+08 2.06072 ns 🚨
clickbench_q22/duckdb:duckdb 1069969610 5.21884e+08 2.0502 ns 🚨
clickbench_q23/duckdb:duckdb 286813436 2.30218e+08 1.24583 ns 🚨
clickbench_q24/duckdb:duckdb 67746182 4.95398e+07 1.36751 ns 🚨
clickbench_q25/duckdb:duckdb 141062721 1.12242e+08 1.25678 ns 🚨
clickbench_q26/duckdb:duckdb 61577022 4.77464e+07 1.28967 ns 🚨
clickbench_q27/duckdb:duckdb 984090609 5.27167e+08 1.86675 ns 🚨
clickbench_q28/duckdb:duckdb 4920383999 4.52752e+09 1.08677 ns
clickbench_q29/duckdb:duckdb 51627948 4.9437e+07 1.04432 ns
clickbench_q30/duckdb:duckdb 278896954 2.72958e+08 1.02176 ns
clickbench_q31/duckdb:duckdb 417599520 3.44317e+08 1.21283 ns 🚨
clickbench_q32/duckdb:duckdb 1426101925 1.04574e+09 1.36373 ns 🚨
clickbench_q33/duckdb:duckdb 1727013045 1.09691e+09 1.57443 ns 🚨
clickbench_q34/duckdb:duckdb 1803034741 1.16005e+09 1.55427 ns 🚨
clickbench_q35/duckdb:duckdb 261462873 2.70711e+08 0.965837 ns
clickbench_q36/duckdb:duckdb 42271295 4.45258e+07 0.949365 ns
clickbench_q37/duckdb:duckdb 34124058 3.34336e+07 1.02065 ns
clickbench_q38/duckdb:duckdb 33145063 3.49633e+07 0.947995 ns
clickbench_q39/duckdb:duckdb 64471565 7.86284e+07 0.819953 ns 🚀
clickbench_q40/duckdb:duckdb 33835706 3.39053e+07 0.997948 ns
clickbench_q41/duckdb:duckdb 34321944 3.39588e+07 1.0107 ns
clickbench_q42/duckdb:duckdb 33624979 3.35643e+07 1.00181 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Benchmarks: PolarSignals Profiling

Summary

  • Overall: 0.984x ➖
  • Vortex: 0.984x ➖
  • datafusion:vortex: 0.984x ➖
  • Best: polarsignals_q04/datafusion:vortex-file-compressed (0.936x)
  • Worst: polarsignals_q05/datafusion:vortex-file-compressed (1.051x)
  • Significant (>10%): 0↑ 0↓
Detailed Results Table
name PR 6f212f6 base fb71117 ratio (PR/base) unit remark
polarsignals_q00/datafusion:vortex-file-compressed 121816970 1.27149e+08 0.958063 ns
polarsignals_q01/datafusion:vortex-file-compressed 347164128 3.51375e+08 0.988016 ns
polarsignals_q02/datafusion:vortex-file-compressed 26053958 2.55489e+07 1.01977 ns
polarsignals_q03/datafusion:vortex-file-compressed 355994950 3.56153e+08 0.999556 ns
polarsignals_q04/datafusion:vortex-file-compressed 12268225 1.31044e+07 0.936193 ns
polarsignals_q05/datafusion:vortex-file-compressed 18213402 1.73247e+07 1.05129 ns
polarsignals_q06/datafusion:vortex-file-compressed 22588189 2.23032e+07 1.01278 ns
polarsignals_q07/datafusion:vortex-file-compressed 15253454 1.58764e+07 0.960761 ns
polarsignals_q08/datafusion:vortex-file-compressed 430479869 4.38285e+08 0.982193 ns
polarsignals_q09/datafusion:vortex-file-compressed 13967204 1.48644e+07 0.939639 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-DS SF=1 on NVME failed! Check the workflow run for details.

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Benchmarks: FineWeb NVMe

Summary

  • Overall: 0.993x ➖
  • Vortex: 0.986x ➖
  • duckdb:vortex: 0.966x ➖
  • datafusion:vortex: 1.007x ➖
  • Best: fineweb_q02/duckdb:vortex-file-compressed (0.837x)
  • Worst: fineweb_q01/datafusion:vortex-compact (1.120x)
  • Significant (>10%): 5↑ 1↓
Detailed Results Table
name PR 6f212f6 base fb71117 ratio (PR/base) unit remark
fineweb_q00/datafusion:parquet 6458247 6.19973e+06 1.0417 ns
fineweb_q01/datafusion:parquet 269059828 2.6849e+08 1.00212 ns
fineweb_q02/datafusion:parquet 274416422 2.69417e+08 1.01856 ns
fineweb_q03/datafusion:parquet 271131967 2.69192e+08 1.00721 ns
fineweb_q04/datafusion:parquet 285436638 2.79135e+08 1.02258 ns
fineweb_q05/datafusion:parquet 285531973 2.75065e+08 1.03805 ns
fineweb_q06/datafusion:parquet 277978704 2.75911e+08 1.00749 ns
fineweb_q07/datafusion:parquet 269722547 2.68028e+08 1.00632 ns
fineweb_q08/datafusion:parquet 264174923 2.64102e+08 1.00028 ns
fineweb_q00/datafusion:vortex-file-compressed 5480756 5.23344e+06 1.04726 ns
fineweb_q01/datafusion:vortex-file-compressed 31800665 2.94697e+07 1.0791 ns
fineweb_q02/datafusion:vortex-file-compressed 30145840 3.34852e+07 0.900272 ns
fineweb_q03/datafusion:vortex-file-compressed 91817702 8.43269e+07 1.08883 ns
fineweb_q04/datafusion:vortex-file-compressed 211044153 2.13344e+08 0.989221 ns
fineweb_q05/datafusion:vortex-file-compressed 202082626 1.98789e+08 1.01657 ns
fineweb_q06/datafusion:vortex-file-compressed 67591545 6.85139e+07 0.986538 ns
fineweb_q07/datafusion:vortex-file-compressed 75132982 7.28169e+07 1.03181 ns
fineweb_q08/datafusion:vortex-file-compressed 27917912 3.24188e+07 0.861164 ns 🚀
fineweb_q00/datafusion:vortex-compact 5422256 5.54559e+06 0.97776 ns
fineweb_q01/datafusion:vortex-compact 162485852 1.4512e+08 1.11967 ns 🚨
fineweb_q02/datafusion:vortex-compact 162750550 1.65961e+08 0.980658 ns
fineweb_q03/datafusion:vortex-compact 1270172899 1.25724e+09 1.01029 ns
fineweb_q04/datafusion:vortex-compact 1485364004 1.44759e+09 1.02609 ns
fineweb_q05/datafusion:vortex-compact 1176818987 1.13368e+09 1.03805 ns
fineweb_q06/datafusion:vortex-compact 595140380 5.8838e+08 1.01149 ns
fineweb_q07/datafusion:vortex-compact 627069056 6.24975e+08 1.00335 ns
fineweb_q08/datafusion:vortex-compact 24731656 2.48639e+07 0.994681 ns
fineweb_q00/duckdb:parquet 38383614 3.15368e+07 1.21711 ns 🚨
fineweb_q01/duckdb:parquet 95375840 9.78665e+07 0.974551 ns
fineweb_q02/duckdb:parquet 98346858 1.06938e+08 0.919665 ns
fineweb_q03/duckdb:parquet 308219956 3.12666e+08 0.98578 ns
fineweb_q04/duckdb:parquet 430121157 4.32165e+08 0.99527 ns
fineweb_q05/duckdb:parquet 404886676 4.07098e+08 0.994569 ns
fineweb_q06/duckdb:parquet 199828564 2.04361e+08 0.977823 ns
fineweb_q07/duckdb:parquet 210882899 2.15799e+08 0.977221 ns
fineweb_q08/duckdb:parquet 59025829 6.27579e+07 0.940533 ns
fineweb_q00/duckdb:vortex-file-compressed 3479986 4.05462e+06 0.858277 ns 🚀
fineweb_q01/duckdb:vortex-file-compressed 27272284 3.02887e+07 0.900411 ns
fineweb_q02/duckdb:vortex-file-compressed 26516558 3.1686e+07 0.836853 ns 🚀
fineweb_q03/duckdb:vortex-file-compressed 143108082 1.46191e+08 0.97891 ns
fineweb_q04/duckdb:vortex-file-compressed 205775005 1.98277e+08 1.03782 ns
fineweb_q05/duckdb:vortex-file-compressed 195002044 1.8411e+08 1.05916 ns
fineweb_q06/duckdb:vortex-file-compressed 68926164 6.87424e+07 1.00267 ns
fineweb_q07/duckdb:vortex-file-compressed 67352030 6.98257e+07 0.964574 ns
fineweb_q08/duckdb:vortex-file-compressed 25606089 2.90915e+07 0.880191 ns 🚀
fineweb_q00/duckdb:vortex-compact 4168353 4.67673e+06 0.891297 ns 🚀
fineweb_q01/duckdb:vortex-compact 95858680 9.62363e+07 0.996076 ns
fineweb_q02/duckdb:vortex-compact 104191839 1.11161e+08 0.937303 ns
fineweb_q03/duckdb:vortex-compact 845258754 8.31839e+08 1.01613 ns
fineweb_q04/duckdb:vortex-compact 907819262 8.99803e+08 1.00891 ns
fineweb_q05/duckdb:vortex-compact 807314257 8.02254e+08 1.00631 ns
fineweb_q06/duckdb:vortex-compact 462309056 4.64899e+08 0.994429 ns
fineweb_q07/duckdb:vortex-compact 471702322 4.71856e+08 0.999675 ns
fineweb_q08/duckdb:vortex-compact 24129806 2.26829e+07 1.06379 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Benchmarks: TPC-H SF=1 on NVME

Summary

  • Overall: 0.941x ➖
  • Vortex: 0.946x ➖
  • duckdb:vortex: 0.901x ➖
  • datafusion:vortex: 0.994x ➖
  • Best: tpch_q08/duckdb:vortex-file-compressed (0.775x)
  • Worst: tpch_q17/datafusion:vortex-compact (1.063x)
  • Significant (>10%): 22↑ 0↓
Detailed Results Table
name PR 6f212f6 base fb71117 ratio (PR/base) unit remark
tpch_q01/datafusion:arrow 69600829 7.01805e+07 0.991741 ns
tpch_q02/datafusion:arrow 23646661 2.43766e+07 0.970056 ns
tpch_q03/datafusion:arrow 38020083 3.84682e+07 0.988351 ns
tpch_q04/datafusion:arrow 31016011 3.21259e+07 0.965452 ns
tpch_q05/datafusion:arrow 93602832 9.39183e+07 0.996641 ns
tpch_q06/datafusion:arrow 23662921 2.1334e+07 1.10917 ns 🚨
tpch_q07/datafusion:arrow 183356907 1.75398e+08 1.04538 ns
tpch_q08/datafusion:arrow 46804331 4.74101e+07 0.987223 ns
tpch_q09/datafusion:arrow 79685347 7.78369e+07 1.02375 ns
tpch_q10/datafusion:arrow 58318820 5.84229e+07 0.998219 ns
tpch_q11/datafusion:arrow 12745112 1.22243e+07 1.04261 ns
tpch_q12/datafusion:arrow 61827891 5.97802e+07 1.03425 ns
tpch_q13/datafusion:arrow 51902591 5.15511e+07 1.00682 ns
tpch_q14/datafusion:arrow 25677184 2.63593e+07 0.974121 ns
tpch_q15/datafusion:arrow 50258284 5.34221e+07 0.940777 ns
tpch_q16/datafusion:arrow 25967937 2.65022e+07 0.97984 ns
tpch_q17/datafusion:arrow 79023793 8.19358e+07 0.96446 ns
tpch_q18/datafusion:arrow 162702895 1.67732e+08 0.970017 ns
tpch_q19/datafusion:arrow 41323236 4.22721e+07 0.977554 ns
tpch_q20/datafusion:arrow 41831104 4.052e+07 1.03236 ns
tpch_q21/datafusion:arrow 223689964 2.15922e+08 1.03597 ns
tpch_q22/datafusion:arrow 23640129 2.33763e+07 1.01129 ns
tpch_q01/datafusion:parquet 144140503 1.46468e+08 0.98411 ns
tpch_q02/datafusion:parquet 81377897 8.43972e+07 0.964226 ns
tpch_q03/datafusion:parquet 87792914 8.1647e+07 1.07527 ns
tpch_q04/datafusion:parquet 57618097 5.66475e+07 1.01713 ns
tpch_q05/datafusion:parquet 173165435 1.75425e+08 0.987117 ns
tpch_q06/datafusion:parquet 48666066 4.58269e+07 1.06195 ns
tpch_q07/datafusion:parquet 192579982 1.88455e+08 1.02189 ns
tpch_q08/datafusion:parquet 179052566 1.73449e+08 1.03231 ns
tpch_q09/datafusion:parquet 225713242 2.16414e+08 1.04297 ns
tpch_q10/datafusion:parquet 197165932 1.9751e+08 0.998259 ns
tpch_q11/datafusion:parquet 60305466 6.05706e+07 0.995622 ns
tpch_q12/datafusion:parquet 123135251 1.26938e+08 0.970044 ns
tpch_q13/datafusion:parquet 200991582 2.07542e+08 0.968439 ns
tpch_q14/datafusion:parquet 83950057 8.18213e+07 1.02602 ns
tpch_q15/datafusion:parquet 69355481 7.47213e+07 0.928189 ns
tpch_q16/datafusion:parquet 54674866 5.68163e+07 0.96231 ns
tpch_q17/datafusion:parquet 179514934 1.80572e+08 0.994146 ns
tpch_q18/datafusion:parquet 236818725 2.36535e+08 1.0012 ns
tpch_q19/datafusion:parquet 102843307 8.96654e+07 1.14697 ns 🚨
tpch_q20/datafusion:parquet 128844179 1.25333e+08 1.02801 ns
tpch_q21/datafusion:parquet 185837712 1.89948e+08 0.97836 ns
tpch_q22/datafusion:parquet 41369204 4.08716e+07 1.01218 ns
tpch_q01/datafusion:vortex-file-compressed 54353199 5.53357e+07 0.982244 ns
tpch_q02/datafusion:vortex-file-compressed 57277957 5.66696e+07 1.01074 ns
tpch_q03/datafusion:vortex-file-compressed 30826913 3.03074e+07 1.01714 ns
tpch_q04/datafusion:vortex-file-compressed 20579624 2.05015e+07 1.00381 ns
tpch_q05/datafusion:vortex-file-compressed 85375248 8.51306e+07 1.00287 ns
tpch_q06/datafusion:vortex-file-compressed 11372599 1.09727e+07 1.03645 ns
tpch_q07/datafusion:vortex-file-compressed 95143744 9.68107e+07 0.982781 ns
tpch_q08/datafusion:vortex-file-compressed 68490850 7.30872e+07 0.937112 ns
tpch_q09/datafusion:vortex-file-compressed 89096651 9.00172e+07 0.989773 ns
tpch_q10/datafusion:vortex-file-compressed 82346136 8.55455e+07 0.9626 ns
tpch_q11/datafusion:vortex-file-compressed 21604754 2.12088e+07 1.01867 ns
tpch_q12/datafusion:vortex-file-compressed 36434491 3.85264e+07 0.945701 ns
tpch_q13/datafusion:vortex-file-compressed 32264925 3.25288e+07 0.991889 ns
tpch_q14/datafusion:vortex-file-compressed 30430030 3.07853e+07 0.988459 ns
tpch_q15/datafusion:vortex-file-compressed 26744796 2.79299e+07 0.957569 ns
tpch_q16/datafusion:vortex-file-compressed 36507432 3.66523e+07 0.996047 ns
tpch_q17/datafusion:vortex-file-compressed 77960633 7.7419e+07 1.007 ns
tpch_q18/datafusion:vortex-file-compressed 108394845 1.10074e+08 0.984748 ns
tpch_q19/datafusion:vortex-file-compressed 38811431 3.87234e+07 1.00227 ns
tpch_q20/datafusion:vortex-file-compressed 51840862 5.29449e+07 0.979147 ns
tpch_q21/datafusion:vortex-file-compressed 101287339 1.05929e+08 0.956178 ns
tpch_q22/datafusion:vortex-file-compressed 17197741 1.80482e+07 0.952877 ns
tpch_q01/datafusion:vortex-compact 60847300 6.01897e+07 1.01092 ns
tpch_q02/datafusion:vortex-compact 59725613 5.77078e+07 1.03497 ns
tpch_q03/datafusion:vortex-compact 34138290 3.41666e+07 0.999173 ns
tpch_q04/datafusion:vortex-compact 25760134 2.57755e+07 0.999405 ns
tpch_q05/datafusion:vortex-compact 87953535 8.98984e+07 0.978366 ns
tpch_q06/datafusion:vortex-compact 15730977 1.54362e+07 1.0191 ns
tpch_q07/datafusion:vortex-compact 103211936 1.02663e+08 1.00535 ns
tpch_q08/datafusion:vortex-compact 78887702 7.83942e+07 1.0063 ns
tpch_q09/datafusion:vortex-compact 97069771 1.01411e+08 0.957188 ns
tpch_q10/datafusion:vortex-compact 87487621 8.47515e+07 1.03228 ns
tpch_q11/datafusion:vortex-compact 22238081 2.20802e+07 1.00715 ns
tpch_q12/datafusion:vortex-compact 47893312 4.73414e+07 1.01166 ns
tpch_q13/datafusion:vortex-compact 38770161 3.7979e+07 1.02083 ns
tpch_q14/datafusion:vortex-compact 33713210 3.49593e+07 0.964355 ns
tpch_q15/datafusion:vortex-compact 35745621 3.57518e+07 0.999828 ns
tpch_q16/datafusion:vortex-compact 42811045 4.27335e+07 1.00181 ns
tpch_q17/datafusion:vortex-compact 85108489 8.00903e+07 1.06266 ns
tpch_q18/datafusion:vortex-compact 113861343 1.1642e+08 0.978022 ns
tpch_q19/datafusion:vortex-compact 51232566 5.04356e+07 1.0158 ns
tpch_q20/datafusion:vortex-compact 58406348 5.9932e+07 0.974544 ns
tpch_q21/datafusion:vortex-compact 116799774 1.14739e+08 1.01796 ns
tpch_q22/datafusion:vortex-compact 16764546 1.7573e+07 0.953996 ns
tpch_q01/duckdb:parquet 100634315 9.45585e+07 1.06425 ns
tpch_q02/duckdb:parquet 40283347 4.82588e+07 0.834735 ns 🚀
tpch_q03/duckdb:parquet 73200187 7.66067e+07 0.955533 ns
tpch_q04/duckdb:parquet 49228598 7.2695e+07 0.677194 ns 🚀
tpch_q05/duckdb:parquet 71643177 7.82873e+07 0.915131 ns
tpch_q06/duckdb:parquet 21191445 2.63642e+07 0.803797 ns 🚀
tpch_q07/duckdb:parquet 68744815 1.00041e+08 0.687163 ns 🚀
tpch_q08/duckdb:parquet 101389940 1.21503e+08 0.834467 ns 🚀
tpch_q09/duckdb:parquet 163391079 1.71176e+08 0.954523 ns
tpch_q10/duckdb:parquet 133458413 1.49633e+08 0.891903 ns 🚀
tpch_q11/duckdb:parquet 22847713 2.64705e+07 0.863138 ns 🚀
tpch_q12/duckdb:parquet 56887642 7.42717e+07 0.765939 ns 🚀
tpch_q13/duckdb:parquet 281153744 2.82447e+08 0.99542 ns
tpch_q14/duckdb:parquet 49336995 6.36665e+07 0.774928 ns 🚀
tpch_q15/duckdb:parquet 25095887 2.91032e+07 0.862308 ns 🚀
tpch_q16/duckdb:parquet 56964237 6.04793e+07 0.94188 ns
tpch_q17/duckdb:parquet 59875066 6.77998e+07 0.883116 ns 🚀
tpch_q18/duckdb:parquet 117325245 1.37193e+08 0.855185 ns 🚀
tpch_q19/duckdb:parquet 91302798 9.52104e+07 0.958958 ns
tpch_q20/duckdb:parquet 64388060 7.1068e+07 0.906006 ns
tpch_q21/duckdb:parquet 188630360 1.84262e+08 1.0237 ns
tpch_q22/duckdb:parquet 53509188 5.66898e+07 0.943894 ns
tpch_q01/duckdb:vortex-file-compressed 33156968 3.54916e+07 0.93422 ns
tpch_q02/duckdb:vortex-file-compressed 29158541 3.26424e+07 0.893273 ns 🚀
tpch_q03/duckdb:vortex-file-compressed 29775296 3.63598e+07 0.818907 ns 🚀
tpch_q04/duckdb:vortex-file-compressed 30060031 3.70463e+07 0.811417 ns 🚀
tpch_q05/duckdb:vortex-file-compressed 32687294 3.81969e+07 0.855757 ns 🚀
tpch_q06/duckdb:vortex-file-compressed 11097882 1.11206e+07 0.997961 ns
tpch_q07/duckdb:vortex-file-compressed 35780551 4.14481e+07 0.863261 ns 🚀
tpch_q08/duckdb:vortex-file-compressed 38244478 4.93344e+07 0.775209 ns 🚀
tpch_q09/duckdb:vortex-file-compressed 83521148 8.25e+07 1.01238 ns
tpch_q10/duckdb:vortex-file-compressed 36488750 3.98135e+07 0.916493 ns
tpch_q11/duckdb:vortex-file-compressed 16028685 1.71481e+07 0.93472 ns
tpch_q12/duckdb:vortex-file-compressed 23420497 2.61197e+07 0.896659 ns 🚀
tpch_q13/duckdb:vortex-file-compressed 36979109 4.14884e+07 0.891312 ns 🚀
tpch_q14/duckdb:vortex-file-compressed 21766440 2.49561e+07 0.872191 ns 🚀
tpch_q15/duckdb:vortex-file-compressed 15846653 1.86943e+07 0.847674 ns 🚀
tpch_q16/duckdb:vortex-file-compressed 29536654 3.41476e+07 0.864971 ns 🚀
tpch_q17/duckdb:vortex-file-compressed 24581455 2.7151e+07 0.90536 ns
tpch_q18/duckdb:vortex-file-compressed 47742219 5.60685e+07 0.851498 ns 🚀
tpch_q19/duckdb:vortex-file-compressed 33341857 3.50168e+07 0.952166 ns
tpch_q20/duckdb:vortex-file-compressed 34841602 3.99368e+07 0.872419 ns 🚀
tpch_q21/duckdb:vortex-file-compressed 105920912 1.07833e+08 0.982268 ns
tpch_q22/duckdb:vortex-file-compressed 19245786 2.09177e+07 0.920071 ns
tpch_q01/duckdb:vortex-compact 40511355 4.2701e+07 0.948722 ns
tpch_q02/duckdb:vortex-compact 39239272 4.38992e+07 0.893849 ns 🚀
tpch_q03/duckdb:vortex-compact 32153347 3.81659e+07 0.842463 ns 🚀
tpch_q04/duckdb:vortex-compact 35881920 4.22277e+07 0.849725 ns 🚀
tpch_q05/duckdb:vortex-compact 38829873 4.49415e+07 0.864009 ns 🚀
tpch_q06/duckdb:vortex-compact 14932264 1.53824e+07 0.970734 ns
tpch_q07/duckdb:vortex-compact 43841253 5.06789e+07 0.865079 ns 🚀
tpch_q08/duckdb:vortex-compact 46952947 5.76124e+07 0.81498 ns 🚀
tpch_q09/duckdb:vortex-compact 95238799 9.53051e+07 0.999305 ns
tpch_q10/duckdb:vortex-compact 41854550 4.6e+07 0.909882 ns
tpch_q11/duckdb:vortex-compact 20129272 2.31924e+07 0.867926 ns 🚀
tpch_q12/duckdb:vortex-compact 38066992 4.01719e+07 0.947603 ns
tpch_q13/duckdb:vortex-compact 47709858 4.94785e+07 0.964254 ns
tpch_q14/duckdb:vortex-compact 30413989 3.15112e+07 0.965179 ns
tpch_q15/duckdb:vortex-compact 20202592 2.23306e+07 0.904705 ns
tpch_q16/duckdb:vortex-compact 37976503 4.1381e+07 0.917728 ns
tpch_q17/duckdb:vortex-compact 29906179 3.25023e+07 0.920126 ns
tpch_q18/duckdb:vortex-compact 51083924 6.13232e+07 0.833028 ns 🚀
tpch_q19/duckdb:vortex-compact 38823553 3.85413e+07 1.00732 ns
tpch_q20/duckdb:vortex-compact 44395959 5.03836e+07 0.881159 ns 🚀
tpch_q21/duckdb:vortex-compact 116258309 1.191e+08 0.976139 ns
tpch_q22/duckdb:vortex-compact 21233684 2.33932e+07 0.907686 ns
tpch_q01/duckdb:duckdb 16461466 1.74901e+07 0.941188 ns
tpch_q02/duckdb:duckdb 12266729 1.57149e+07 0.78058 ns 🚀
tpch_q03/duckdb:duckdb 20210436 2.11863e+07 0.953939 ns
tpch_q04/duckdb:duckdb 19606912 2.12952e+07 0.920721 ns
tpch_q05/duckdb:duckdb 20504199 2.29355e+07 0.893995 ns 🚀
tpch_q06/duckdb:duckdb 5775109 7.10708e+06 0.812586 ns 🚀
tpch_q07/duckdb:duckdb 23941194 2.70515e+07 0.885023 ns 🚀
tpch_q08/duckdb:duckdb 21219646 2.66118e+07 0.797377 ns 🚀
tpch_q09/duckdb:duckdb 54945967 5.82953e+07 0.942545 ns
tpch_q10/duckdb:duckdb 46935315 5.93613e+07 0.790672 ns 🚀
tpch_q11/duckdb:duckdb 5835071 8.16039e+06 0.715048 ns 🚀
tpch_q12/duckdb:duckdb 14521059 1.74752e+07 0.830953 ns 🚀
tpch_q13/duckdb:duckdb 38843136 4.0194e+07 0.966391 ns
tpch_q14/duckdb:duckdb 18705904 2.23407e+07 0.8373 ns 🚀
tpch_q15/duckdb:duckdb 12345790 1.41951e+07 0.869725 ns 🚀
tpch_q16/duckdb:duckdb 25818530 2.52193e+07 1.02376 ns
tpch_q17/duckdb:duckdb 13833930 1.83744e+07 0.752892 ns 🚀
tpch_q18/duckdb:duckdb 38169583 4.05289e+07 0.941787 ns
tpch_q19/duckdb:duckdb 26953138 3.22323e+07 0.836216 ns 🚀
tpch_q20/duckdb:duckdb 24165644 2.74532e+07 0.88025 ns 🚀
tpch_q21/duckdb:duckdb 57129712 6.41458e+07 0.890623 ns 🚀
tpch_q22/duckdb:duckdb 25829302 2.73445e+07 0.944588 ns

@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Feb 20, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Feb 20, 2026
@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Feb 20, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Feb 20, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Feb 20, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6f212f6 1 Explore Profiling Data
Previous Runs (14)
Status Commit Job Attempt Link
🟢 Done 36c3ed6 1 Explore Profiling Data
🟢 Done 073d0a4 1 Explore Profiling Data
🟢 Done 8fdc20c 1 Explore Profiling Data
🟢 Done 016c24d 1 Explore Profiling Data
🟢 Done cb54d93 1 Explore Profiling Data
🟢 Done 98fdb3c 1 Explore Profiling Data
🟢 Done 4f7926b 1 Explore Profiling Data
🟢 Done 8fffc1b 1 Explore Profiling Data
🟢 Done d329f52 1 Explore Profiling Data
🟢 Done 9fadb94 1 Explore Profiling Data
🟢 Done 1394e34 1 Explore Profiling Data
🟢 Done 11ada49 1 Explore Profiling Data
🟢 Done 2cb49f8 1 Explore Profiling Data
🟢 Done 127911a 1 Explore Profiling Data

Powered by Polar Signals Cloud

@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Feb 20, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Feb 20, 2026
@myrrc myrrc force-pushed the myrrc/duckdbfs-perf-regression branch 4 times, most recently from 1bbec73 to 11ada49 Compare February 23, 2026 11:24
@myrrc myrrc added the action/benchmark Trigger full benchmarks to run on this PR label Feb 23, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Feb 23, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Feb 23, 2026 •
edited
Loading

Benchmarks: Random Access

Summary

  • Overall: 0.952x ➖
  • Vortex: 0.878x ✅
  • Best: random-access/taxi/correlated/vortex-tokio-local-disk (0.619x)
  • Worst: random-access/nested-lists/correlated/vortex-tokio-local-disk (1.151x)
  • Significant (>10%): 8↑ 3↓
Detailed Results Table
name PR 8fdc20c base 1786200 ratio (PR/base) unit remark
random-access/parquet-tokio-local-disk 189282887 1.90327e+08 0.994515 ns
random-access/parquet-tokio-local-disk-footer 209013056 1.91591e+08 1.09093 ns
random-access/taxi/correlated/parquet-tokio-local-disk 307851618 2.85358e+08 1.07883 ns
random-access/taxi/correlated/parquet-tokio-local-disk-footer 300965135 2.84049e+08 1.05955 ns
random-access/taxi/uniform/parquet-tokio-local-disk 295137495 3.00775e+08 0.981258 ns
random-access/taxi/uniform/parquet-tokio-local-disk-footer 302601349 3.02909e+08 0.998983 ns
random-access/vortex-tokio-local-disk 1233265 1.70227e+06 0.724483 ns 🚀
random-access/vortex-tokio-local-disk-footer 1247623 1.86692e+06 0.668279 ns 🚀
random-access/taxi/correlated/vortex-tokio-local-disk 1620146 2.61937e+06 0.618524 ns 🚀
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1739842 2.63128e+06 0.661214 ns 🚀
random-access/taxi/uniform/vortex-tokio-local-disk 4487736 5.49022e+06 0.817405 ns 🚀
random-access/taxi/uniform/vortex-tokio-local-disk-footer 5057075 5.51326e+06 0.917256 ns
random-access/lance-tokio-local-disk 831735 771243 1.07843 ns
random-access/lance-tokio-local-disk-footer 1377201 1.44088e+06 0.955803 ns
random-access/taxi/correlated/lance-tokio-local-disk 979663 1.01011e+06 0.969857 ns
random-access/taxi/correlated/lance-tokio-local-disk-footer 1716524 1.75269e+06 0.979363 ns
random-access/taxi/uniform/lance-tokio-local-disk 8703071 8.87234e+06 0.980921 ns
random-access/taxi/uniform/lance-tokio-local-disk-footer 9383572 9.59365e+06 0.978102 ns
random-access/feature-vectors/correlated/parquet-tokio-local-disk 14186371638 1.40382e+10 1.01055 ns
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 14201925159 1.34994e+10 1.05204 ns
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13603967268 1.35446e+10 1.00438 ns
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13515520559 1.34603e+10 1.0041 ns
random-access/feature-vectors/correlated/vortex-tokio-local-disk 6613950 8.00205e+06 0.826532 ns 🚀
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 5618454 6.46448e+06 0.869128 ns 🚀
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12053660 1.3482e+07 0.894057 ns 🚀
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12254526 1.3535e+07 0.905394 ns
random-access/feature-vectors/correlated/lance-tokio-local-disk 2410162 2.93635e+06 0.820803 ns 🚀
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1301905 1.42486e+06 0.913708 ns
random-access/feature-vectors/uniform/lance-tokio-local-disk 1455556 1.62888e+06 0.893592 ns 🚀
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2374528 2.59951e+06 0.913451 ns
random-access/nested-lists/correlated/parquet-tokio-local-disk 167372792 1.64534e+08 1.01725 ns
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 167185370 1.6497e+08 1.01343 ns
random-access/nested-lists/uniform/parquet-tokio-local-disk 166938535 1.64963e+08 1.01198 ns
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 178070152 1.64393e+08 1.0832 ns
random-access/nested-lists/correlated/vortex-tokio-local-disk 826590 718029 1.15119 ns 🚨
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 821259 739281 1.11089 ns 🚨
random-access/nested-lists/uniform/vortex-tokio-local-disk 2777636 2.46876e+06 1.12512 ns 🚨
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2501610 2.63421e+06 0.949661 ns
random-access/nested-lists/correlated/lance-tokio-local-disk 274695 278557 0.986136 ns
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 750604 793702 0.9457 ns
random-access/nested-lists/uniform/lance-tokio-local-disk 1188506 1.24854e+06 0.951917 ns
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1693984 1.78778e+06 0.947532 ns
random-access/nested-structs/correlated/parquet-tokio-local-disk 27320593 2.80484e+07 0.97405 ns
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 27287726 2.77519e+07 0.983275 ns
random-access/nested-structs/uniform/parquet-tokio-local-disk 32459040 2.77574e+07 1.16938 ns 🚨
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 32241366 2.86236e+07 1.12639 ns 🚨
random-access/nested-structs/correlated/vortex-tokio-local-disk 896915 929028 0.965434 ns
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 879593 931775 0.943997 ns
random-access/nested-structs/uniform/vortex-tokio-local-disk 1747722 1.82604e+06 0.957112 ns
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1717125 1.82901e+06 0.938827 ns
random-access/nested-structs/correlated/lance-tokio-local-disk 435199 455606 0.955209 ns
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 646078 687041 0.940378 ns
random-access/nested-structs/uniform/lance-tokio-local-disk 2825275 3.03188e+06 0.931857 ns
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3097579 3.25892e+06 0.950491 ns

@github-actions
Copy link
Contributor

github-actions bot commented Feb 23, 2026 •
edited
Loading

Benchmarks: Compression

Summary

  • Overall: 0.990x ➖
  • Vortex: 0.997x ➖
  • Best: vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 (0.888x)
  • Worst: vortex:parquet-zstd ratio decompress time/CMSprovider (1.074x)
  • Significant (>10%): 1↑ 0↓
Detailed Results Table
name PR 8fdc20c base 1786200 ratio (PR/base) unit remark
parquet_rs-zstd compress time/taxi 1.39418e+09 1.40539e+09 0.992019 ns
parquet_rs-zstd decompress time/taxi 2.94096e+08 2.94623e+08 0.998211 ns
compress time/taxi 6.90702e+08 7.24054e+08 0.953936 ns
decompress time/taxi 2.03844e+07 2.01721e+07 1.01052 ns
parquet_rs-zstd compress time/Arade 2.52258e+09 2.5398e+09 0.993219 ns
parquet_rs-zstd decompress time/Arade 6.67306e+08 6.62433e+08 1.00736 ns
compress time/Arade 1.06913e+09 1.11035e+09 0.962872 ns
decompress time/Arade 3.12422e+07 3.19974e+07 0.976399 ns
parquet_rs-zstd compress time/Bimbo 1.60021e+10 1.61184e+10 0.99278 ns
parquet_rs-zstd decompress time/Bimbo 2.26499e+09 2.27419e+09 0.995953 ns
compress time/Bimbo 6.68613e+09 6.80197e+09 0.982971 ns
decompress time/Bimbo 9.88122e+07 9.65991e+07 1.02291 ns
parquet_rs-zstd compress time/CMSprovider 7.90444e+09 7.92137e+09 0.997862 ns
parquet_rs-zstd decompress time/CMSprovider 2.11053e+09 2.10267e+09 1.00374 ns
compress time/CMSprovider 2.85828e+09 2.85551e+09 1.00097 ns
decompress time/CMSprovider 8.4985e+07 7.88134e+07 1.07831 ns
parquet_rs-zstd compress time/Euro2016 1.45153e+09 1.46664e+09 0.989693 ns
parquet_rs-zstd decompress time/Euro2016 4.20151e+08 4.21e+08 0.997983 ns
compress time/Euro2016 4.21748e+08 4.36555e+08 0.966082 ns
decompress time/Euro2016 2.19567e+07 2.29117e+07 0.958319 ns
parquet_rs-zstd compress time/Food 9.31645e+08 9.37484e+08 0.993772 ns
parquet_rs-zstd decompress time/Food 2.39283e+08 2.39441e+08 0.999339 ns
compress time/Food 3.62702e+08 3.95648e+08 0.916729 ns
decompress time/Food 8.5493e+06 9.09318e+06 0.940188 ns
parquet_rs-zstd compress time/HashTags 2.52738e+09 2.57831e+09 0.980249 ns
parquet_rs-zstd decompress time/HashTags 6.73317e+08 6.94187e+08 0.969935 ns
compress time/HashTags 9.14308e+08 9.29045e+08 0.984138 ns
decompress time/HashTags 8.62069e+07 8.79568e+07 0.980105 ns
parquet_rs-zstd compress time/TPC-H l_comment chunked 3.16851e+09 3.22619e+09 0.98212 ns
parquet_rs-zstd decompress time/TPC-H l_comment chunked 7.16939e+08 7.14738e+08 1.00308 ns
compress time/TPC-H l_comment chunked 1.26967e+09 1.29414e+09 0.981092 ns
decompress time/TPC-H l_comment chunked 4.43089e+07 4.38312e+07 1.0109 ns
parquet_rs-zstd compress time/TPC-H l_comment canonical 3.18125e+09 3.18945e+09 0.997429 ns
parquet_rs-zstd decompress time/TPC-H l_comment canonical 7.08188e+08 7.22238e+08 0.980547 ns
compress time/TPC-H l_comment canonical 1.25569e+09 1.27778e+09 0.982713 ns
decompress time/TPC-H l_comment canonical 4.48153e+07 4.39263e+07 1.02024 ns
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6.53494e+06 6.77905e+06 0.96399 ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2.57168e+06 2.59123e+06 0.992453 ns
compress time/wide table cols=100 chunks=1 rows=1000 1.4587e+07 1.52158e+07 0.958675 ns
decompress time/wide table cols=100 chunks=1 rows=1000 2.7608e+06 3.13201e+06 0.88148 ns 🚀
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 8.534e+07 8.87825e+07 0.961226 ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 2.92195e+07 3.04043e+07 0.961033 ns
compress time/wide table cols=1000 chunks=1 rows=1000 1.48924e+08 1.50381e+08 0.990316 ns
decompress time/wide table cols=1000 chunks=1 rows=1000 2.60653e+07 2.54906e+07 1.02255 ns
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 8.87331e+08 9.14692e+08 0.970087 ns
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 3.37384e+08 3.42967e+08 0.983723 ns
compress time/wide table cols=10000 chunks=1 rows=1000 1.43428e+09 1.47163e+09 0.974621 ns
decompress time/wide table cols=10000 chunks=1 rows=1000 2.57739e+08 2.62607e+08 0.981463 ns
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6.65283e+06 6.48356e+06 1.02611 ns
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2.56952e+06 2.55898e+06 1.00412 ns
compress time/wide table cols=100 chunks=50 rows=1000 1.46563e+07 1.56262e+07 0.937931 ns
decompress time/wide table cols=100 chunks=50 rows=1000 2.74007e+06 2.9162e+06 0.939604 ns
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 8.36601e+07 8.97372e+07 0.932279 ns
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 2.88259e+07 3.04871e+07 0.945512 ns
compress time/wide table cols=1000 chunks=50 rows=1000 1.47807e+08 1.50474e+08 0.982274 ns
decompress time/wide table cols=1000 chunks=50 rows=1000 2.5842e+07 2.5505e+07 1.01321 ns
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 8.75979e+08 9.12677e+08 0.959791 ns
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 3.38313e+08 3.41294e+08 0.991265 ns
compress time/wide table cols=10000 chunks=50 rows=1000 1.444e+09 1.47368e+09 0.979858 ns
decompress time/wide table cols=10000 chunks=50 rows=1000 2.59731e+08 2.62605e+08 0.989058 ns
parquet size/taxi 5.58792e+07 5.58792e+07 1 bytes
vortex-file-compressed size/taxi 5.14542e+07 5.14542e+07 1 bytes
vortex:parquet-zstd size/taxi 0.920811 0.920811 1 ratio
vortex:parquet-zstd ratio compress time/taxi 0.495419 0.515197 0.961611 ratio
vortex:parquet-zstd ratio decompress time/taxi 0.0693119 0.0684674 1.01233 ratio
parquet size/Arade 3.05282e+08 3.05282e+08 1 bytes
vortex-file-compressed size/Arade 1.43322e+08 1.43322e+08 1 bytes
vortex:parquet-zstd size/Arade 0.469473 0.469473 1 ratio
vortex:parquet-zstd ratio compress time/Arade 0.423823 0.437181 0.969446 ratio
vortex:parquet-zstd ratio decompress time/Arade 0.0468184 0.0483029 0.969268 ratio
parquet size/Bimbo 3.88935e+08 3.88935e+08 1 bytes
vortex-file-compressed size/Bimbo 5.26092e+08 5.26092e+08 1 bytes
vortex:parquet-zstd size/Bimbo 1.35265 1.35265 1 ratio
vortex:parquet-zstd ratio compress time/Bimbo 0.417829 0.421999 0.990119 ratio
vortex:parquet-zstd ratio decompress time/Bimbo 0.043626 0.0424763 1.02707 ratio
parquet size/CMSprovider 3.84635e+08 3.84635e+08 1 bytes
vortex-file-compressed size/CMSprovider 4.48348e+08 4.48348e+08 1 bytes
vortex:parquet-zstd size/CMSprovider 1.16565 1.16565 1 ratio
vortex:parquet-zstd ratio compress time/CMSprovider 0.361604 0.360482 1.00311 ratio
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0402672 0.0374826 1.07429 ratio
parquet size/Euro2016 1.23043e+08 1.23043e+08 1 bytes
vortex-file-compressed size/Euro2016 1.67857e+08 1.67857e+08 1 bytes
vortex:parquet-zstd size/Euro2016 1.36422 1.36422 1 ratio
vortex:parquet-zstd ratio compress time/Euro2016 0.290555 0.297656 0.976143 ratio
vortex:parquet-zstd ratio decompress time/Euro2016 0.052259 0.054422 0.960256 ratio
parquet size/Food 3.61776e+07 3.61776e+07 1 bytes
vortex-file-compressed size/Food 4.41635e+07 4.41635e+07 1 bytes
vortex:parquet-zstd size/Food 1.22074 1.22074 1 ratio
vortex:parquet-zstd ratio compress time/Food 0.389314 0.422032 0.922475 ratio
vortex:parquet-zstd ratio decompress time/Food 0.0357288 0.0379767 0.94081 ratio
parquet size/HashTags 1.33855e+08 1.33855e+08 1 bytes
vortex-file-compressed size/HashTags 1.98707e+08 1.98707e+08 1 bytes
vortex:parquet-zstd size/HashTags 1.48449 1.48449 1 ratio
vortex:parquet-zstd ratio compress time/HashTags 0.361761 0.360331 1.00397 ratio
vortex:parquet-zstd ratio decompress time/HashTags 0.128033 0.126705 1.01049 ratio
parquet size/TPC-H l_comment chunked 1.58411e+08 1.58411e+08 1 bytes
vortex-file-compressed size/TPC-H l_comment chunked 1.80419e+08 1.80419e+08 1 bytes
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13893 1.13893 1 ratio
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.400714 0.401134 0.998953 ratio
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0618029 0.0613248 1.0078 ratio
parquet size/TPC-H l_comment canonical 1.58411e+08 1.58411e+08 1 bytes
vortex-file-compressed size/TPC-H l_comment canonical 1.80419e+08 1.80419e+08 1 bytes
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13893 1.13893 1 ratio
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.394716 0.400627 0.985246 ratio
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0632817 0.0608196 1.04048 ratio
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1 bytes
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1 bytes
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0.948702 0.948702 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2.23216 2.24454 0.994487 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1.07354 1.20869 0.888183 ratio 🚀
parquet size/wide table cols=1000 chunks=1 rows=1000 9.322e+06 9.322e+06 1 bytes
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8.82958e+06 8.82958e+06 1 bytes
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.947177 0.947177 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.74507 1.69381 1.03026 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.892052 0.838387 1.06401 ratio
parquet size/wide table cols=10000 chunks=1 rows=1000 9.322e+07 9.322e+07 1 bytes
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 8.83176e+07 8.83176e+07 1 bytes
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.94741 0.94741 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.6164 1.60888 1.00467 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.763934 0.765694 0.997702 ratio
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1 bytes
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1 bytes
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0.948702 0.948702 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2.20302 2.41013 0.914066 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1.06638 1.13959 0.935751 ratio
parquet size/wide table cols=1000 chunks=50 rows=1000 9.322e+06 9.322e+06 1 bytes
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8.82958e+06 8.82958e+06 1 bytes
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.947177 0.947177 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.76675 1.67683 1.05363 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.896485 0.836584 1.0716 ratio
parquet size/wide table cols=10000 chunks=50 rows=1000 9.322e+07 9.322e+07 1 bytes
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 8.83176e+07 8.83176e+07 1 bytes
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.94741 0.94741 1 ratio
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.64844 1.61468 1.02091 ratio
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.767725 0.769438 0.997773 ratio

@myrrc
Copy link
Contributor Author

myrrc commented Feb 23, 2026 •
edited
Loading

Testing this change is tricky as 1.5 is not released, thus there are no artifacts. I'll open a patch to spin up our own building jobs and cache artifacts in own S3, so we could test pre-releases.

@myrrc myrrc force-pushed the myrrc/duckdbfs-perf-regression branch 2 times, most recently from fec3743 to 8fdc20c Compare February 27, 2026 17:04
@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Feb 27, 2026
@github-actions github-actions bot removed action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Feb 27, 2026
@myrrc myrrc added action/benchmark Trigger full benchmarks to run on this PR action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Feb 27, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Feb 27, 2026
@myrrc myrrc force-pushed the myrrc/duckdbfs-perf-regression branch from 8fdc20c to 073d0a4 Compare February 27, 2026 17:37
@myrrc myrrc added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Feb 27, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Feb 27, 2026
@myrrc myrrc force-pushed the myrrc/duckdbfs-perf-regression branch from 073d0a4 to 36c3ed6 Compare March 2, 2026 09:52
@myrrc myrrc added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 2, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 2, 2026
@myrrc
Copy link
Contributor Author

myrrc commented Mar 2, 2026

#6706 (comment)

@myrrc myrrc force-pushed the myrrc/duckdbfs-perf-regression branch from 36c3ed6 to 6f212f6 Compare March 2, 2026 10:57
@myrrc myrrc changed the title Trying out duckdb-1.5 with duckdbfs Trying out duckdb-1.5 Mar 2, 2026
@myrrc myrrc added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 2, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 2, 2026
@myrrc myrrc added changelog/feature A new feature ext/duckdb Relates to the DuckDB integration action/benchmark-sql Trigger SQL benchmarks to run on this PR labels Mar 2, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 2, 2026
@myrrc myrrc force-pushed the myrrc/duckdbfs-perf-regression branch 2 times, most recently from 3087190 to f294e73 Compare March 2, 2026 13:27
myrrc added 2 commits March 2, 2026 13:35
@myrrc
6627
dd2d8a6
@myrrc
build duckdb with static httpfs in release from source + CI
326d2bc 
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc force-pushed the myrrc/duckdbfs-perf-regression branch from f294e73 to 326d2bc Compare March 2, 2026 13:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

action/benchmark Trigger full benchmarks to run on this PR changelog/feature A new feature do not merge Pull requests that are not intended to merge ext/duckdb Relates to the DuckDB integration

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@myrrc