Skip to content

Interned Identifiers#7068

Draft
gatesn wants to merge 8 commits intodevelopfrom
ngates/id
Draft

Interned Identifiers#7068
gatesn wants to merge 8 commits intodevelopfrom
ngates/id

Conversation

@gatesn
Copy link
Contributor

@gatesn gatesn commented Mar 19, 2026

Fixes #6823

gatesn added 4 commits March 19, 2026 06:03
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added the changelog/feature A new feature label Mar 19, 2026
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Comment on lines +276 to +282
pub const ID: &'static str = "vortex.alp";

/// Returns the cached [`ArrayId`] for this encoding.
pub fn array_id() -> ArrayId {
static CACHED: std::sync::OnceLock<ArrayId> = std::sync::OnceLock::new();
*CACHED.get_or_init(|| ArrayId::new(Self::ID))
}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this not have an atomic? On read

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We could force vtables to hold onto an instance of their ID by having VTable::id(&Array) -> &ArrayId?

But it means no more ZSTs for vtables

gatesn added 2 commits March 19, 2026 10:00
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.7%
Vortex (geomean): 0.969x ➖
Parquet (geomean): 1.006x ➖
Shifts: Parquet (control) +0.6% · Median polish -2.5%


datafusion / vortex-file-compressed (0.933x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 32704202 32224590 1.01
fineweb_q01/datafusion:vortex-file-compressed 544905026 653646086 0.83
fineweb_q02/datafusion:vortex-file-compressed 494505791 574772510 0.86
fineweb_q03/datafusion:vortex-file-compressed 1400880130 1392832887 1.01
fineweb_q04/datafusion:vortex-file-compressed 1362024469 1366135332 1.00
fineweb_q05/datafusion:vortex-file-compressed 1336015877 1345076071 0.99
fineweb_q06/datafusion:vortex-file-compressed 1515424010 1559484187 0.97
fineweb_q07/datafusion:vortex-file-compressed 1367982311 1395906520 0.98
fineweb_q08/datafusion:vortex-file-compressed 528053853 677756771 0.78
datafusion / vortex-compact (1.024x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 35861388 28381746 1.26
fineweb_q01/datafusion:vortex-compact 595337663 587791567 1.01
fineweb_q02/datafusion:vortex-compact 647236067 625200431 1.04
fineweb_q03/datafusion:vortex-compact 1872974357 1851170949 1.01
fineweb_q04/datafusion:vortex-compact 2160465509 2198018410 0.98
fineweb_q05/datafusion:vortex-compact 1701285595 1689781431 1.01
fineweb_q06/datafusion:vortex-compact 1492574932 1496242175 1.00
fineweb_q07/datafusion:vortex-compact 1443295603 1371127575 1.05
fineweb_q08/datafusion:vortex-compact 373305578 420719723 0.89
datafusion / parquet (1.055x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1242433682 1127164009 1.10
fineweb_q01/datafusion:parquet 1750365839 1878874777 0.93
fineweb_q02/datafusion:parquet 1885651409 2045230796 0.92
fineweb_q03/datafusion:parquet 2151674233 1860951083 1.16
fineweb_q04/datafusion:parquet 2086246574 1899370460 1.10
fineweb_q05/datafusion:parquet 2008132454 1750746811 1.15
fineweb_q06/datafusion:parquet 1788064228 1744429660 1.03
fineweb_q07/datafusion:parquet 1957199320 1917853422 1.02
fineweb_q08/datafusion:parquet 2023928068 1802693581 1.12
duckdb / vortex-file-compressed (0.968x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 95077044 111404297 0.85
fineweb_q01/duckdb:vortex-file-compressed 534304646 572403614 0.93
fineweb_q02/duckdb:vortex-file-compressed 514300978 447694662 1.15
fineweb_q03/duckdb:vortex-file-compressed 1410344926 1466793095 0.96
fineweb_q04/duckdb:vortex-file-compressed 1520993311 1568259693 0.97
fineweb_q05/duckdb:vortex-file-compressed 1469999216 1508680569 0.97
fineweb_q06/duckdb:vortex-file-compressed 1664627596 1659643074 1.00
fineweb_q07/duckdb:vortex-file-compressed 1424268446 1436972680 0.99
fineweb_q08/duckdb:vortex-file-compressed 602299097 667864925 0.90
duckdb / vortex-compact (0.952x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 101384179 112960058 0.90
fineweb_q01/duckdb:vortex-compact 560398151 515251723 1.09
fineweb_q02/duckdb:vortex-compact 579720945 664838034 0.87
fineweb_q03/duckdb:vortex-compact 1650558464 1636341139 1.01
fineweb_q04/duckdb:vortex-compact 1686097967 1674254173 1.01
fineweb_q05/duckdb:vortex-compact 1517765733 1645755930 0.92
fineweb_q06/duckdb:vortex-compact 1477751352 1560856531 0.95
fineweb_q07/duckdb:vortex-compact 1318955341 1264593017 1.04
fineweb_q08/duckdb:vortex-compact 493167233 602722513 0.82
duckdb / parquet (0.959x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1031149488 1107083646 0.93
fineweb_q01/duckdb:parquet 1614790022 1732979929 0.93
fineweb_q02/duckdb:parquet 1637440206 1622258595 1.01
fineweb_q03/duckdb:parquet 4249900337 4330337530 0.98
fineweb_q04/duckdb:parquet 1979499369 1917007218 1.03
fineweb_q05/duckdb:parquet 2666485835 3011627425 0.89
fineweb_q06/duckdb:parquet 3405528891 3601165547 0.95
fineweb_q07/duckdb:parquet 3959476575 4281881381 0.92
fineweb_q08/duckdb:parquet 1080822125 1084967749 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +26.4% +1.3% +24.7% +154.3% ➖ noise
0 datafusion:vortex-file-compressed +1.5% +1.3% +0.2% +204.4% ➖ noise
0 duckdb:vortex-compact -10.2% +1.3% -11.4% +37.7% ➖ noise
0 duckdb:vortex-file-compressed -14.7% +1.3% -15.8% +48.7% ➖ noise
1 datafusion:vortex-compact +1.3% -6.8% +8.7% +47.3% ➖ noise
1 datafusion:vortex-file-compressed -16.6% -6.8% -10.5% +127.3% ➖ noise
1 duckdb:vortex-compact +8.8% -6.8% +16.7% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -6.7% -6.8% +0.2% +31.9% ➖ noise
2 datafusion:vortex-compact +3.5% -3.5% +7.3% +30.0% ➖ noise
2 datafusion:vortex-file-compressed -14.0% -3.5% -10.8% +34.3% ➖ noise
2 duckdb:vortex-compact -12.8% -3.5% -9.6% +41.1% ➖ noise
2 duckdb:vortex-file-compressed +14.9% -3.5% +19.1% +39.3% ➖ noise
3 datafusion:vortex-compact +1.2% +6.5% -5.0% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +0.6% +6.5% -5.6% +30.0% ➖ noise
3 duckdb:vortex-compact +0.9% +6.5% -5.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -3.8% +6.5% -9.7% +30.0% ➖ noise
4 datafusion:vortex-compact -1.7% +6.5% -7.7% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -0.3% +6.5% -6.4% +30.0% ➖ noise
4 duckdb:vortex-compact +0.7% +6.5% -5.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -3.0% +6.5% -8.9% +30.0% ➖ noise
5 datafusion:vortex-compact +0.7% +0.8% -0.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -0.7% +0.8% -1.4% +30.0% ➖ noise
5 duckdb:vortex-compact -7.8% +0.8% -8.5% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -2.6% +0.8% -3.3% +30.0% ➖ noise
6 datafusion:vortex-compact -0.2% -1.5% +1.3% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -2.8% -1.5% -1.3% +30.0% ➖ noise
6 duckdb:vortex-compact -5.3% -1.5% -3.8% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +0.3% -1.5% +1.9% +30.0% ➖ noise
7 datafusion:vortex-compact +5.3% -2.9% +8.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -2.0% -2.9% +0.9% +30.0% ➖ noise
7 duckdb:vortex-compact +4.3% -2.9% +7.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -0.9% -2.9% +2.0% +34.6% ➖ noise
8 datafusion:vortex-compact -11.3% +5.8% -16.1% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -22.1% +5.8% -26.3% +30.0% ✅ faster
8 duckdb:vortex-compact -18.2% +5.8% -22.6% +31.6% ➖ noise
8 duckdb:vortex-file-compressed -9.8% +5.8% -14.7% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Vortex (geomean): 1.058x ➖
Parquet (geomean): 1.069x ➖
Shifts: Parquet (control) +6.9% · Median polish +5.4%


duckdb / vortex-file-compressed (1.064x ➖, 0↑ 2↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11749773 10964905 1.07
statpopgen_q01/duckdb:vortex-file-compressed 20581337 19236963 1.07
statpopgen_q02/duckdb:vortex-file-compressed 1345802338 1293784935 1.04
statpopgen_q03/duckdb:vortex-file-compressed 3217614583 3062541921 1.05
statpopgen_q04/duckdb:vortex-file-compressed 3263774831 3074789529 1.06
statpopgen_q05/duckdb:vortex-file-compressed 1417701387 1376512608 1.03
statpopgen_q06/duckdb:vortex-file-compressed 2137030676 2038252012 1.05
statpopgen_q07/duckdb:vortex-file-compressed 🚨 209136769 185877547 1.13
statpopgen_q08/duckdb:vortex-file-compressed 🚨 220984353 199742751 1.11
statpopgen_q09/duckdb:vortex-file-compressed 2952709440 2795910471 1.06
statpopgen_q10/duckdb:vortex-file-compressed 4839208549 4600987749 1.05
duckdb / vortex-compact (1.051x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11679692 10870735 1.07
statpopgen_q01/duckdb:vortex-compact 172514113 166071527 1.04
statpopgen_q02/duckdb:vortex-compact 1910900794 1800028753 1.06
statpopgen_q03/duckdb:vortex-compact 3729231797 3498782545 1.07
statpopgen_q04/duckdb:vortex-compact 3780818950 3544154414 1.07
statpopgen_q05/duckdb:vortex-compact 1903101895 1816399267 1.05
statpopgen_q06/duckdb:vortex-compact 2820007537 2682212781 1.05
statpopgen_q07/duckdb:vortex-compact 973301327 947419529 1.03
statpopgen_q08/duckdb:vortex-compact 1003891166 978725606 1.03
statpopgen_q09/duckdb:vortex-compact 3540713806 3325628077 1.06
statpopgen_q10/duckdb:vortex-compact 5602295512 5408038225 1.04
duckdb / parquet (1.069x ➖, 0↑ 2↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 330684295 311333009 1.06
statpopgen_q01/duckdb:parquet 419714410 390839297 1.07
statpopgen_q02/duckdb:parquet 1062655193 1013099170 1.05
statpopgen_q03/duckdb:parquet 🚨 1627261352 1477958703 1.10
statpopgen_q04/duckdb:parquet 1614605001 1517614620 1.06
statpopgen_q05/duckdb:parquet 1076363163 1005257104 1.07
statpopgen_q06/duckdb:parquet 1594658145 1480818416 1.08
statpopgen_q07/duckdb:parquet 1963580997 1890950437 1.04
statpopgen_q08/duckdb:parquet 1958906770 1881110674 1.04
statpopgen_q09/duckdb:parquet 🚨 1495911677 1354186396 1.10
statpopgen_q10/duckdb:parquet 2868618668 2659886421 1.08
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +7.4% +6.2% +1.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +7.2% +6.2% +0.9% +10.6% ➖ noise
1 duckdb:vortex-compact +3.9% +7.4% -3.3% +29.1% ➖ noise
1 duckdb:vortex-file-compressed +7.0% +7.4% -0.4% +212.6% ➖ noise
2 duckdb:vortex-compact +6.2% +4.9% +1.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +4.0% +4.9% -0.8% +10.0% ➖ noise
3 duckdb:vortex-compact +6.6% +10.1% -3.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.1% +10.1% -4.6% +10.0% ➖ noise
4 duckdb:vortex-compact +6.7% +6.4% +0.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +6.1% +6.4% -0.2% +10.0% ➖ noise
5 duckdb:vortex-compact +4.8% +7.1% -2.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.0% +7.1% -3.8% +10.0% ➖ noise
6 duckdb:vortex-compact +5.1% +7.7% -2.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.8% +7.7% -2.6% +10.0% ➖ noise
7 duckdb:vortex-compact +2.7% +3.8% -1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +12.5% +3.8% +8.4% +10.0% ➖ noise
8 duckdb:vortex-compact +2.6% +4.1% -1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +10.6% +4.1% +6.2% +10.0% ➖ noise
9 duckdb:vortex-compact +6.5% +10.5% -3.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +5.6% +10.5% -4.4% +10.0% ➖ noise
10 duckdb:vortex-compact +3.6% +7.8% -3.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +5.2% +7.8% -2.5% +10.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +15.5%
Vortex (geomean): 1.211x ❌
Parquet (geomean): 0.977x ➖
Shifts: Parquet (control) -2.3% · Median polish -2.2%


datafusion / vortex-file-compressed (1.173x ❌, 9↑ 20↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚀 1637987 1970796 0.83
clickbench_q01/datafusion:vortex-file-compressed 🚨 17371805 14460168 1.20
clickbench_q02/datafusion:vortex-file-compressed 34710233 32491733 1.07
clickbench_q03/datafusion:vortex-file-compressed 36345012 37068160 0.98
clickbench_q04/datafusion:vortex-file-compressed 316116778 316931314 1.00
clickbench_q05/datafusion:vortex-file-compressed 314238700 316991970 0.99
clickbench_q06/datafusion:vortex-file-compressed 1678917 1839543 0.91
clickbench_q07/datafusion:vortex-file-compressed 🚨 24381678 17397106 1.40
clickbench_q08/datafusion:vortex-file-compressed 390525133 387107283 1.01
clickbench_q09/datafusion:vortex-file-compressed 574694160 606059922 0.95
clickbench_q10/datafusion:vortex-file-compressed 86264963 81177631 1.06
clickbench_q11/datafusion:vortex-file-compressed 🚨 100841814 89848328 1.12
clickbench_q12/datafusion:vortex-file-compressed 🚀 276924583 335916477 0.82
clickbench_q13/datafusion:vortex-file-compressed 🚀 429386243 511971745 0.84
clickbench_q14/datafusion:vortex-file-compressed 🚀 265759123 316201585 0.84
clickbench_q15/datafusion:vortex-file-compressed 🚀 373119201 452631973 0.82
clickbench_q16/datafusion:vortex-file-compressed 🚀 727018058 886876016 0.82
clickbench_q17/datafusion:vortex-file-compressed 🚀 717723055 876346227 0.82
clickbench_q18/datafusion:vortex-file-compressed 🚀 1437145558 1732109030 0.83
clickbench_q19/datafusion:vortex-file-compressed 🚨 33068668 27687986 1.19
clickbench_q20/datafusion:vortex-file-compressed 🚀 356185161 401786259 0.89
clickbench_q21/datafusion:vortex-file-compressed 478327139 466586207 1.03
clickbench_q22/datafusion:vortex-file-compressed 🚨 861394697 625374465 1.38
clickbench_q23/datafusion:vortex-file-compressed 🚨 5072903217 726850959 6.98
clickbench_q24/datafusion:vortex-file-compressed 61261851 61148364 1.00
clickbench_q25/datafusion:vortex-file-compressed 76187194 81157129 0.94
clickbench_q26/datafusion:vortex-file-compressed 54227148 53411298 1.02
clickbench_q27/datafusion:vortex-file-compressed 🚨 1050965689 899687678 1.17
clickbench_q28/datafusion:vortex-file-compressed 7206250978 7208076692 1.00
clickbench_q29/datafusion:vortex-file-compressed 254897525 242456119 1.05
clickbench_q30/datafusion:vortex-file-compressed 🚨 353272414 254705220 1.39
clickbench_q31/datafusion:vortex-file-compressed 🚨 407318734 296683401 1.37
clickbench_q32/datafusion:vortex-file-compressed 🚨 1859594974 1336543550 1.39
clickbench_q33/datafusion:vortex-file-compressed 🚨 2246936370 1407721368 1.60
clickbench_q34/datafusion:vortex-file-compressed 🚨 2367959702 1413077774 1.68
clickbench_q35/datafusion:vortex-file-compressed 🚨 818296850 520772966 1.57
clickbench_q36/datafusion:vortex-file-compressed 🚨 139937532 77036143 1.82
clickbench_q37/datafusion:vortex-file-compressed 🚨 53322436 39614167 1.35
clickbench_q38/datafusion:vortex-file-compressed 🚨 38554693 26620229 1.45
clickbench_q39/datafusion:vortex-file-compressed 🚨 252815893 152668095 1.66
clickbench_q40/datafusion:vortex-file-compressed 🚨 33693977 20617939 1.63
clickbench_q41/datafusion:vortex-file-compressed 🚨 27407813 20305379 1.35
clickbench_q42/datafusion:vortex-file-compressed 🚨 30996465 22701604 1.37
datafusion / parquet (0.987x ➖, 10↑ 6↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1780858 1936626 0.92
clickbench_q01/datafusion:parquet 22029643 23116990 0.95
clickbench_q02/datafusion:parquet 51608743 55067685 0.94
clickbench_q03/datafusion:parquet 42486403 47054717 0.90
clickbench_q04/datafusion:parquet 🚀 375752497 420145363 0.89
clickbench_q05/datafusion:parquet 411238833 443963560 0.93
clickbench_q06/datafusion:parquet 1665693 1674092 0.99
clickbench_q07/datafusion:parquet 🚀 27086763 30905051 0.88
clickbench_q08/datafusion:parquet 🚀 450522546 508703007 0.89
clickbench_q09/datafusion:parquet 🚀 713040648 808528256 0.88
clickbench_q10/datafusion:parquet 🚀 125156811 141744770 0.88
clickbench_q11/datafusion:parquet 156691213 173506217 0.90
clickbench_q12/datafusion:parquet 🚀 391128822 440042493 0.89
clickbench_q13/datafusion:parquet 🚀 557875009 623771140 0.89
clickbench_q14/datafusion:parquet 404909399 440702306 0.92
clickbench_q15/datafusion:parquet 🚀 415614452 476031574 0.87
clickbench_q16/datafusion:parquet 805920031 892043503 0.90
clickbench_q17/datafusion:parquet 🚀 779275777 875006606 0.89
clickbench_q18/datafusion:parquet 🚀 1630429645 1839803943 0.89
clickbench_q19/datafusion:parquet 35714929 39201923 0.91
clickbench_q20/datafusion:parquet 643276999 711426568 0.90
clickbench_q21/datafusion:parquet 724375512 788741222 0.92
clickbench_q22/datafusion:parquet 1024178073 1137618312 0.90
clickbench_q23/datafusion:parquet 4078213922 4088996955 1.00
clickbench_q24/datafusion:parquet 100423958 99387258 1.01
clickbench_q25/datafusion:parquet 156600897 154260504 1.02
clickbench_q26/datafusion:parquet 99623399 96169591 1.04
clickbench_q27/datafusion:parquet 1060410226 1063019403 1.00
clickbench_q28/datafusion:parquet 7067183313 6599313413 1.07
clickbench_q29/datafusion:parquet 239224607 244390993 0.98
clickbench_q30/datafusion:parquet 🚨 534253763 385599092 1.39
clickbench_q31/datafusion:parquet 🚨 523472801 403239691 1.30
clickbench_q32/datafusion:parquet 🚨 1705157333 1254787591 1.36
clickbench_q33/datafusion:parquet 🚨 2084109020 1547129952 1.35
clickbench_q34/datafusion:parquet 🚨 1728759259 1545164881 1.12
clickbench_q35/datafusion:parquet 562471277 543801101 1.03
clickbench_q36/datafusion:parquet 🚨 175237061 138939355 1.26
clickbench_q37/datafusion:parquet 60306121 59842470 1.01
clickbench_q38/datafusion:parquet 90484791 92496901 0.98
clickbench_q39/datafusion:parquet 284855358 279254947 1.02
clickbench_q40/datafusion:parquet 34050639 34923643 0.98
clickbench_q41/datafusion:parquet 31002147 31036524 1.00
clickbench_q42/datafusion:parquet 33580597 32004682 1.05
duckdb / vortex-file-compressed (1.249x ❌, 8↑ 15↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 7496630 6724747 1.11
clickbench_q01/duckdb:vortex-file-compressed 🚨 50559713 14753353 3.43
clickbench_q02/duckdb:vortex-file-compressed 🚨 94280700 25950791 3.63
clickbench_q03/duckdb:vortex-file-compressed 🚨 61997710 33634737 1.84
clickbench_q04/duckdb:vortex-file-compressed 206511568 194323788 1.06
clickbench_q05/duckdb:vortex-file-compressed 233683482 232184110 1.01
clickbench_q06/duckdb:vortex-file-compressed 🚨 105286204 21149963 4.98
clickbench_q07/duckdb:vortex-file-compressed 🚨 62651148 16861259 3.72
clickbench_q08/duckdb:vortex-file-compressed 299484560 294619849 1.02
clickbench_q09/duckdb:vortex-file-compressed 414525923 426048332 0.97
clickbench_q10/duckdb:vortex-file-compressed 84148367 82135398 1.02
clickbench_q11/duckdb:vortex-file-compressed 92433505 95681986 0.97
clickbench_q12/duckdb:vortex-file-compressed 🚀 227196899 253045054 0.90
clickbench_q13/duckdb:vortex-file-compressed 🚀 457975962 509890210 0.90
clickbench_q14/duckdb:vortex-file-compressed 253234079 275213579 0.92
clickbench_q15/duckdb:vortex-file-compressed 245237746 245454233 1.00
clickbench_q16/duckdb:vortex-file-compressed 797358812 801392050 0.99
clickbench_q17/duckdb:vortex-file-compressed 662897668 642406791 1.03
clickbench_q18/duckdb:vortex-file-compressed 🚀 1188857003 1340583436 0.89
clickbench_q19/duckdb:vortex-file-compressed 🚨 95226803 27312369 3.49
clickbench_q20/duckdb:vortex-file-compressed 🚀 419472851 473980533 0.89
clickbench_q21/duckdb:vortex-file-compressed 472828903 497295090 0.95
clickbench_q22/duckdb:vortex-file-compressed 🚨 1001611107 671461548 1.49
clickbench_q23/duckdb:vortex-file-compressed 🚨 1434808365 854130667 1.68
clickbench_q24/duckdb:vortex-file-compressed 59823200 55314233 1.08
clickbench_q25/duckdb:vortex-file-compressed 🚨 114689178 91124715 1.26
clickbench_q26/duckdb:vortex-file-compressed 50048114 53028604 0.94
clickbench_q27/duckdb:vortex-file-compressed 568131880 557171555 1.02
clickbench_q28/duckdb:vortex-file-compressed 🚀 3025537618 3420986284 0.88
clickbench_q29/duckdb:vortex-file-compressed 🚨 98946785 32194854 3.07
clickbench_q30/duckdb:vortex-file-compressed 🚀 192272479 242199736 0.79
clickbench_q31/duckdb:vortex-file-compressed 🚀 273550252 360203719 0.76
clickbench_q32/duckdb:vortex-file-compressed 🚀 1354992216 1673959356 0.81
clickbench_q33/duckdb:vortex-file-compressed 1885173422 1849488057 1.02
clickbench_q34/duckdb:vortex-file-compressed 2055880490 1919739279 1.07
clickbench_q35/duckdb:vortex-file-compressed 460141277 426873750 1.08
clickbench_q36/duckdb:vortex-file-compressed 🚨 58228083 40206046 1.45
clickbench_q37/duckdb:vortex-file-compressed 🚨 32932386 26292880 1.25
clickbench_q38/duckdb:vortex-file-compressed 🚨 41694275 31088731 1.34
clickbench_q39/duckdb:vortex-file-compressed 🚨 80929507 56077075 1.44
clickbench_q40/duckdb:vortex-file-compressed 26556592 28847031 0.92
clickbench_q41/duckdb:vortex-file-compressed 24658933 26441292 0.93
clickbench_q42/duckdb:vortex-file-compressed 26653586 28559309 0.93
duckdb / parquet (0.968x ➖, 3↑ 5↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 338233674 275235475 1.23
clickbench_q01/duckdb:parquet 🚨 62673191 53890249 1.16
clickbench_q02/duckdb:parquet 🚨 84789705 72440642 1.17
clickbench_q03/duckdb:parquet 🚨 80475226 70668078 1.14
clickbench_q04/duckdb:parquet 🚨 262662401 229745710 1.14
clickbench_q05/duckdb:parquet 300860413 312207211 0.96
clickbench_q06/duckdb:parquet 66422647 65913705 1.01
clickbench_q07/duckdb:parquet 57026865 56507898 1.01
clickbench_q08/duckdb:parquet 281375485 297952076 0.94
clickbench_q09/duckdb:parquet 417177577 442590592 0.94
clickbench_q10/duckdb:parquet 104723980 110485354 0.95
clickbench_q11/duckdb:parquet 114829953 120156336 0.96
clickbench_q12/duckdb:parquet 323201945 329689445 0.98
clickbench_q13/duckdb:parquet 🚀 526270461 587351863 0.90
clickbench_q14/duckdb:parquet 334589851 368453863 0.91
clickbench_q15/duckdb:parquet 256180171 272757441 0.94
clickbench_q16/duckdb:parquet 639083411 690988787 0.92
clickbench_q17/duckdb:parquet 532681451 571621393 0.93
clickbench_q18/duckdb:parquet 1098810147 1181267558 0.93
clickbench_q19/duckdb:parquet 51612857 54079116 0.95
clickbench_q20/duckdb:parquet 442491952 478569995 0.92
clickbench_q21/duckdb:parquet 568038874 615112039 0.92
clickbench_q22/duckdb:parquet 937525830 1008744610 0.93
clickbench_q23/duckdb:parquet 320026357 339572762 0.94
clickbench_q24/duckdb:parquet 79567634 80609722 0.99
clickbench_q25/duckdb:parquet 142435324 146243839 0.97
clickbench_q26/duckdb:parquet 52303161 56492082 0.93
clickbench_q27/duckdb:parquet 659487711 647084577 1.02
clickbench_q28/duckdb:parquet 4872819325 4960641839 0.98
clickbench_q29/duckdb:parquet 62591390 64885085 0.96
clickbench_q30/duckdb:parquet 313482822 336965170 0.93
clickbench_q31/duckdb:parquet 358221021 393564177 0.91
clickbench_q32/duckdb:parquet 🚀 1176093945 1337687024 0.88
clickbench_q33/duckdb:parquet 1273592035 1394914126 0.91
clickbench_q34/duckdb:parquet 🚀 1320655415 1517606769 0.87
clickbench_q35/duckdb:parquet 361650282 390943576 0.93
clickbench_q36/duckdb:parquet 65459061 68128146 0.96
clickbench_q37/duckdb:parquet 55522040 57493618 0.97
clickbench_q38/duckdb:parquet 59770857 61518586 0.97
clickbench_q39/duckdb:parquet 100385115 109857668 0.91
clickbench_q40/duckdb:parquet 57572131 59987195 0.96
clickbench_q41/duckdb:parquet 61631196 64360847 0.96
clickbench_q42/duckdb:parquet 52274420 56123092 0.93
duckdb / duckdb (0.982x ➖, 8↑ 5↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17972230 18775946 0.96
clickbench_q01/duckdb:duckdb 32248493 35343435 0.91
clickbench_q02/duckdb:duckdb 44270668 47134703 0.94
clickbench_q03/duckdb:duckdb 47818795 49174173 0.97
clickbench_q04/duckdb:duckdb 🚀 216646917 244564968 0.89
clickbench_q05/duckdb:duckdb 🚀 328021334 365378993 0.90
clickbench_q06/duckdb:duckdb 34897675 37373059 0.93
clickbench_q07/duckdb:duckdb 35071464 37493246 0.94
clickbench_q08/duckdb:duckdb 🚀 315021815 353341596 0.89
clickbench_q09/duckdb:duckdb 487718285 534453402 0.91
clickbench_q10/duckdb:duckdb 97846063 105723181 0.93
clickbench_q11/duckdb:duckdb 108476998 116128083 0.93
clickbench_q12/duckdb:duckdb 🚀 305530686 347815278 0.88
clickbench_q13/duckdb:duckdb 🚀 553522734 653195322 0.85
clickbench_q14/duckdb:duckdb 🚀 346866646 398956334 0.87
clickbench_q15/duckdb:duckdb 269719810 294867868 0.91
clickbench_q16/duckdb:duckdb 🚀 674791737 756793296 0.89
clickbench_q17/duckdb:duckdb 🚀 586318009 658269184 0.89
clickbench_q18/duckdb:duckdb 1503234332 1437256784 1.05
clickbench_q19/duckdb:duckdb 39192833 36391002 1.08
clickbench_q20/duckdb:duckdb 🚨 1123652321 962678563 1.17
clickbench_q21/duckdb:duckdb 🚨 1181142336 1031407385 1.15
clickbench_q22/duckdb:duckdb 1182845112 1185527134 1.00
clickbench_q23/duckdb:duckdb 289874808 279726313 1.04
clickbench_q24/duckdb:duckdb 64903951 64296738 1.01
clickbench_q25/duckdb:duckdb 133689156 132162015 1.01
clickbench_q26/duckdb:duckdb 60093300 58342263 1.03
clickbench_q27/duckdb:duckdb 1183726338 1132956905 1.04
clickbench_q28/duckdb:duckdb 5084959012 5050467512 1.01
clickbench_q29/duckdb:duckdb 52957859 50378491 1.05
clickbench_q30/duckdb:duckdb 341867041 313129207 1.09
clickbench_q31/duckdb:duckdb 508672099 484212633 1.05
clickbench_q32/duckdb:duckdb 🚨 1928557889 1595998062 1.21
clickbench_q33/duckdb:duckdb 🚨 2523786121 2065834392 1.22
clickbench_q34/duckdb:duckdb 🚨 2427260301 2033558505 1.19
clickbench_q35/duckdb:duckdb 266854507 291797253 0.91
clickbench_q36/duckdb:duckdb 42421394 44280035 0.96
clickbench_q37/duckdb:duckdb 31694923 32556145 0.97
clickbench_q38/duckdb:duckdb 31802665 32692353 0.97
clickbench_q39/duckdb:duckdb 62537923 66337377 0.94
clickbench_q40/duckdb:duckdb 31580470 33276548 0.95
clickbench_q41/duckdb:duckdb 30460638 32162144 0.95
clickbench_q42/duckdb:duckdb 31313805 32888292 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -16.9% +6.3% -21.8% +630.4% ➖ noise
0 duckdb:duckdb -4.3% +6.3% -10.0% +300.3% ➖ noise
0 duckdb:vortex-file-compressed +11.5% +6.3% +4.9% +347.6% ➖ noise
1 datafusion:vortex-file-compressed +20.1% +5.3% +14.1% +40.1% ➖ noise
1 duckdb:duckdb -8.8% +5.3% -13.3% +45.2% ➖ noise
1 duckdb:vortex-file-compressed +242.7% +5.3% +225.5% +21.3% 🚨 regression
2 datafusion:vortex-file-compressed +6.8% +4.7% +2.0% +38.0% ➖ noise
2 duckdb:duckdb -6.1% +4.7% -10.3% +20.8% ➖ noise
2 duckdb:vortex-file-compressed +263.3% +4.7% +246.9% +20.9% 🚨 regression
3 datafusion:vortex-file-compressed -2.0% +1.4% -3.3% +181.4% ➖ noise
3 duckdb:duckdb -2.8% +1.4% -4.1% +43.9% ➖ noise
3 duckdb:vortex-file-compressed +84.3% +1.4% +81.8% +28.1% 🚨 regression
4 datafusion:vortex-file-compressed -0.3% +1.1% -1.4% +17.8% ➖ noise
4 duckdb:duckdb -11.4% +1.1% -12.4% +17.8% ➖ noise
4 duckdb:vortex-file-compressed +6.3% +1.1% +5.1% +17.8% ➖ noise
5 datafusion:vortex-file-compressed -0.9% -5.5% +4.9% +17.8% ➖ noise
5 duckdb:duckdb -10.2% -5.5% -5.0% +17.8% ➖ noise
5 duckdb:vortex-file-compressed +0.6% -5.5% +6.5% +17.8% ➖ noise
6 datafusion:vortex-file-compressed -8.7% +0.1% -8.9% +43.6% ➖ noise
6 duckdb:duckdb -6.6% +0.1% -6.7% +28.5% ➖ noise
6 duckdb:vortex-file-compressed +397.8% +0.1% +397.1% +26.2% 🚨 regression
7 datafusion:vortex-file-compressed +40.1% -6.0% +49.0% +25.5% 🚨 regression
7 duckdb:duckdb -6.5% -6.0% -0.5% +17.8% ➖ noise
7 duckdb:vortex-file-compressed +271.6% -6.0% +295.1% +17.8% 🚨 regression
8 datafusion:vortex-file-compressed +0.9% -8.5% +10.3% +17.8% ➖ noise
8 duckdb:duckdb -10.8% -8.5% -2.5% +17.8% ➖ noise
8 duckdb:vortex-file-compressed +1.7% -8.5% +11.2% +17.8% ➖ noise
9 datafusion:vortex-file-compressed -5.2% -8.8% +4.0% +17.8% ➖ noise
9 duckdb:duckdb -8.7% -8.8% +0.1% +17.8% ➖ noise
9 duckdb:vortex-file-compressed -2.7% -8.8% +6.7% +17.8% ➖ noise
10 datafusion:vortex-file-compressed +6.3% -8.5% +16.2% +17.8% ➖ noise
10 duckdb:duckdb -7.5% -8.5% +1.2% +17.8% ➖ noise
10 duckdb:vortex-file-compressed +2.5% -8.5% +12.0% +22.6% ➖ noise
11 datafusion:vortex-file-compressed +12.2% -7.1% +20.8% +17.8% 🚨 regression
11 duckdb:duckdb -6.6% -7.1% +0.5% +17.8% ➖ noise
11 duckdb:vortex-file-compressed -3.4% -7.1% +4.0% +17.8% ➖ noise
12 datafusion:vortex-file-compressed -17.6% -6.7% -11.7% +17.8% ➖ noise
12 duckdb:duckdb -12.2% -6.7% -5.9% +17.8% ➖ noise
12 duckdb:vortex-file-compressed -10.2% -6.7% -3.8% +17.8% ➖ noise
13 datafusion:vortex-file-compressed -16.1% -10.5% -6.3% +17.8% ➖ noise
13 duckdb:duckdb -15.3% -10.5% -5.3% +17.8% ➖ noise
13 duckdb:vortex-file-compressed -10.2% -10.5% +0.3% +17.8% ➖ noise
14 datafusion:vortex-file-compressed -16.0% -8.7% -8.0% +17.8% ➖ noise
14 duckdb:duckdb -13.1% -8.7% -4.8% +17.8% ➖ noise
14 duckdb:vortex-file-compressed -8.0% -8.7% +0.7% +17.8% ➖ noise
15 datafusion:vortex-file-compressed -17.6% -9.4% -9.0% +17.8% ➖ noise
15 duckdb:duckdb -8.5% -9.4% +1.0% +17.8% ➖ noise
15 duckdb:vortex-file-compressed -0.1% -9.4% +10.3% +17.8% ➖ noise
16 datafusion:vortex-file-compressed -18.0% -8.6% -10.3% +17.8% ➖ noise
16 duckdb:duckdb -10.8% -8.6% -2.5% +17.8% ➖ noise
16 duckdb:vortex-file-compressed -0.5% -8.6% +8.8% +17.8% ➖ noise
17 datafusion:vortex-file-compressed -18.1% -8.9% -10.1% +17.8% ➖ noise
17 duckdb:duckdb -10.9% -8.9% -2.2% +17.8% ➖ noise
17 duckdb:vortex-file-compressed +3.2% -8.9% +13.3% +17.8% ➖ noise
18 datafusion:vortex-file-compressed -17.0% -9.2% -8.6% +17.8% ➖ noise
18 duckdb:duckdb +4.6% -9.2% +15.2% +18.3% ➖ noise
18 duckdb:vortex-file-compressed -11.3% -9.2% -2.3% +17.8% ➖ noise
19 datafusion:vortex-file-compressed +19.4% -6.8% +28.1% +17.8% 🚨 regression
19 duckdb:duckdb +7.7% -6.8% +15.5% +17.8% ➖ noise
19 duckdb:vortex-file-compressed +248.7% -6.8% +273.9% +21.5% 🚨 regression
20 datafusion:vortex-file-compressed -11.3% -8.6% -3.0% +172.5% ➖ noise
20 duckdb:duckdb +16.7% -8.6% +27.7% +17.8% 🚨 regression
20 duckdb:vortex-file-compressed -11.5% -8.6% -3.2% +17.8% ➖ noise
21 datafusion:vortex-file-compressed +2.5% -7.9% +11.3% +17.8% ➖ noise
21 duckdb:duckdb +14.5% -7.9% +24.3% +17.8% 🚨 regression
21 duckdb:vortex-file-compressed -4.9% -7.9% +3.2% +17.8% ➖ noise
22 datafusion:vortex-file-compressed +37.7% -8.5% +50.6% +17.8% 🚨 regression
22 duckdb:duckdb -0.2% -8.5% +9.1% +17.8% ➖ noise
22 duckdb:vortex-file-compressed +49.2% -8.5% +63.1% +17.8% 🚨 regression
23 datafusion:vortex-file-compressed +597.9% -3.0% +619.9% +33.8% 🚨 regression
23 duckdb:duckdb +3.6% -3.0% +6.9% +17.8% ➖ noise
23 duckdb:vortex-file-compressed +68.0% -3.0% +73.3% +39.2% 🚨 regression
24 datafusion:vortex-file-compressed +0.2% -0.1% +0.3% +39.0% ➖ noise
24 duckdb:duckdb +0.9% -0.1% +1.1% +17.8% ➖ noise
24 duckdb:vortex-file-compressed +8.2% -0.1% +8.3% +31.0% ➖ noise
25 datafusion:vortex-file-compressed -6.1% -0.6% -5.6% +17.8% ➖ noise
25 duckdb:duckdb +1.2% -0.6% +1.7% +17.8% ➖ noise
25 duckdb:vortex-file-compressed +25.9% -0.6% +26.6% +17.8% 🚨 regression
26 datafusion:vortex-file-compressed +1.5% -2.1% +3.7% +17.8% ➖ noise
26 duckdb:duckdb +3.0% -2.1% +5.2% +17.8% ➖ noise
26 duckdb:vortex-file-compressed -5.6% -2.1% -3.6% +19.5% ➖ noise
27 datafusion:vortex-file-compressed +16.8% +0.8% +15.9% +17.8% ➖ noise
27 duckdb:duckdb +4.5% +0.8% +3.6% +17.8% ➖ noise
27 duckdb:vortex-file-compressed +2.0% +0.8% +1.1% +17.8% ➖ noise
28 datafusion:vortex-file-compressed -0.0% +2.6% -2.5% +17.8% ➖ noise
28 duckdb:duckdb +0.7% +2.6% -1.8% +17.8% ➖ noise
28 duckdb:vortex-file-compressed -11.6% +2.6% -13.8% +17.8% ➖ noise
29 datafusion:vortex-file-compressed +5.1% -2.8% +8.2% +17.8% ➖ noise
29 duckdb:duckdb +5.1% -2.8% +8.2% +17.8% ➖ noise
29 duckdb:vortex-file-compressed +207.3% -2.8% +216.3% +17.8% 🚨 regression
30 datafusion:vortex-file-compressed +38.7% +13.5% +22.2% +17.8% 🚨 regression
30 duckdb:duckdb +9.2% +13.5% -3.8% +17.8% ➖ noise
30 duckdb:vortex-file-compressed -20.6% +13.5% -30.1% +17.8% ✅ faster
31 datafusion:vortex-file-compressed +37.3% +8.7% +26.3% +19.6% 🚨 regression
31 duckdb:duckdb +5.1% +8.7% -3.4% +17.8% ➖ noise
31 duckdb:vortex-file-compressed -24.1% +8.7% -30.1% +17.8% ✅ faster
32 datafusion:vortex-file-compressed +39.1% +9.3% +27.3% +17.8% 🚨 regression
32 duckdb:duckdb +20.8% +9.3% +10.6% +17.8% ➖ noise
32 duckdb:vortex-file-compressed -19.1% +9.3% -25.9% +17.8% ✅ faster
33 datafusion:vortex-file-compressed +59.6% +10.9% +43.9% +17.8% 🚨 regression
33 duckdb:duckdb +22.2% +10.9% +10.2% +17.8% ➖ noise
33 duckdb:vortex-file-compressed +1.9% +10.9% -8.1% +17.8% ➖ noise
34 datafusion:vortex-file-compressed +67.6% -1.3% +69.8% +17.8% 🚨 regression
34 duckdb:duckdb +19.4% -1.3% +21.0% +17.8% 🚨 regression
34 duckdb:vortex-file-compressed +7.1% -1.3% +8.5% +17.8% ➖ noise
35 datafusion:vortex-file-compressed +57.1% -2.2% +60.6% +24.1% 🚨 regression
35 duckdb:duckdb -8.5% -2.2% -6.5% +17.8% ➖ noise
35 duckdb:vortex-file-compressed +7.8% -2.2% +10.2% +17.8% ➖ noise
36 datafusion:vortex-file-compressed +81.7% +10.1% +65.0% +17.8% 🚨 regression
36 duckdb:duckdb -4.2% +10.1% -13.0% +17.8% ➖ noise
36 duckdb:vortex-file-compressed +44.8% +10.1% +31.6% +25.1% 🚨 regression
37 datafusion:vortex-file-compressed +34.6% -1.3% +36.4% +17.8% 🚨 regression
37 duckdb:duckdb -2.6% -1.3% -1.3% +17.8% ➖ noise
37 duckdb:vortex-file-compressed +25.3% -1.3% +27.0% +18.3% 🚨 regression
38 datafusion:vortex-file-compressed +44.8% -2.5% +48.6% +17.8% 🚨 regression
38 duckdb:duckdb -2.7% -2.5% -0.2% +17.8% ➖ noise
38 duckdb:vortex-file-compressed +34.1% -2.5% +37.6% +17.8% 🚨 regression
39 datafusion:vortex-file-compressed +65.6% -3.5% +71.5% +17.8% 🚨 regression
39 duckdb:duckdb -5.7% -3.5% -2.4% +17.8% ➖ noise
39 duckdb:vortex-file-compressed +44.3% -3.5% +49.5% +21.9% 🚨 regression
40 datafusion:vortex-file-compressed +63.4% -3.3% +68.9% +18.2% 🚨 regression
40 duckdb:duckdb -5.1% -3.3% -1.9% +17.8% ➖ noise
40 duckdb:vortex-file-compressed -7.9% -3.3% -4.8% +17.8% ➖ noise
41 datafusion:vortex-file-compressed +35.0% -2.2% +38.0% +17.8% 🚨 regression
41 duckdb:duckdb -5.3% -2.2% -3.2% +17.8% ➖ noise
41 duckdb:vortex-file-compressed -6.7% -2.2% -4.6% +17.8% ➖ noise
42 datafusion:vortex-file-compressed +36.5% -1.1% +38.1% +17.8% 🚨 regression
42 duckdb:duckdb -4.8% -1.1% -3.7% +17.8% ➖ noise
42 duckdb:vortex-file-compressed -6.7% -1.1% -5.6% +17.8% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.9%
Vortex (geomean): 0.937x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -5.4%


datafusion / vortex-file-compressed (0.924x ➖, 3↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 280120600 222511823 1.26
tpch_q02/datafusion:vortex-file-compressed 581124081 516455761 1.13
tpch_q03/datafusion:vortex-file-compressed 436526856 413412577 1.06
tpch_q04/datafusion:vortex-file-compressed 238586919 251992411 0.95
tpch_q05/datafusion:vortex-file-compressed 461434116 517795257 0.89
tpch_q06/datafusion:vortex-file-compressed 🚀 268358059 415242767 0.65
tpch_q07/datafusion:vortex-file-compressed 🚀 383707394 699189451 0.55
tpch_q08/datafusion:vortex-file-compressed 646959868 686653915 0.94
tpch_q09/datafusion:vortex-file-compressed 512657035 604972911 0.85
tpch_q10/datafusion:vortex-file-compressed 543872336 572218444 0.95
tpch_q11/datafusion:vortex-file-compressed 351926657 417682381 0.84
tpch_q12/datafusion:vortex-file-compressed 394210737 523631477 0.75
tpch_q13/datafusion:vortex-file-compressed 🚀 149968655 216806757 0.69
tpch_q14/datafusion:vortex-file-compressed 238518762 242101520 0.99
tpch_q15/datafusion:vortex-file-compressed 367090839 401549524 0.91
tpch_q16/datafusion:vortex-file-compressed 195921823 190543290 1.03
tpch_q17/datafusion:vortex-file-compressed 351942201 360288593 0.98
tpch_q18/datafusion:vortex-file-compressed 352740128 336451730 1.05
tpch_q19/datafusion:vortex-file-compressed 378759498 355756575 1.06
tpch_q20/datafusion:vortex-file-compressed 499545236 392453184 1.27
tpch_q21/datafusion:vortex-file-compressed 435715273 474639314 0.92
tpch_q22/datafusion:vortex-file-compressed 151925775 151486712 1.00
datafusion / vortex-compact (0.983x ➖, 1↑ 3↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 313153686 243274209 1.29
tpch_q02/datafusion:vortex-compact 🚨 587224600 434330718 1.35
tpch_q03/datafusion:vortex-compact 349058047 387250081 0.90
tpch_q04/datafusion:vortex-compact 254605128 299986809 0.85
tpch_q05/datafusion:vortex-compact 429158389 500236734 0.86
tpch_q06/datafusion:vortex-compact 401631239 417196343 0.96
tpch_q07/datafusion:vortex-compact 601160343 615913136 0.98
tpch_q08/datafusion:vortex-compact 558782399 661027793 0.85
tpch_q09/datafusion:vortex-compact 494358371 538589221 0.92
tpch_q10/datafusion:vortex-compact 560098780 472106804 1.19
tpch_q11/datafusion:vortex-compact 🚨 426734364 326097791 1.31
tpch_q12/datafusion:vortex-compact 🚨 618057194 448659223 1.38
tpch_q13/datafusion:vortex-compact 159719142 209050155 0.76
tpch_q14/datafusion:vortex-compact 282582176 286134134 0.99
tpch_q15/datafusion:vortex-compact 496040892 442314050 1.12
tpch_q16/datafusion:vortex-compact 192450274 184143447 1.05
tpch_q17/datafusion:vortex-compact 381971627 377061740 1.01
tpch_q18/datafusion:vortex-compact 297427856 338489709 0.88
tpch_q19/datafusion:vortex-compact 514330466 579385258 0.89
tpch_q20/datafusion:vortex-compact 536156941 537426404 1.00
tpch_q21/datafusion:vortex-compact 🚀 500489108 762668417 0.66
tpch_q22/datafusion:vortex-compact 118037688 138792558 0.85
datafusion / parquet (1.011x ➖, 0↑ 1↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 262991383 259585503 1.01
tpch_q02/datafusion:parquet 516755231 431539084 1.20
tpch_q03/datafusion:parquet 378443798 348170079 1.09
tpch_q04/datafusion:parquet 176706764 176688495 1.00
tpch_q05/datafusion:parquet 651134126 523562284 1.24
tpch_q06/datafusion:parquet 149902814 186983756 0.80
tpch_q07/datafusion:parquet 655212117 553479180 1.18
tpch_q08/datafusion:parquet 756891469 635686346 1.19
tpch_q09/datafusion:parquet 🚨 763278283 585020907 1.30
tpch_q10/datafusion:parquet 585848518 590668514 0.99
tpch_q11/datafusion:parquet 370575934 362831942 1.02
tpch_q12/datafusion:parquet 261569291 354265476 0.74
tpch_q13/datafusion:parquet 430917060 432522756 1.00
tpch_q14/datafusion:parquet 205578345 222321355 0.92
tpch_q15/datafusion:parquet 317483930 361474760 0.88
tpch_q16/datafusion:parquet 176899789 190667732 0.93
tpch_q17/datafusion:parquet 426920235 502302608 0.85
tpch_q18/datafusion:parquet 709440935 550051310 1.29
tpch_q19/datafusion:parquet 499958754 402284071 1.24
tpch_q20/datafusion:parquet 360202156 417357230 0.86
tpch_q21/datafusion:parquet 545376143 670714476 0.81
tpch_q22/datafusion:parquet 126352365 130083315 0.97
duckdb / vortex-file-compressed (0.916x ➖, 1↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀 261649313 394815298 0.66
tpch_q02/duckdb:vortex-file-compressed 977367759 1004534848 0.97
tpch_q03/duckdb:vortex-file-compressed 564402983 670781601 0.84
tpch_q04/duckdb:vortex-file-compressed 434554390 408968550 1.06
tpch_q05/duckdb:vortex-file-compressed 869840294 1038465717 0.84
tpch_q06/duckdb:vortex-file-compressed 388194122 491023246 0.79
tpch_q07/duckdb:vortex-file-compressed 764190510 782270935 0.98
tpch_q08/duckdb:vortex-file-compressed 923786142 982324018 0.94
tpch_q09/duckdb:vortex-file-compressed 844043555 1064497614 0.79
tpch_q10/duckdb:vortex-file-compressed 700817984 813693016 0.86
tpch_q11/duckdb:vortex-file-compressed 421043983 532331595 0.79
tpch_q12/duckdb:vortex-file-compressed 651916302 554405562 1.18
tpch_q13/duckdb:vortex-file-compressed 495109597 443249550 1.12
tpch_q14/duckdb:vortex-file-compressed 443200464 457563030 0.97
tpch_q15/duckdb:vortex-file-compressed 315834758 336345632 0.94
tpch_q16/duckdb:vortex-file-compressed 358901552 373257703 0.96
tpch_q17/duckdb:vortex-file-compressed 677883037 666741389 1.02
tpch_q18/duckdb:vortex-file-compressed 472552006 577282140 0.82
tpch_q19/duckdb:vortex-file-compressed 401850328 471940794 0.85
tpch_q20/duckdb:vortex-file-compressed 764921762 756497055 1.01
tpch_q21/duckdb:vortex-file-compressed 1197482163 1161224615 1.03
tpch_q22/duckdb:vortex-file-compressed 327239017 365581903 0.90
duckdb / vortex-compact (0.925x ➖, 0↑ 1↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 237761760 274966459 0.86
tpch_q02/duckdb:vortex-compact 866423886 943409341 0.92
tpch_q03/duckdb:vortex-compact 582048017 558035370 1.04
tpch_q04/duckdb:vortex-compact 🚨 498365460 365540674 1.36
tpch_q05/duckdb:vortex-compact 837161818 839865409 1.00
tpch_q06/duckdb:vortex-compact 436440500 379078506 1.15
tpch_q07/duckdb:vortex-compact 792736348 874135867 0.91
tpch_q08/duckdb:vortex-compact 809628192 931418101 0.87
tpch_q09/duckdb:vortex-compact 886855191 924540946 0.96
tpch_q10/duckdb:vortex-compact 643236348 749355908 0.86
tpch_q11/duckdb:vortex-compact 512242801 554401471 0.92
tpch_q12/duckdb:vortex-compact 434187136 467608862 0.93
tpch_q13/duckdb:vortex-compact 445780052 438109300 1.02
tpch_q14/duckdb:vortex-compact 477368549 488214864 0.98
tpch_q15/duckdb:vortex-compact 276693548 354881530 0.78
tpch_q16/duckdb:vortex-compact 343056396 439963745 0.78
tpch_q17/duckdb:vortex-compact 627726507 713412019 0.88
tpch_q18/duckdb:vortex-compact 460955833 541350155 0.85
tpch_q19/duckdb:vortex-compact 492159810 555785438 0.89
tpch_q20/duckdb:vortex-compact 758526338 899534419 0.84
tpch_q21/duckdb:vortex-compact 994790208 1038321571 0.96
tpch_q22/duckdb:vortex-compact 307865418 396809600 0.78
duckdb / parquet (0.981x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 483400708 587489780 0.82
tpch_q02/duckdb:parquet 1189560989 1355501528 0.88
tpch_q03/duckdb:parquet 1145225532 1177810387 0.97
tpch_q04/duckdb:parquet 605545982 600656151 1.01
tpch_q05/duckdb:parquet 1594894392 1472811258 1.08
tpch_q06/duckdb:parquet 401640321 373359783 1.08
tpch_q07/duckdb:parquet 1210456695 1175927956 1.03
tpch_q08/duckdb:parquet 1577655621 1583220416 1.00
tpch_q09/duckdb:parquet 1316600504 1348953075 0.98
tpch_q10/duckdb:parquet 1535849981 1296777463 1.18
tpch_q11/duckdb:parquet 932988025 829981625 1.12
tpch_q12/duckdb:parquet 573236858 627475036 0.91
tpch_q13/duckdb:parquet 895218571 926865716 0.97
tpch_q14/duckdb:parquet 825251379 725703918 1.14
tpch_q15/duckdb:parquet 536822230 562239580 0.95
tpch_q16/duckdb:parquet 481642307 560906491 0.86
tpch_q17/duckdb:parquet 756569973 844392302 0.90
tpch_q18/duckdb:parquet 877924821 928905558 0.95
tpch_q19/duckdb:parquet 902807738 813279813 1.11
tpch_q20/duckdb:parquet 1118297200 1173714324 0.95
tpch_q21/duckdb:parquet 1146948821 1315575961 0.87
tpch_q22/duckdb:parquet 483739655 519500327 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +28.7% -8.7% +41.0% +172.6% ➖ noise
1 datafusion:vortex-file-compressed +25.9% -8.7% +37.9% +132.6% ➖ noise
1 duckdb:vortex-compact -13.5% -8.7% -5.3% +54.5% ➖ noise
1 duckdb:vortex-file-compressed -33.7% -8.7% -27.4% +50.5% ➖ noise
2 datafusion:vortex-compact +35.2% +2.5% +31.9% +41.1% ➖ noise
2 datafusion:vortex-file-compressed +12.5% +2.5% +9.8% +35.6% ➖ noise
2 duckdb:vortex-compact -8.2% +2.5% -10.4% +31.4% ➖ noise
2 duckdb:vortex-file-compressed -2.7% +2.5% -5.1% +31.4% ➖ noise
3 datafusion:vortex-compact -9.9% +2.8% -12.3% +109.2% ➖ noise
3 datafusion:vortex-file-compressed +5.6% +2.8% +2.7% +79.5% ➖ noise
3 duckdb:vortex-compact +4.3% +2.8% +1.5% +40.3% ➖ noise
3 duckdb:vortex-file-compressed -15.9% +2.8% -18.2% +47.7% ➖ noise
4 datafusion:vortex-compact -15.1% +0.4% -15.5% +36.8% ➖ noise
4 datafusion:vortex-file-compressed -5.3% +0.4% -5.7% +32.4% ➖ noise
4 duckdb:vortex-compact +36.3% +0.4% +35.8% +41.4% ➖ noise
4 duckdb:vortex-file-compressed +6.3% +0.4% +5.8% +35.3% ➖ noise
5 datafusion:vortex-compact -14.2% +16.0% -26.1% +36.8% ➖ noise
5 datafusion:vortex-file-compressed -10.9% +16.0% -23.2% +31.7% ➖ noise
5 duckdb:vortex-compact -0.3% +16.0% -14.1% +31.4% ➖ noise
5 duckdb:vortex-file-compressed -16.2% +16.0% -27.8% +31.4% ✅ faster
6 datafusion:vortex-compact -3.7% -7.1% +3.7% +79.6% ➖ noise
6 datafusion:vortex-file-compressed -35.4% -7.1% -30.4% +38.0% ✅ faster
6 duckdb:vortex-compact +15.1% -7.1% +24.0% +36.4% ➖ noise
6 duckdb:vortex-file-compressed -20.9% -7.1% -14.9% +111.0% ➖ noise
7 datafusion:vortex-compact -2.4% +10.4% -11.6% +31.5% ➖ noise
7 datafusion:vortex-file-compressed -45.1% +10.4% -50.3% +31.4% ✅ faster
7 duckdb:vortex-compact -9.3% +10.4% -17.8% +31.4% ➖ noise
7 duckdb:vortex-file-compressed -2.3% +10.4% -11.5% +31.4% ➖ noise
8 datafusion:vortex-compact -15.5% +8.9% -22.4% +46.0% ➖ noise
8 datafusion:vortex-file-compressed -5.8% +8.9% -13.5% +31.4% ➖ noise
8 duckdb:vortex-compact -13.1% +8.9% -20.2% +31.4% ➖ noise
8 duckdb:vortex-file-compressed -6.0% +8.9% -13.7% +31.4% ➖ noise
9 datafusion:vortex-compact -8.2% +12.8% -18.7% +36.9% ➖ noise
9 datafusion:vortex-file-compressed -15.3% +12.8% -24.9% +34.0% ➖ noise
9 duckdb:vortex-compact -4.1% +12.8% -15.0% +31.4% ➖ noise
9 duckdb:vortex-file-compressed -20.7% +12.8% -29.7% +31.4% ✅ faster
10 datafusion:vortex-compact +18.6% +8.4% +9.5% +31.4% ➖ noise
10 datafusion:vortex-file-compressed -5.0% +8.4% -12.3% +31.4% ➖ noise
10 duckdb:vortex-compact -14.2% +8.4% -20.8% +31.4% ➖ noise
10 duckdb:vortex-file-compressed -13.9% +8.4% -20.5% +31.4% ➖ noise
11 datafusion:vortex-compact +30.9% +7.1% +22.1% +31.4% ➖ noise
11 datafusion:vortex-file-compressed -15.7% +7.1% -21.4% +31.4% ➖ noise
11 duckdb:vortex-compact -7.6% +7.1% -13.8% +31.4% ➖ noise
11 duckdb:vortex-file-compressed -20.9% +7.1% -26.2% +31.4% ✅ faster
12 datafusion:vortex-compact +37.8% -17.9% +67.7% +39.8% 🚨 regression
12 datafusion:vortex-file-compressed -24.7% -17.9% -8.3% +37.3% ➖ noise
12 duckdb:vortex-compact -7.1% -17.9% +13.1% +43.6% ➖ noise
12 duckdb:vortex-file-compressed +17.6% -17.9% +43.2% +32.4% 🚨 regression
13 datafusion:vortex-compact -23.6% -1.9% -22.1% +117.1% ➖ noise
13 datafusion:vortex-file-compressed -30.8% -1.9% -29.5% +66.7% ➖ noise
13 duckdb:vortex-compact +1.8% -1.9% +3.7% +34.0% ➖ noise
13 duckdb:vortex-file-compressed +11.7% -1.9% +13.9% +31.4% ➖ noise
14 datafusion:vortex-compact -1.2% +2.5% -3.7% +43.6% ➖ noise
14 datafusion:vortex-file-compressed -1.5% +2.5% -3.9% +35.1% ➖ noise
14 duckdb:vortex-compact -2.2% +2.5% -4.6% +31.4% ➖ noise
14 duckdb:vortex-file-compressed -3.1% +2.5% -5.5% +31.4% ➖ noise
15 datafusion:vortex-compact +12.1% -8.4% +22.5% +31.4% ➖ noise
15 datafusion:vortex-file-compressed -8.6% -8.4% -0.2% +42.9% ➖ noise
15 duckdb:vortex-compact -22.0% -8.4% -14.9% +31.4% ➖ noise
15 duckdb:vortex-file-compressed -6.1% -8.4% +2.5% +31.4% ➖ noise
16 datafusion:vortex-compact +4.5% -10.7% +17.1% +35.2% ➖ noise
16 datafusion:vortex-file-compressed +2.8% -10.7% +15.2% +32.0% ➖ noise
16 duckdb:vortex-compact -22.0% -10.7% -12.6% +41.3% ➖ noise
16 duckdb:vortex-file-compressed -3.8% -10.7% +7.7% +34.6% ➖ noise
17 datafusion:vortex-compact +1.3% -12.7% +16.1% +32.5% ➖ noise
17 datafusion:vortex-file-compressed -2.3% -12.7% +11.9% +38.6% ➖ noise
17 duckdb:vortex-compact -12.0% -12.7% +0.8% +31.4% ➖ noise
17 duckdb:vortex-file-compressed +1.7% -12.7% +16.5% +31.4% ➖ noise
18 datafusion:vortex-compact -12.1% +10.4% -20.4% +31.4% ➖ noise
18 datafusion:vortex-file-compressed +4.8% +10.4% -5.0% +31.4% ➖ noise
18 duckdb:vortex-compact -14.9% +10.4% -22.9% +31.4% ➖ noise
18 duckdb:vortex-file-compressed -18.1% +10.4% -25.9% +31.4% ✅ faster
19 datafusion:vortex-compact -11.2% +17.5% -24.4% +51.8% ➖ noise
19 datafusion:vortex-file-compressed +6.5% +17.5% -9.4% +33.0% ➖ noise
19 duckdb:vortex-compact -11.4% +17.5% -24.6% +37.3% ➖ noise
19 duckdb:vortex-file-compressed -14.9% +17.5% -27.5% +43.8% ➖ noise
20 datafusion:vortex-compact -0.2% -9.3% +10.0% +38.2% ➖ noise
20 datafusion:vortex-file-compressed +27.3% -9.3% +40.4% +33.7% 🚨 regression
20 duckdb:vortex-compact -15.7% -9.3% -7.0% +31.4% ➖ noise
20 duckdb:vortex-file-compressed +1.1% -9.3% +11.5% +31.4% ➖ noise
21 datafusion:vortex-compact -34.4% -15.8% -22.1% +37.4% ➖ noise
21 datafusion:vortex-file-compressed -8.2% -15.8% +9.0% +31.4% ➖ noise
21 duckdb:vortex-compact -4.2% -15.8% +13.8% +31.4% ➖ noise
21 duckdb:vortex-file-compressed +3.1% -15.8% +22.5% +31.4% ➖ noise
22 datafusion:vortex-compact -15.0% -4.9% -10.6% +31.4% ➖ noise
22 datafusion:vortex-file-compressed +0.3% -4.9% +5.5% +31.4% ➖ noise
22 duckdb:vortex-compact -22.4% -4.9% -18.4% +31.4% ➖ noise
22 duckdb:vortex-file-compressed -10.5% -4.9% -5.9% +31.4% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 3.077x ❌


datafusion / vortex-file-compressed (3.077x ❌, 0↑ 10↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 🚨 181633498 117143352 1.55
polarsignals_q01/datafusion:vortex-file-compressed 🚨 451304206 344571153 1.31
polarsignals_q02/datafusion:vortex-file-compressed 🚨 137924823 23025435 5.99
polarsignals_q03/datafusion:vortex-file-compressed 🚨 446131892 338994034 1.32
polarsignals_q04/datafusion:vortex-file-compressed 🚨 69203453 12305299 5.62
polarsignals_q05/datafusion:vortex-file-compressed 🚨 100634186 16179213 6.22
polarsignals_q06/datafusion:vortex-file-compressed 🚨 93932891 19661615 4.78
polarsignals_q07/datafusion:vortex-file-compressed 🚨 100638735 12239868 8.22
polarsignals_q08/datafusion:vortex-file-compressed 🚨 519213517 433443139 1.20
polarsignals_q09/datafusion:vortex-file-compressed 🚨 32264211 11184639 2.88

@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: Likely regression (environment too noisy confidence)
Attributed Vortex impact: +19.8%
Vortex (geomean): 1.311x ❌
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +3.1%


datafusion / vortex-file-compressed (1.680x ❌, 0↑ 18↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 69273219 50488804 1.37
tpch_q02/datafusion:vortex-file-compressed 57292467 52229034 1.10
tpch_q03/datafusion:vortex-file-compressed 🚨 53481073 27453858 1.95
tpch_q04/datafusion:vortex-file-compressed 🚨 40372386 18753875 2.15
tpch_q05/datafusion:vortex-file-compressed 🚨 91644867 78475620 1.17
tpch_q06/datafusion:vortex-file-compressed 🚨 70156382 10306209 6.81
tpch_q07/datafusion:vortex-file-compressed 🚨 118403796 87996869 1.35
tpch_q08/datafusion:vortex-file-compressed 🚨 84336090 66341310 1.27
tpch_q09/datafusion:vortex-file-compressed 97276643 89090976 1.09
tpch_q10/datafusion:vortex-file-compressed 🚨 102764773 75931051 1.35
tpch_q11/datafusion:vortex-file-compressed 🚨 30296817 19101517 1.59
tpch_q12/datafusion:vortex-file-compressed 🚨 108552004 33855291 3.21
tpch_q13/datafusion:vortex-file-compressed 🚨 38987616 26385812 1.48
tpch_q14/datafusion:vortex-file-compressed 🚨 51460322 28989317 1.78
tpch_q15/datafusion:vortex-file-compressed 🚨 82112506 23871796 3.44
tpch_q16/datafusion:vortex-file-compressed 36514892 33955394 1.08
tpch_q17/datafusion:vortex-file-compressed 83399712 76897279 1.08
tpch_q18/datafusion:vortex-file-compressed 🚨 113445641 101447680 1.12
tpch_q19/datafusion:vortex-file-compressed 🚨 130581000 35767679 3.65
tpch_q20/datafusion:vortex-file-compressed 🚨 73005526 50347764 1.45
tpch_q21/datafusion:vortex-file-compressed 🚨 114876529 93992293 1.22
tpch_q22/datafusion:vortex-file-compressed 🚨 26946303 14551132 1.85
datafusion / vortex-compact (1.507x ❌, 0↑ 19↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 80129379 62932844 1.27
tpch_q02/datafusion:vortex-compact 57787156 53855163 1.07
tpch_q03/datafusion:vortex-compact 🚨 57034952 31915173 1.79
tpch_q04/datafusion:vortex-compact 🚨 43434271 23073141 1.88
tpch_q05/datafusion:vortex-compact 🚨 96253787 84254526 1.14
tpch_q06/datafusion:vortex-compact 🚨 68504693 14280481 4.80
tpch_q07/datafusion:vortex-compact 🚨 119328284 94038519 1.27
tpch_q08/datafusion:vortex-compact 🚨 86768953 71671449 1.21
tpch_q09/datafusion:vortex-compact 🚨 102556270 90544234 1.13
tpch_q10/datafusion:vortex-compact 🚨 97807762 80873648 1.21
tpch_q11/datafusion:vortex-compact 🚨 31380005 20453588 1.53
tpch_q12/datafusion:vortex-compact 🚨 114802533 43997379 2.61
tpch_q13/datafusion:vortex-compact 🚨 46196201 35995934 1.28
tpch_q14/datafusion:vortex-compact 🚨 54430344 32650762 1.67
tpch_q15/datafusion:vortex-compact 🚨 86742387 32136835 2.70
tpch_q16/datafusion:vortex-compact 43347251 40820350 1.06
tpch_q17/datafusion:vortex-compact 🚨 90046067 78636651 1.15
tpch_q18/datafusion:vortex-compact 🚨 119180131 107811914 1.11
tpch_q19/datafusion:vortex-compact 🚨 130838758 44699762 2.93
tpch_q20/datafusion:vortex-compact 🚨 76553787 55046479 1.39
tpch_q21/datafusion:vortex-compact 🚨 132508859 106225403 1.25
tpch_q22/datafusion:vortex-compact 17352463 17438165 1.00
datafusion / parquet (0.998x ➖, 2↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 146527814 147081256 1.00
tpch_q02/datafusion:parquet 82859143 80316200 1.03
tpch_q03/datafusion:parquet 88404521 82126289 1.08
tpch_q04/datafusion:parquet 55132061 55266038 1.00
tpch_q05/datafusion:parquet 161976407 160117651 1.01
tpch_q06/datafusion:parquet 🚀 39396922 48532422 0.81
tpch_q07/datafusion:parquet 183795141 176479217 1.04
tpch_q08/datafusion:parquet 165710110 161419361 1.03
tpch_q09/datafusion:parquet 207765520 205081446 1.01
tpch_q10/datafusion:parquet 190337016 180102258 1.06
tpch_q11/datafusion:parquet 61049888 61034985 1.00
tpch_q12/datafusion:parquet 🚀 108706214 126245766 0.86
tpch_q13/datafusion:parquet 211464667 199140891 1.06
tpch_q14/datafusion:parquet 78872255 79164307 1.00
tpch_q15/datafusion:parquet 70651066 69300897 1.02
tpch_q16/datafusion:parquet 57051075 54378001 1.05
tpch_q17/datafusion:parquet 164035639 170603841 0.96
tpch_q18/datafusion:parquet 232655919 229061024 1.02
tpch_q19/datafusion:parquet 96081714 103109355 0.93
tpch_q20/datafusion:parquet 122668690 117116712 1.05
tpch_q21/datafusion:parquet 183922558 183306202 1.00
tpch_q22/datafusion:parquet 39667414 40446898 0.98
datafusion / arrow (0.994x ➖, 0↑ 1↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 64124618 61807592 1.04
tpch_q02/datafusion:arrow 22799190 22997326 0.99
tpch_q03/datafusion:arrow 36793288 38240085 0.96
tpch_q04/datafusion:arrow 30564837 30691847 1.00
tpch_q05/datafusion:arrow 92260295 90823622 1.02
tpch_q06/datafusion:arrow 21594916 22440149 0.96
tpch_q07/datafusion:arrow 🚨 190526642 170040676 1.12
tpch_q08/datafusion:arrow 49657526 48533811 1.02
tpch_q09/datafusion:arrow 74620255 76970421 0.97
tpch_q10/datafusion:arrow 59578220 59657544 1.00
tpch_q11/datafusion:arrow 12568205 12157231 1.03
tpch_q12/datafusion:arrow 57195894 58559292 0.98
tpch_q13/datafusion:arrow 51274958 50579412 1.01
tpch_q14/datafusion:arrow 25165308 26627250 0.95
tpch_q15/datafusion:arrow 49428298 54369132 0.91
tpch_q16/datafusion:arrow 23930874 25664161 0.93
tpch_q17/datafusion:arrow 81768318 87389269 0.94
tpch_q18/datafusion:arrow 160689675 160221760 1.00
tpch_q19/datafusion:arrow 42405075 40915814 1.04
tpch_q20/datafusion:arrow 41768267 42477156 0.98
tpch_q21/datafusion:arrow 232620167 231586151 1.00
tpch_q22/datafusion:arrow 21956315 21252154 1.03
duckdb / vortex-file-compressed (1.086x ➖, 0↑ 6↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33219914 32493865 1.02
tpch_q02/duckdb:vortex-file-compressed 29649610 28314893 1.05
tpch_q03/duckdb:vortex-file-compressed 30362955 29014745 1.05
tpch_q04/duckdb:vortex-file-compressed 29668058 31055222 0.96
tpch_q05/duckdb:vortex-file-compressed 33037751 33359090 0.99
tpch_q06/duckdb:vortex-file-compressed 🚨 19309075 11459186 1.69
tpch_q07/duckdb:vortex-file-compressed 🚨 42490071 36085875 1.18
tpch_q08/duckdb:vortex-file-compressed 39983804 41681773 0.96
tpch_q09/duckdb:vortex-file-compressed 80694308 80373132 1.00
tpch_q10/duckdb:vortex-file-compressed 36932095 36614031 1.01
tpch_q11/duckdb:vortex-file-compressed 17018176 17920192 0.95
tpch_q12/duckdb:vortex-file-compressed 🚨 34307543 22907541 1.50
tpch_q13/duckdb:vortex-file-compressed 🚨 43444565 37410886 1.16
tpch_q14/duckdb:vortex-file-compressed 🚨 28503162 21980949 1.30
tpch_q15/duckdb:vortex-file-compressed 16470334 15853352 1.04
tpch_q16/duckdb:vortex-file-compressed 30508598 29569423 1.03
tpch_q17/duckdb:vortex-file-compressed 26764229 25329631 1.06
tpch_q18/duckdb:vortex-file-compressed 48301979 48828632 0.99
tpch_q19/duckdb:vortex-file-compressed 32989605 31946219 1.03
tpch_q20/duckdb:vortex-file-compressed 🚨 38746579 34537286 1.12
tpch_q21/duckdb:vortex-file-compressed 105755024 101539449 1.04
tpch_q22/duckdb:vortex-file-compressed 18655694 18010878 1.04
duckdb / vortex-compact (1.073x ➖, 0↑ 3↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40673674 39438991 1.03
tpch_q02/duckdb:vortex-compact 39488812 37771307 1.05
tpch_q03/duckdb:vortex-compact 33024006 32314630 1.02
tpch_q04/duckdb:vortex-compact 35676732 33756546 1.06
tpch_q05/duckdb:vortex-compact 39384186 37944515 1.04
tpch_q06/duckdb:vortex-compact 🚨 22907853 14906624 1.54
tpch_q07/duckdb:vortex-compact 🚨 48269818 42707115 1.13
tpch_q08/duckdb:vortex-compact 46837294 43950302 1.07
tpch_q09/duckdb:vortex-compact 91027339 86393401 1.05
tpch_q10/duckdb:vortex-compact 42094563 40089016 1.05
tpch_q11/duckdb:vortex-compact 20939828 21028751 1.00
tpch_q12/duckdb:vortex-compact 🚨 47108144 36173405 1.30
tpch_q13/duckdb:vortex-compact 49909258 47867584 1.04
tpch_q14/duckdb:vortex-compact 35135900 31961294 1.10
tpch_q15/duckdb:vortex-compact 20836396 19466017 1.07
tpch_q16/duckdb:vortex-compact 36855464 37596068 0.98
tpch_q17/duckdb:vortex-compact 32497610 31247604 1.04
tpch_q18/duckdb:vortex-compact 51508380 51611928 1.00
tpch_q19/duckdb:vortex-compact 38212718 38346842 1.00
tpch_q20/duckdb:vortex-compact 48370427 44010913 1.10
tpch_q21/duckdb:vortex-compact 117963959 112072845 1.05
tpch_q22/duckdb:vortex-compact 20640968 20361025 1.01
duckdb / parquet (0.998x ➖, 3↑ 2↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79941783 76732003 1.04
tpch_q02/duckdb:parquet 39670470 38535550 1.03
tpch_q03/duckdb:parquet 70356605 69465822 1.01
tpch_q04/duckdb:parquet 🚀 46743137 54731536 0.85
tpch_q05/duckdb:parquet 🚀 67662645 80907657 0.84
tpch_q06/duckdb:parquet 20440026 20963551 0.98
tpch_q07/duckdb:parquet 79994712 82437863 0.97
tpch_q08/duckdb:parquet 81921185 81174185 1.01
tpch_q09/duckdb:parquet 160506475 157383296 1.02
tpch_q10/duckdb:parquet 129008966 125952261 1.02
tpch_q11/duckdb:parquet 22777969 22590144 1.01
tpch_q12/duckdb:parquet 52880645 55783475 0.95
tpch_q13/duckdb:parquet 265572806 262972444 1.01
tpch_q14/duckdb:parquet 🚨 60464948 49812340 1.21
tpch_q15/duckdb:parquet 24467796 24518224 1.00
tpch_q16/duckdb:parquet 55321879 55706250 0.99
tpch_q17/duckdb:parquet 🚀 58049214 66263096 0.88
tpch_q18/duckdb:parquet 🚨 140479004 119655100 1.17
tpch_q19/duckdb:parquet 69398348 71871024 0.97
tpch_q20/duckdb:parquet 63078272 62553738 1.01
tpch_q21/duckdb:parquet 180636453 168679084 1.07
tpch_q22/duckdb:parquet 52046220 52536635 0.99
duckdb / duckdb (0.995x ➖, 1↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15893645 16025924 0.99
tpch_q02/duckdb:duckdb 11793333 12251963 0.96
tpch_q03/duckdb:duckdb 18997751 20100164 0.95
tpch_q04/duckdb:duckdb 19324576 18835041 1.03
tpch_q05/duckdb:duckdb 19394371 19815121 0.98
tpch_q06/duckdb:duckdb 5350164 5301567 1.01
tpch_q07/duckdb:duckdb 22385812 22902823 0.98
tpch_q08/duckdb:duckdb 20755296 20979163 0.99
tpch_q09/duckdb:duckdb 53683743 52565723 1.02
tpch_q10/duckdb:duckdb 42092330 42059293 1.00
tpch_q11/duckdb:duckdb 5755656 5680993 1.01
tpch_q12/duckdb:duckdb 13821477 14033653 0.98
tpch_q13/duckdb:duckdb 35271984 37475432 0.94
tpch_q14/duckdb:duckdb 🚀 15987423 17843857 0.90
tpch_q15/duckdb:duckdb 11915854 12068026 0.99
tpch_q16/duckdb:duckdb 22611891 22416534 1.01
tpch_q17/duckdb:duckdb 13939854 13255193 1.05
tpch_q18/duckdb:duckdb 38118893 37270247 1.02
tpch_q19/duckdb:duckdb 29372918 27552538 1.07
tpch_q20/duckdb:duckdb 22812972 21910129 1.04
tpch_q21/duckdb:duckdb 54637981 54967931 0.99
tpch_q22/duckdb:duckdb 24188669 24269566 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +3.7% +1.9% +1.8% +32.0% ➖ noise
1 datafusion:vortex-compact +27.3% +1.9% +25.0% +27.2% ➖ noise
1 datafusion:vortex-file-compressed +37.2% +1.9% +34.7% +30.9% 🚨 regression
1 duckdb:duckdb -0.8% +1.9% -2.7% +26.9% ➖ noise
1 duckdb:vortex-compact +3.1% +1.9% +1.2% +26.7% ➖ noise
1 duckdb:vortex-file-compressed +2.2% +1.9% +0.3% +27.3% ➖ noise
2 datafusion:arrow -0.9% +3.1% -3.8% +16.5% ➖ noise
2 datafusion:vortex-compact +7.3% +3.1% +4.1% +16.5% ➖ noise
2 datafusion:vortex-file-compressed +9.7% +3.1% +6.4% +16.5% ➖ noise
2 duckdb:duckdb -3.7% +3.1% -6.6% +16.5% ➖ noise
2 duckdb:vortex-compact +4.5% +3.1% +1.4% +16.5% ➖ noise
2 duckdb:vortex-file-compressed +4.7% +3.1% +1.6% +16.5% ➖ noise
3 datafusion:arrow -3.8% +4.4% -7.9% +16.5% ➖ noise
3 datafusion:vortex-compact +78.7% +4.4% +71.2% +16.5% 🚨 regression
3 datafusion:vortex-file-compressed +94.8% +4.4% +86.6% +16.5% 🚨 regression
3 duckdb:duckdb -5.5% +4.4% -9.5% +16.5% ➖ noise
3 duckdb:vortex-compact +2.2% +4.4% -2.1% +16.5% ➖ noise
3 duckdb:vortex-file-compressed +4.6% +4.4% +0.2% +17.5% ➖ noise
4 datafusion:arrow -0.4% -7.7% +7.9% +16.5% ➖ noise
4 datafusion:vortex-compact +88.2% -7.7% +103.9% +16.5% 🚨 regression
4 datafusion:vortex-file-compressed +115.3% -7.7% +133.2% +16.5% 🚨 regression
4 duckdb:duckdb +2.6% -7.7% +11.2% +16.5% ➖ noise
4 duckdb:vortex-compact +5.7% -7.7% +14.5% +16.5% ➖ noise
4 duckdb:vortex-file-compressed -4.5% -7.7% +3.5% +16.5% ➖ noise
5 datafusion:arrow +1.6% -8.0% +10.4% +16.5% ➖ noise
5 datafusion:vortex-compact +14.2% -8.0% +24.2% +16.5% 🚨 regression
5 datafusion:vortex-file-compressed +16.8% -8.0% +27.0% +16.5% 🚨 regression
5 duckdb:duckdb -2.1% -8.0% +6.4% +19.0% ➖ noise
5 duckdb:vortex-compact +3.8% -8.0% +12.8% +16.5% ➖ noise
5 duckdb:vortex-file-compressed -1.0% -8.0% +7.7% +16.5% ➖ noise
6 datafusion:arrow -3.8% -11.0% +8.2% +21.1% ➖ noise
6 datafusion:vortex-compact +379.7% -11.0% +439.2% +20.9% 🚨 regression
6 datafusion:vortex-file-compressed +580.7% -11.0% +665.1% +21.2% 🚨 regression
6 duckdb:duckdb +0.9% -11.0% +13.4% +22.7% ➖ noise
6 duckdb:vortex-compact +53.7% -11.0% +72.7% +20.7% 🚨 regression
6 duckdb:vortex-file-compressed +68.5% -11.0% +89.4% +24.3% 🚨 regression
7 datafusion:arrow +12.0% +0.5% +11.5% +16.5% ➖ noise
7 datafusion:vortex-compact +26.9% +0.5% +26.2% +16.5% 🚨 regression
7 datafusion:vortex-file-compressed +34.6% +0.5% +33.8% +16.5% 🚨 regression
7 duckdb:duckdb -2.3% +0.5% -2.8% +16.5% ➖ noise
7 duckdb:vortex-compact +13.0% +0.5% +12.4% +16.5% ➖ noise
7 duckdb:vortex-file-compressed +17.7% +0.5% +17.1% +16.5% 🚨 regression
8 datafusion:arrow +2.3% +1.8% +0.5% +16.5% ➖ noise
8 datafusion:vortex-compact +21.1% +1.8% +18.9% +16.5% 🚨 regression
8 datafusion:vortex-file-compressed +27.1% +1.8% +24.9% +16.5% 🚨 regression
8 duckdb:duckdb -1.1% +1.8% -2.8% +16.5% ➖ noise
8 duckdb:vortex-compact +6.6% +1.8% +4.7% +16.5% ➖ noise
8 duckdb:vortex-file-compressed -4.1% +1.8% -5.8% +16.5% ➖ noise
9 datafusion:arrow -3.1% +1.6% -4.6% +16.5% ➖ noise
9 datafusion:vortex-compact +13.3% +1.6% +11.4% +16.5% ➖ noise
9 datafusion:vortex-file-compressed +9.2% +1.6% +7.4% +16.5% ➖ noise
9 duckdb:duckdb +2.1% +1.6% +0.5% +16.5% ➖ noise
9 duckdb:vortex-compact +5.4% +1.6% +3.7% +16.5% ➖ noise
9 duckdb:vortex-file-compressed +0.4% +1.6% -1.2% +16.5% ➖ noise
10 datafusion:arrow -0.1% +4.0% -4.0% +21.2% ➖ noise
10 datafusion:vortex-compact +20.9% +4.0% +16.2% +16.5% ➖ noise
10 datafusion:vortex-file-compressed +35.3% +4.0% +30.1% +16.5% 🚨 regression
10 duckdb:duckdb +0.1% +4.0% -3.8% +16.5% ➖ noise
10 duckdb:vortex-compact +5.0% +4.0% +0.9% +16.5% ➖ noise
10 duckdb:vortex-file-compressed +0.9% +4.0% -3.1% +16.5% ➖ noise
11 datafusion:arrow +3.4% +0.4% +2.9% +16.6% ➖ noise
11 datafusion:vortex-compact +53.4% +0.4% +52.8% +16.9% 🚨 regression
11 datafusion:vortex-file-compressed +58.6% +0.4% +57.9% +16.5% 🚨 regression
11 duckdb:duckdb +1.3% +0.4% +0.9% +24.2% ➖ noise
11 duckdb:vortex-compact -0.4% +0.4% -0.8% +16.5% ➖ noise
11 duckdb:vortex-file-compressed -5.0% +0.4% -5.4% +16.5% ➖ noise
12 datafusion:arrow -2.3% -9.7% +8.1% +16.5% ➖ noise
12 datafusion:vortex-compact +160.9% -9.7% +188.8% +16.5% 🚨 regression
12 datafusion:vortex-file-compressed +220.6% -9.7% +254.9% +16.5% 🚨 regression
12 duckdb:duckdb -1.5% -9.7% +9.0% +16.5% ➖ noise
12 duckdb:vortex-compact +30.2% -9.7% +44.1% +16.5% 🚨 regression
12 duckdb:vortex-file-compressed +49.8% -9.7% +65.8% +16.5% 🚨 regression
13 datafusion:arrow +1.4% +3.6% -2.1% +16.5% ➖ noise
13 datafusion:vortex-compact +28.3% +3.6% +23.9% +16.5% 🚨 regression
13 datafusion:vortex-file-compressed +47.8% +3.6% +42.7% +16.5% 🚨 regression
13 duckdb:duckdb -5.9% +3.6% -9.1% +25.7% ➖ noise
13 duckdb:vortex-compact +4.3% +3.6% +0.7% +16.5% ➖ noise
13 duckdb:vortex-file-compressed +16.1% +3.6% +12.1% +16.5% ➖ noise
14 datafusion:arrow -5.5% +10.0% -14.1% +16.5% ➖ noise
14 datafusion:vortex-compact +66.7% +10.0% +51.6% +16.5% 🚨 regression
14 datafusion:vortex-file-compressed +77.5% +10.0% +61.4% +16.5% 🚨 regression
14 duckdb:duckdb -10.4% +10.0% -18.5% +26.0% ➖ noise
14 duckdb:vortex-compact +9.9% +10.0% -0.0% +18.2% ➖ noise
14 duckdb:vortex-file-compressed +29.7% +10.0% +17.9% +19.0% ➖ noise
15 datafusion:arrow -9.1% +0.9% -9.9% +20.0% ➖ noise
15 datafusion:vortex-compact +169.9% +0.9% +167.6% +18.6% 🚨 regression
15 datafusion:vortex-file-compressed +244.0% +0.9% +241.0% +19.8% 🚨 regression
15 duckdb:duckdb -1.3% +0.9% -2.1% +22.4% ➖ noise
15 duckdb:vortex-compact +7.0% +0.9% +6.1% +18.4% ➖ noise
15 duckdb:vortex-file-compressed +3.9% +0.9% +3.0% +19.2% ➖ noise
16 datafusion:arrow -6.8% +2.1% -8.6% +16.5% ➖ noise
16 datafusion:vortex-compact +6.2% +2.1% +4.0% +16.5% ➖ noise
16 datafusion:vortex-file-compressed +7.5% +2.1% +5.4% +16.5% ➖ noise
16 duckdb:duckdb +0.9% +2.1% -1.2% +18.1% ➖ noise
16 duckdb:vortex-compact -2.0% +2.1% -4.0% +16.5% ➖ noise
16 duckdb:vortex-file-compressed +3.2% +2.1% +1.1% +16.5% ➖ noise
17 datafusion:arrow -6.4% -8.2% +2.0% +16.5% ➖ noise
17 datafusion:vortex-compact +14.5% -8.2% +24.8% +16.5% 🚨 regression
17 datafusion:vortex-file-compressed +8.5% -8.2% +18.2% +16.6% 🚨 regression
17 duckdb:duckdb +5.2% -8.2% +14.6% +16.5% ➖ noise
17 duckdb:vortex-compact +4.0% -8.2% +13.3% +16.5% ➖ noise
17 duckdb:vortex-file-compressed +5.7% -8.2% +15.1% +16.5% ➖ noise
18 datafusion:arrow +0.3% +9.2% -8.2% +16.5% ➖ noise
18 datafusion:vortex-compact +10.5% +9.2% +1.2% +16.5% ➖ noise
18 datafusion:vortex-file-compressed +11.8% +9.2% +2.4% +16.5% ➖ noise
18 duckdb:duckdb +2.3% +9.2% -6.3% +16.5% ➖ noise
18 duckdb:vortex-compact -0.2% +9.2% -8.6% +16.5% ➖ noise
18 duckdb:vortex-file-compressed -1.1% +9.2% -9.4% +16.5% ➖ noise
19 datafusion:arrow +3.6% -5.1% +9.3% +17.8% ➖ noise
19 datafusion:vortex-compact +192.7% -5.1% +208.6% +17.5% 🚨 regression
19 datafusion:vortex-file-compressed +265.1% -5.1% +284.9% +16.5% 🚨 regression
19 duckdb:duckdb +6.6% -5.1% +12.4% +19.2% ➖ noise
19 duckdb:vortex-compact -0.3% -5.1% +5.1% +19.9% ➖ noise
19 duckdb:vortex-file-compressed +3.3% -5.1% +8.9% +16.5% ➖ noise
20 datafusion:arrow -1.7% +2.8% -4.3% +16.5% ➖ noise
20 datafusion:vortex-compact +39.1% +2.8% +35.3% +16.5% 🚨 regression
20 datafusion:vortex-file-compressed +45.0% +2.8% +41.1% +16.5% 🚨 regression
20 duckdb:duckdb +4.1% +2.8% +1.3% +16.5% ➖ noise
20 duckdb:vortex-compact +9.9% +2.8% +6.9% +16.5% ➖ noise
20 duckdb:vortex-file-compressed +12.2% +2.8% +9.2% +16.5% ➖ noise
21 datafusion:arrow +0.4% +3.7% -3.1% +16.5% ➖ noise
21 datafusion:vortex-compact +24.7% +3.7% +20.3% +16.5% 🚨 regression
21 datafusion:vortex-file-compressed +22.2% +3.7% +17.9% +16.5% 🚨 regression
21 duckdb:duckdb -0.6% +3.7% -4.1% +16.5% ➖ noise
21 duckdb:vortex-compact +5.3% +3.7% +1.5% +16.5% ➖ noise
21 duckdb:vortex-file-compressed +4.2% +3.7% +0.5% +16.5% ➖ noise
22 datafusion:arrow +3.3% -1.4% +4.8% +21.1% ➖ noise
22 datafusion:vortex-compact -0.5% -1.4% +1.0% +16.5% ➖ noise
22 datafusion:vortex-file-compressed +85.2% -1.4% +87.9% +16.5% 🚨 regression
22 duckdb:duckdb -0.3% -1.4% +1.1% +16.5% ➖ noise
22 duckdb:vortex-compact +1.4% -1.4% +2.8% +16.5% ➖ noise
22 duckdb:vortex-file-compressed +3.6% -1.4% +5.1% +16.5% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.6%
Vortex (geomean): 1.140x ❌
Parquet (geomean): 1.040x ➖
Shifts: Parquet (control) +4.0% · Median polish +5.3%


datafusion / vortex-file-compressed (1.253x ❌, 0↑ 58↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 39578756 26492743 1.49
tpcds_q02/datafusion:vortex-file-compressed 80624162 77995512 1.03
tpcds_q03/datafusion:vortex-file-compressed 29141377 28222154 1.03
tpcds_q04/datafusion:vortex-file-compressed 419473320 385266213 1.09
tpcds_q05/datafusion:vortex-file-compressed 82078690 75203433 1.09
tpcds_q06/datafusion:vortex-file-compressed 78126232 72740385 1.07
tpcds_q07/datafusion:vortex-file-compressed 🚨 81401268 70837342 1.15
tpcds_q08/datafusion:vortex-file-compressed 🚨 44409645 40285245 1.10
tpcds_q09/datafusion:vortex-file-compressed 🚨 350954294 46453119 7.56
tpcds_q10/datafusion:vortex-file-compressed 🚨 59547561 46655813 1.28
tpcds_q11/datafusion:vortex-file-compressed 240750279 230066169 1.05
tpcds_q12/datafusion:vortex-file-compressed 36612086 34152520 1.07
tpcds_q13/datafusion:vortex-file-compressed 🚨 184846179 78595513 2.35
tpcds_q14/datafusion:vortex-file-compressed 🚨 268364080 214145212 1.25
tpcds_q15/datafusion:vortex-file-compressed 52855172 49773598 1.06
tpcds_q16/datafusion:vortex-file-compressed 🚨 43199943 29094807 1.48
tpcds_q17/datafusion:vortex-file-compressed 🚨 121412861 105337734 1.15
tpcds_q18/datafusion:vortex-file-compressed 🚨 111617590 97384501 1.15
tpcds_q19/datafusion:vortex-file-compressed 51814128 47627500 1.09
tpcds_q20/datafusion:vortex-file-compressed 🚨 45097292 40462170 1.11
tpcds_q21/datafusion:vortex-file-compressed 172175623 171161559 1.01
tpcds_q22/datafusion:vortex-file-compressed 77107923 71326096 1.08
tpcds_q23/datafusion:vortex-file-compressed 🚨 205996359 182266148 1.13
tpcds_q24/datafusion:vortex-file-compressed 185591015 175347269 1.06
tpcds_q25/datafusion:vortex-file-compressed 🚨 124640403 112477368 1.11
tpcds_q26/datafusion:vortex-file-compressed 62679625 59693010 1.05
tpcds_q27/datafusion:vortex-file-compressed 177575078 163713019 1.08
tpcds_q28/datafusion:vortex-file-compressed 🚨 465846779 49254758 9.46
tpcds_q29/datafusion:vortex-file-compressed 🚨 129594991 107761830 1.20
tpcds_q30/datafusion:vortex-file-compressed 29576426 29409470 1.01
tpcds_q31/datafusion:vortex-file-compressed 187706997 175503152 1.07
tpcds_q32/datafusion:vortex-file-compressed 🚨 32773311 23420412 1.40
tpcds_q33/datafusion:vortex-file-compressed 🚨 47287992 38014653 1.24
tpcds_q34/datafusion:vortex-file-compressed 🚨 42560678 36390875 1.17
tpcds_q35/datafusion:vortex-file-compressed 🚨 71628602 59265634 1.21
tpcds_q36/datafusion:vortex-file-compressed 108330371 104414233 1.04
tpcds_q37/datafusion:vortex-file-compressed 🚨 54145835 38438118 1.41
tpcds_q38/datafusion:vortex-file-compressed 90727471 84582309 1.07
tpcds_q39/datafusion:vortex-file-compressed 196160772 187468832 1.05
tpcds_q40/datafusion:vortex-file-compressed 🚨 69191741 55027717 1.26
tpcds_q41/datafusion:vortex-file-compressed 🚨 14852107 13234339 1.12
tpcds_q42/datafusion:vortex-file-compressed 30838939 29687142 1.04
tpcds_q43/datafusion:vortex-file-compressed 49792071 49037206 1.02
tpcds_q44/datafusion:vortex-file-compressed 🚨 82733517 41028839 2.02
tpcds_q45/datafusion:vortex-file-compressed 🚨 53510382 48278250 1.11
tpcds_q46/datafusion:vortex-file-compressed 🚨 72111980 63703049 1.13
tpcds_q47/datafusion:vortex-file-compressed 294855168 268195520 1.10
tpcds_q48/datafusion:vortex-file-compressed 🚨 158618924 68900719 2.30
tpcds_q49/datafusion:vortex-file-compressed 🚨 163429429 69108825 2.36
tpcds_q50/datafusion:vortex-file-compressed 80303317 74705974 1.07
tpcds_q51/datafusion:vortex-file-compressed 🚨 111898917 92583745 1.21
tpcds_q52/datafusion:vortex-file-compressed 32138792 30982418 1.04
tpcds_q53/datafusion:vortex-file-compressed 31402928 29261287 1.07
tpcds_q54/datafusion:vortex-file-compressed 🚨 64629396 48482894 1.33
tpcds_q55/datafusion:vortex-file-compressed 33195385 30266033 1.10
tpcds_q56/datafusion:vortex-file-compressed 🚨 52203236 45446514 1.15
tpcds_q57/datafusion:vortex-file-compressed 193418824 177496812 1.09
tpcds_q58/datafusion:vortex-file-compressed 116258902 108605505 1.07
tpcds_q59/datafusion:vortex-file-compressed 101247322 92585953 1.09
tpcds_q60/datafusion:vortex-file-compressed 🚨 56141430 47078033 1.19
tpcds_q61/datafusion:vortex-file-compressed 🚨 64407173 57312554 1.12
tpcds_q62/datafusion:vortex-file-compressed 🚨 50424459 42723395 1.18
tpcds_q63/datafusion:vortex-file-compressed 🚨 33556506 29937062 1.12
tpcds_q64/datafusion:vortex-file-compressed 743074345 702741282 1.06
tpcds_q65/datafusion:vortex-file-compressed 🚨 66651138 50377431 1.32
tpcds_q66/datafusion:vortex-file-compressed 109988066 102196897 1.08
tpcds_q67/datafusion:vortex-file-compressed 151343782 140148767 1.08
tpcds_q68/datafusion:vortex-file-compressed 🚨 74827375 64289547 1.16
tpcds_q69/datafusion:vortex-file-compressed 🚨 58153543 44566271 1.30
tpcds_q70/datafusion:vortex-file-compressed 134694946 129878665 1.04
tpcds_q71/datafusion:vortex-file-compressed 🚨 48103685 29801858 1.61
tpcds_q72/datafusion:vortex-file-compressed 🚨 3692335498 3300649143 1.12
tpcds_q73/datafusion:vortex-file-compressed 42324468 38502431 1.10
tpcds_q74/datafusion:vortex-file-compressed 175714132 164979395 1.07
tpcds_q75/datafusion:vortex-file-compressed 🚨 192814341 129198425 1.49
tpcds_q76/datafusion:vortex-file-compressed 65899168 60364068 1.09
tpcds_q77/datafusion:vortex-file-compressed 🚨 66307596 51503281 1.29
tpcds_q78/datafusion:vortex-file-compressed 🚨 227069626 176368300 1.29
tpcds_q79/datafusion:vortex-file-compressed 🚨 54171922 44566208 1.22
tpcds_q80/datafusion:vortex-file-compressed 🚨 167036192 114569515 1.46
tpcds_q81/datafusion:vortex-file-compressed 🚨 40694549 36290596 1.12
tpcds_q82/datafusion:vortex-file-compressed 🚨 56687896 40147948 1.41
tpcds_q83/datafusion:vortex-file-compressed 🚨 72164252 65315010 1.10
tpcds_q84/datafusion:vortex-file-compressed 🚨 18531961 14673182 1.26
tpcds_q85/datafusion:vortex-file-compressed 🚨 231290854 133977783 1.73
tpcds_q86/datafusion:vortex-file-compressed 32919357 31234763 1.05
tpcds_q87/datafusion:vortex-file-compressed 93217474 88492500 1.05
tpcds_q88/datafusion:vortex-file-compressed 🚨 108691729 80833331 1.34
tpcds_q89/datafusion:vortex-file-compressed 🚨 65429839 55510399 1.18
tpcds_q90/datafusion:vortex-file-compressed 🚨 25355864 15526690 1.63
tpcds_q91/datafusion:vortex-file-compressed 27965855 26010597 1.08
tpcds_q92/datafusion:vortex-file-compressed 🚨 27269068 18846396 1.45
tpcds_q93/datafusion:vortex-file-compressed 🚨 51777008 36420266 1.42
tpcds_q94/datafusion:vortex-file-compressed 🚨 39499866 25880580 1.53
tpcds_q95/datafusion:vortex-file-compressed 🚨 104859392 87350086 1.20
tpcds_q96/datafusion:vortex-file-compressed 🚨 20152878 15199306 1.33
tpcds_q97/datafusion:vortex-file-compressed 🚨 44770240 31177244 1.44
tpcds_q98/datafusion:vortex-file-compressed 50346419 47431013 1.06
tpcds_q99/datafusion:vortex-file-compressed 63687418 60564420 1.05
datafusion / vortex-compact (1.177x ❌, 0↑ 48↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 36527294 33968810 1.08
tpcds_q02/datafusion:vortex-compact 85673627 79925433 1.07
tpcds_q03/datafusion:vortex-compact 35966333 33011225 1.09
tpcds_q04/datafusion:vortex-compact 🚨 478555843 425862228 1.12
tpcds_q05/datafusion:vortex-compact 84867970 83543510 1.02
tpcds_q06/datafusion:vortex-compact 85115917 82193837 1.04
tpcds_q07/datafusion:vortex-compact 97610921 90836281 1.07
tpcds_q08/datafusion:vortex-compact 52706469 48210846 1.09
tpcds_q09/datafusion:vortex-compact 🚨 367921758 93626169 3.93
tpcds_q10/datafusion:vortex-compact 🚨 74713817 66382314 1.13
tpcds_q11/datafusion:vortex-compact 273415100 256151343 1.07
tpcds_q12/datafusion:vortex-compact 39577458 37627225 1.05
tpcds_q13/datafusion:vortex-compact 🚨 237302053 140880678 1.68
tpcds_q14/datafusion:vortex-compact 🚨 317004839 263694256 1.20
tpcds_q15/datafusion:vortex-compact 54686408 51664224 1.06
tpcds_q16/datafusion:vortex-compact 🚨 52819803 41189507 1.28
tpcds_q17/datafusion:vortex-compact 137385482 126594235 1.09
tpcds_q18/datafusion:vortex-compact 🚨 131748092 113191255 1.16
tpcds_q19/datafusion:vortex-compact 65587878 61772099 1.06
tpcds_q20/datafusion:vortex-compact 🚨 47934108 43403556 1.10
tpcds_q21/datafusion:vortex-compact 181564568 182617465 0.99
tpcds_q22/datafusion:vortex-compact 83975248 79068407 1.06
tpcds_q23/datafusion:vortex-compact 253301203 234705776 1.08
tpcds_q24/datafusion:vortex-compact 216231815 219912716 0.98
tpcds_q25/datafusion:vortex-compact 135187769 127922767 1.06
tpcds_q26/datafusion:vortex-compact 75592292 69849926 1.08
tpcds_q27/datafusion:vortex-compact 218319254 210453341 1.04
tpcds_q28/datafusion:vortex-compact 🚨 487387011 102331845 4.76
tpcds_q29/datafusion:vortex-compact 🚨 140730172 126919456 1.11
tpcds_q30/datafusion:vortex-compact 36053766 37570635 0.96
tpcds_q31/datafusion:vortex-compact 221645101 206046681 1.08
tpcds_q32/datafusion:vortex-compact 🚨 37386686 30229079 1.24
tpcds_q33/datafusion:vortex-compact 🚨 59885173 51041180 1.17
tpcds_q34/datafusion:vortex-compact 60197147 57486815 1.05
tpcds_q35/datafusion:vortex-compact 🚨 86170862 74243590 1.16
tpcds_q36/datafusion:vortex-compact 136418402 127056403 1.07
tpcds_q37/datafusion:vortex-compact 🚨 64755151 51847847 1.25
tpcds_q38/datafusion:vortex-compact 108726010 100493488 1.08
tpcds_q39/datafusion:vortex-compact 215259901 208123178 1.03
tpcds_q40/datafusion:vortex-compact 🚨 68563656 60283401 1.14
tpcds_q41/datafusion:vortex-compact 🚨 17215745 14845288 1.16
tpcds_q42/datafusion:vortex-compact 🚨 38913560 32472376 1.20
tpcds_q43/datafusion:vortex-compact 56214956 57121167 0.98
tpcds_q44/datafusion:vortex-compact 🚨 96436918 70982060 1.36
tpcds_q45/datafusion:vortex-compact 55768476 51792740 1.08
tpcds_q46/datafusion:vortex-compact 99365921 91246082 1.09
tpcds_q47/datafusion:vortex-compact 311595372 301233109 1.03
tpcds_q48/datafusion:vortex-compact 🚨 192985459 108681836 1.78
tpcds_q49/datafusion:vortex-compact 🚨 194715269 98003844 1.99
tpcds_q50/datafusion:vortex-compact 95949638 92399651 1.04
tpcds_q51/datafusion:vortex-compact 🚨 121342490 98591008 1.23
tpcds_q52/datafusion:vortex-compact 🚨 39828342 35307355 1.13
tpcds_q53/datafusion:vortex-compact 41057241 41118042 1.00
tpcds_q54/datafusion:vortex-compact 🚨 77370651 64905683 1.19
tpcds_q55/datafusion:vortex-compact 39372952 37550009 1.05
tpcds_q56/datafusion:vortex-compact 🚨 69612600 58171803 1.20
tpcds_q57/datafusion:vortex-compact 204137385 192932272 1.06
tpcds_q58/datafusion:vortex-compact 124673860 116131955 1.07
tpcds_q59/datafusion:vortex-compact 🚨 117606550 106364522 1.11
tpcds_q60/datafusion:vortex-compact 🚨 67843224 57088420 1.19
tpcds_q61/datafusion:vortex-compact 🚨 98279101 82149366 1.20
tpcds_q62/datafusion:vortex-compact 48844947 46562707 1.05
tpcds_q63/datafusion:vortex-compact 🚨 42593361 38525498 1.11
tpcds_q64/datafusion:vortex-compact 822422692 774125857 1.06
tpcds_q65/datafusion:vortex-compact 🚨 87509922 70044863 1.25
tpcds_q66/datafusion:vortex-compact 123332750 115588309 1.07
tpcds_q67/datafusion:vortex-compact 160927662 152750631 1.05
tpcds_q68/datafusion:vortex-compact 🚨 100742137 90024943 1.12
tpcds_q69/datafusion:vortex-compact 🚨 72624309 62318088 1.17
tpcds_q70/datafusion:vortex-compact 151567365 142695593 1.06
tpcds_q71/datafusion:vortex-compact 🚨 65683205 44378744 1.48
tpcds_q72/datafusion:vortex-compact 3657814466 3335075350 1.10
tpcds_q73/datafusion:vortex-compact 59911784 56444904 1.06
tpcds_q74/datafusion:vortex-compact 197207291 182575184 1.08
tpcds_q75/datafusion:vortex-compact 🚨 225992225 173234748 1.30
tpcds_q76/datafusion:vortex-compact 81676548 77447991 1.05
tpcds_q77/datafusion:vortex-compact 73679946 67280592 1.10
tpcds_q78/datafusion:vortex-compact 🚨 254999411 202702047 1.26
tpcds_q79/datafusion:vortex-compact 🚨 79766537 66067883 1.21
tpcds_q80/datafusion:vortex-compact 🚨 184932179 138772292 1.33
tpcds_q81/datafusion:vortex-compact 🚨 47151001 40999138 1.15
tpcds_q82/datafusion:vortex-compact 🚨 64822470 52495615 1.23
tpcds_q83/datafusion:vortex-compact 69116852 63372936 1.09
tpcds_q84/datafusion:vortex-compact 19145601 17759476 1.08
tpcds_q85/datafusion:vortex-compact 🚨 256312573 156845173 1.63
tpcds_q86/datafusion:vortex-compact 33654269 32492910 1.04
tpcds_q87/datafusion:vortex-compact 108011051 103014818 1.05
tpcds_q88/datafusion:vortex-compact 🚨 162414550 133939653 1.21
tpcds_q89/datafusion:vortex-compact 69998891 63855054 1.10
tpcds_q90/datafusion:vortex-compact 🚨 30515345 21667273 1.41
tpcds_q91/datafusion:vortex-compact 🚨 44216195 40164260 1.10
tpcds_q92/datafusion:vortex-compact 🚨 30352980 21055798 1.44
tpcds_q93/datafusion:vortex-compact 🚨 65440277 51775171 1.26
tpcds_q94/datafusion:vortex-compact 🚨 44543236 31619900 1.41
tpcds_q95/datafusion:vortex-compact 🚨 115931282 96593083 1.20
tpcds_q96/datafusion:vortex-compact 🚨 27830297 24331407 1.14
tpcds_q97/datafusion:vortex-compact 🚨 55728959 41760704 1.33
tpcds_q98/datafusion:vortex-compact 59629813 54906663 1.09
tpcds_q99/datafusion:vortex-compact 67943782 65662048 1.03
datafusion / parquet (1.050x ➖, 0↑ 9↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 🚨 40065534 35679982 1.12
tpcds_q02/datafusion:parquet 55780673 53841528 1.04
tpcds_q03/datafusion:parquet 16900129 17990584 0.94
tpcds_q04/datafusion:parquet 378130141 366430750 1.03
tpcds_q05/datafusion:parquet 93211844 90095403 1.03
tpcds_q06/datafusion:parquet 93841483 90407871 1.04
tpcds_q07/datafusion:parquet 143442280 132712963 1.08
tpcds_q08/datafusion:parquet 42233851 38488644 1.10
tpcds_q09/datafusion:parquet 55215085 53342256 1.04
tpcds_q10/datafusion:parquet 107989435 100561401 1.07
tpcds_q11/datafusion:parquet 226988389 215692849 1.05
tpcds_q12/datafusion:parquet 30040700 29845913 1.01
tpcds_q13/datafusion:parquet 138983272 142236293 0.98
tpcds_q14/datafusion:parquet 221064834 211722083 1.04
tpcds_q15/datafusion:parquet 56132154 54654979 1.03
tpcds_q16/datafusion:parquet 33347855 31873434 1.05
tpcds_q17/datafusion:parquet 174901514 176816227 0.99
tpcds_q18/datafusion:parquet 182941885 174690581 1.05
tpcds_q19/datafusion:parquet 36444711 35970443 1.01
tpcds_q20/datafusion:parquet 25666551 24174634 1.06
tpcds_q21/datafusion:parquet 🚨 30532378 26882277 1.14
tpcds_q22/datafusion:parquet 157485398 151869207 1.04
tpcds_q23/datafusion:parquet 197159034 182779916 1.08
tpcds_q24/datafusion:parquet 218902174 212859435 1.03
tpcds_q25/datafusion:parquet 176764262 177485074 1.00
tpcds_q26/datafusion:parquet 121949927 117930976 1.03
tpcds_q27/datafusion:parquet 271313562 254799148 1.06
tpcds_q28/datafusion:parquet 53003739 51652034 1.03
tpcds_q29/datafusion:parquet 180419875 183013243 0.99
tpcds_q30/datafusion:parquet 46359714 44558301 1.04
tpcds_q31/datafusion:parquet 109774667 103297773 1.06
tpcds_q32/datafusion:parquet 30665960 28783752 1.07
tpcds_q33/datafusion:parquet 38878800 36265305 1.07
tpcds_q34/datafusion:parquet 🚨 39558111 35112076 1.13
tpcds_q35/datafusion:parquet 102792201 94696603 1.09
tpcds_q36/datafusion:parquet 87354256 81797553 1.07
tpcds_q37/datafusion:parquet 27295695 25528917 1.07
tpcds_q38/datafusion:parquet 🚨 67133714 60835137 1.10
tpcds_q39/datafusion:parquet 106504642 98991169 1.08
tpcds_q40/datafusion:parquet 36915848 34513496 1.07
tpcds_q41/datafusion:parquet 13201627 12912014 1.02
tpcds_q42/datafusion:parquet 16514066 15108989 1.09
tpcds_q43/datafusion:parquet 27542911 26633839 1.03
tpcds_q44/datafusion:parquet 42936891 39697552 1.08
tpcds_q45/datafusion:parquet 68675559 66617292 1.03
tpcds_q46/datafusion:parquet 52340666 52507867 1.00
tpcds_q47/datafusion:parquet 196866400 187654489 1.05
tpcds_q48/datafusion:parquet 137536847 129828294 1.06
tpcds_q49/datafusion:parquet 77169707 73188432 1.05
tpcds_q50/datafusion:parquet 114569976 108348174 1.06
tpcds_q51/datafusion:parquet 103801005 94959228 1.09
tpcds_q52/datafusion:parquet 16293744 15214389 1.07
tpcds_q53/datafusion:parquet 32862969 31034624 1.06
tpcds_q54/datafusion:parquet 49896353 48695093 1.02
tpcds_q55/datafusion:parquet 🚨 17481579 15202531 1.15
tpcds_q56/datafusion:parquet 37506231 36457498 1.03
tpcds_q57/datafusion:parquet 146739934 141876537 1.03
tpcds_q58/datafusion:parquet 73851496 73655800 1.00
tpcds_q59/datafusion:parquet 67515645 69106699 0.98
tpcds_q60/datafusion:parquet 38108825 36552564 1.04
tpcds_q61/datafusion:parquet 67818487 66388378 1.02
tpcds_q62/datafusion:parquet 42783357 40696490 1.05
tpcds_q63/datafusion:parquet 32120984 30978909 1.04
tpcds_q64/datafusion:parquet 1017346721 999002284 1.02
tpcds_q65/datafusion:parquet 51578401 50768284 1.02
tpcds_q66/datafusion:parquet 92446658 90487054 1.02
tpcds_q67/datafusion:parquet 188442770 171865976 1.10
tpcds_q68/datafusion:parquet 51629549 50226260 1.03
tpcds_q69/datafusion:parquet 99347154 92400520 1.08
tpcds_q70/datafusion:parquet 113459844 108637577 1.04
tpcds_q71/datafusion:parquet 30388371 28723722 1.06
tpcds_q72/datafusion:parquet 912878114 851547645 1.07
tpcds_q73/datafusion:parquet 39327754 37746311 1.04
tpcds_q74/datafusion:parquet 134419915 127278008 1.06
tpcds_q75/datafusion:parquet 138091346 128638089 1.07
tpcds_q76/datafusion:parquet 95607214 89790058 1.06
tpcds_q77/datafusion:parquet 61611426 57875028 1.06
tpcds_q78/datafusion:parquet 190946844 182378487 1.05
tpcds_q79/datafusion:parquet 🚨 44298152 39503854 1.12
tpcds_q80/datafusion:parquet 117519600 111880199 1.05
tpcds_q81/datafusion:parquet 45777706 43066047 1.06
tpcds_q82/datafusion:parquet 30028199 29177475 1.03
tpcds_q83/datafusion:parquet 56019580 54760656 1.02
tpcds_q84/datafusion:parquet 49405946 48502342 1.02
tpcds_q85/datafusion:parquet 246644275 241403531 1.02
tpcds_q86/datafusion:parquet 22832102 21047422 1.08
tpcds_q87/datafusion:parquet 67098730 64842286 1.03
tpcds_q88/datafusion:parquet 80929557 77920347 1.04
tpcds_q89/datafusion:parquet 🚨 40189094 35523705 1.13
tpcds_q90/datafusion:parquet 20146799 18773330 1.07
tpcds_q91/datafusion:parquet 79349766 79450913 1.00
tpcds_q92/datafusion:parquet 🚨 27997702 25181197 1.11
tpcds_q93/datafusion:parquet 42620635 39055290 1.09
tpcds_q94/datafusion:parquet 29680378 28722992 1.03
tpcds_q95/datafusion:parquet 138403629 133048414 1.04
tpcds_q96/datafusion:parquet 🚨 15968516 14424389 1.11
tpcds_q97/datafusion:parquet 37438770 36811480 1.02
tpcds_q98/datafusion:parquet 37778735 36300545 1.04
tpcds_q99/datafusion:parquet 46125452 45218594 1.02
duckdb / vortex-file-compressed (1.082x ➖, 2↑ 21↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 26930940 27381708 0.98
tpcds_q02/duckdb:vortex-file-compressed 87637968 90103594 0.97
tpcds_q03/duckdb:vortex-file-compressed 🚨 159632197 24424322 6.54
tpcds_q04/duckdb:vortex-file-compressed 112074881 120538522 0.93
tpcds_q05/duckdb:vortex-file-compressed 99970259 100503423 0.99
tpcds_q06/duckdb:vortex-file-compressed 37168060 35075491 1.06
tpcds_q07/duckdb:vortex-file-compressed 25736582 23952267 1.07
tpcds_q08/duckdb:vortex-file-compressed 25835204 23671727 1.09
tpcds_q09/duckdb:vortex-file-compressed 🚨 71430949 39601910 1.80
tpcds_q10/duckdb:vortex-file-compressed 39284097 37060958 1.06
tpcds_q11/duckdb:vortex-file-compressed 63290122 59541708 1.06
tpcds_q12/duckdb:vortex-file-compressed 15292013 14600743 1.05
tpcds_q13/duckdb:vortex-file-compressed 33231618 32085966 1.04
tpcds_q14/duckdb:vortex-file-compressed 200213548 199837650 1.00
tpcds_q15/duckdb:vortex-file-compressed 43239924 41880733 1.03
tpcds_q16/duckdb:vortex-file-compressed 29882105 31055813 0.96
tpcds_q17/duckdb:vortex-file-compressed 38852768 37958189 1.02
tpcds_q18/duckdb:vortex-file-compressed 48456701 45453043 1.07
tpcds_q19/duckdb:vortex-file-compressed 🚨 34867429 31530995 1.11
tpcds_q20/duckdb:vortex-file-compressed 🚨 17151911 15046388 1.14
tpcds_q21/duckdb:vortex-file-compressed 20491580 20379786 1.01
tpcds_q22/duckdb:vortex-file-compressed 🚨 117913132 106972251 1.10
tpcds_q23/duckdb:vortex-file-compressed 🚨 138638794 125793658 1.10
tpcds_q24/duckdb:vortex-file-compressed 59152801 54933986 1.08
tpcds_q25/duckdb:vortex-file-compressed 39288199 36855262 1.07
tpcds_q26/duckdb:vortex-file-compressed 40897360 38550816 1.06
tpcds_q27/duckdb:vortex-file-compressed 91590719 87911727 1.04
tpcds_q28/duckdb:vortex-file-compressed 🚨 63076474 37656177 1.68
tpcds_q29/duckdb:vortex-file-compressed 🚨 39851740 36165407 1.10
tpcds_q30/duckdb:vortex-file-compressed 30570245 29667752 1.03
tpcds_q31/duckdb:vortex-file-compressed 24596231 24977519 0.98
tpcds_q32/duckdb:vortex-file-compressed 17194134 16598049 1.04
tpcds_q33/duckdb:vortex-file-compressed 71780447 65683602 1.09
tpcds_q34/duckdb:vortex-file-compressed 🚨 20782344 18839827 1.10
tpcds_q35/duckdb:vortex-file-compressed 67744692 62677808 1.08
tpcds_q36/duckdb:vortex-file-compressed 28074656 27246040 1.03
tpcds_q37/duckdb:vortex-file-compressed 23685597 22589319 1.05
tpcds_q38/duckdb:vortex-file-compressed 36825360 36208351 1.02
tpcds_q39/duckdb:vortex-file-compressed 48227389 47238363 1.02
tpcds_q40/duckdb:vortex-file-compressed 24189854 23819100 1.02
tpcds_q41/duckdb:vortex-file-compressed 🚨 14472184 13031058 1.11
tpcds_q42/duckdb:vortex-file-compressed 12018655 11384570 1.06
tpcds_q43/duckdb:vortex-file-compressed 21187685 20351862 1.04
tpcds_q44/duckdb:vortex-file-compressed 26400790 24030629 1.10
tpcds_q45/duckdb:vortex-file-compressed 28424626 27311960 1.04
tpcds_q46/duckdb:vortex-file-compressed 49869518 46924237 1.06
tpcds_q47/duckdb:vortex-file-compressed 52691490 53289290 0.99
tpcds_q48/duckdb:vortex-file-compressed 31465325 33586051 0.94
tpcds_q49/duckdb:vortex-file-compressed 32155507 32662049 0.98
tpcds_q50/duckdb:vortex-file-compressed 36989399 38743322 0.95
tpcds_q51/duckdb:vortex-file-compressed 🚨 126056551 102691481 1.23
tpcds_q52/duckdb:vortex-file-compressed 12442482 12214393 1.02
tpcds_q53/duckdb:vortex-file-compressed 17551196 17988433 0.98
tpcds_q54/duckdb:vortex-file-compressed 51546659 48569909 1.06
tpcds_q55/duckdb:vortex-file-compressed 🚨 12375746 11021555 1.12
tpcds_q56/duckdb:vortex-file-compressed 68637364 62680374 1.10
tpcds_q57/duckdb:vortex-file-compressed 45108649 44452716 1.01
tpcds_q58/duckdb:vortex-file-compressed 35445886 33958461 1.04
tpcds_q59/duckdb:vortex-file-compressed 60034592 56548586 1.06
tpcds_q60/duckdb:vortex-file-compressed 74048595 68805493 1.08
tpcds_q61/duckdb:vortex-file-compressed 🚨 39520427 35676426 1.11
tpcds_q62/duckdb:vortex-file-compressed 🚀 19343940 21615598 0.89
tpcds_q63/duckdb:vortex-file-compressed 🚨 19772348 17641718 1.12
tpcds_q64/duckdb:vortex-file-compressed 84674724 80629223 1.05
tpcds_q65/duckdb:vortex-file-compressed 24712113 23372273 1.06
tpcds_q66/duckdb:vortex-file-compressed 🚨 61185728 54521008 1.12
tpcds_q67/duckdb:vortex-file-compressed 153300686 149661034 1.02
tpcds_q68/duckdb:vortex-file-compressed 41801120 41189683 1.01
tpcds_q69/duckdb:vortex-file-compressed 39970895 38299034 1.04
tpcds_q70/duckdb:vortex-file-compressed 26447519 24267304 1.09
tpcds_q71/duckdb:vortex-file-compressed 🚨 21574277 19231450 1.12
tpcds_q72/duckdb:vortex-file-compressed 181085145 179136030 1.01
tpcds_q73/duckdb:vortex-file-compressed 20364080 19115905 1.07
tpcds_q74/duckdb:vortex-file-compressed 52428440 50362499 1.04
tpcds_q75/duckdb:vortex-file-compressed 64171986 60468634 1.06
tpcds_q76/duckdb:vortex-file-compressed 🚨 62655376 56673280 1.11
tpcds_q77/duckdb:vortex-file-compressed 67846090 62038478 1.09
tpcds_q78/duckdb:vortex-file-compressed 83751349 76684646 1.09
tpcds_q79/duckdb:vortex-file-compressed 🚨 48095414 34235156 1.40
tpcds_q80/duckdb:vortex-file-compressed 🚨 103029379 90329886 1.14
tpcds_q81/duckdb:vortex-file-compressed 34756251 34251121 1.01
tpcds_q82/duckdb:vortex-file-compressed 23062980 22105247 1.04
tpcds_q83/duckdb:vortex-file-compressed 29395239 28226427 1.04
tpcds_q84/duckdb:vortex-file-compressed 19102136 17622547 1.08
tpcds_q85/duckdb:vortex-file-compressed 47826315 43649868 1.10
tpcds_q86/duckdb:vortex-file-compressed 🚨 18497300 16733739 1.11
tpcds_q87/duckdb:vortex-file-compressed 41259381 42777099 0.96
tpcds_q88/duckdb:vortex-file-compressed 42844233 39764308 1.08
tpcds_q89/duckdb:vortex-file-compressed 19031430 18400701 1.03
tpcds_q90/duckdb:vortex-file-compressed 15979646 15357095 1.04
tpcds_q91/duckdb:vortex-file-compressed 28871085 26291381 1.10
tpcds_q92/duckdb:vortex-file-compressed 14927439 14155086 1.05
tpcds_q93/duckdb:vortex-file-compressed 31488457 31260704 1.01
tpcds_q94/duckdb:vortex-file-compressed 23392021 22352102 1.05
tpcds_q95/duckdb:vortex-file-compressed 🚀 146364709 163035212 0.90
tpcds_q96/duckdb:vortex-file-compressed 🚨 19193873 17157024 1.12
tpcds_q97/duckdb:vortex-file-compressed 41084542 38654509 1.06
tpcds_q98/duckdb:vortex-file-compressed 19698271 18761139 1.05
tpcds_q99/duckdb:vortex-file-compressed 34134776 32943709 1.04
duckdb / vortex-compact (1.057x ➖, 0↑ 7↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 35724985 34236124 1.04
tpcds_q02/duckdb:vortex-compact 128054282 123240400 1.04
tpcds_q03/duckdb:vortex-compact 🚨 172962270 51080756 3.39
tpcds_q04/duckdb:vortex-compact 126681253 126356050 1.00
tpcds_q05/duckdb:vortex-compact 185705104 170202013 1.09
tpcds_q06/duckdb:vortex-compact 43038782 40019765 1.08
tpcds_q07/duckdb:vortex-compact 39997184 37679216 1.06
tpcds_q08/duckdb:vortex-compact 29473813 28748600 1.03
tpcds_q09/duckdb:vortex-compact 🚨 138513404 109885928 1.26
tpcds_q10/duckdb:vortex-compact 50721698 49777834 1.02
tpcds_q11/duckdb:vortex-compact 81285402 83524128 0.97
tpcds_q12/duckdb:vortex-compact 21849999 20812784 1.05
tpcds_q13/duckdb:vortex-compact 55990084 54759641 1.02
tpcds_q14/duckdb:vortex-compact 298256772 282511632 1.06
tpcds_q15/duckdb:vortex-compact 47463898 45086264 1.05
tpcds_q16/duckdb:vortex-compact 39996970 37432140 1.07
tpcds_q17/duckdb:vortex-compact 54116706 50689622 1.07
tpcds_q18/duckdb:vortex-compact 68677002 64556938 1.06
tpcds_q19/duckdb:vortex-compact 42188691 41984516 1.00
tpcds_q20/duckdb:vortex-compact 21732915 21353969 1.02
tpcds_q21/duckdb:vortex-compact 28303435 27847925 1.02
tpcds_q22/duckdb:vortex-compact 123564078 116829744 1.06
tpcds_q23/duckdb:vortex-compact 183978070 172284946 1.07
tpcds_q24/duckdb:vortex-compact 81126183 75451789 1.08
tpcds_q25/duckdb:vortex-compact 53302463 52295081 1.02
tpcds_q26/duckdb:vortex-compact 51510453 53268454 0.97
tpcds_q27/duckdb:vortex-compact 148132979 142523041 1.04
tpcds_q28/duckdb:vortex-compact 🚨 132650725 106764392 1.24
tpcds_q29/duckdb:vortex-compact 53063001 51969467 1.02
tpcds_q30/duckdb:vortex-compact 36843087 34330162 1.07
tpcds_q31/duckdb:vortex-compact 31733270 31819310 1.00
tpcds_q32/duckdb:vortex-compact 24309165 24382463 1.00
tpcds_q33/duckdb:vortex-compact 148335524 147828729 1.00
tpcds_q34/duckdb:vortex-compact 30514478 30337989 1.01
tpcds_q35/duckdb:vortex-compact 75669865 71878068 1.05
tpcds_q36/duckdb:vortex-compact 35150358 34799862 1.01
tpcds_q37/duckdb:vortex-compact 32130248 30689394 1.05
tpcds_q38/duckdb:vortex-compact 41195362 39852703 1.03
tpcds_q39/duckdb:vortex-compact 56902884 53414723 1.07
tpcds_q40/duckdb:vortex-compact 32704728 31272387 1.05
tpcds_q41/duckdb:vortex-compact 🚨 18181596 16460805 1.10
tpcds_q42/duckdb:vortex-compact 14788135 15123844 0.98
tpcds_q43/duckdb:vortex-compact 25611750 24126280 1.06
tpcds_q44/duckdb:vortex-compact 35419319 35109435 1.01
tpcds_q45/duckdb:vortex-compact 35973759 33218644 1.08
tpcds_q46/duckdb:vortex-compact 64011451 60396872 1.06
tpcds_q47/duckdb:vortex-compact 57997044 54845531 1.06
tpcds_q48/duckdb:vortex-compact 47719602 45206021 1.06
tpcds_q49/duckdb:vortex-compact 50214129 46266151 1.09
tpcds_q50/duckdb:vortex-compact 59463231 54317199 1.09
tpcds_q51/duckdb:vortex-compact 108408002 106597664 1.02
tpcds_q52/duckdb:vortex-compact 15719131 15296464 1.03
tpcds_q53/duckdb:vortex-compact 23347737 23113985 1.01
tpcds_q54/duckdb:vortex-compact 91449698 88171212 1.04
tpcds_q55/duckdb:vortex-compact 14951946 16598849 0.90
tpcds_q56/duckdb:vortex-compact 149620410 142916364 1.05
tpcds_q57/duckdb:vortex-compact 51498490 51647749 1.00
tpcds_q58/duckdb:vortex-compact 40999202 40849507 1.00
tpcds_q59/duckdb:vortex-compact 71713102 67315980 1.07
tpcds_q60/duckdb:vortex-compact 152683479 148855746 1.03
tpcds_q61/duckdb:vortex-compact 54672030 55129036 0.99
tpcds_q62/duckdb:vortex-compact 22634657 22598058 1.00
tpcds_q63/duckdb:vortex-compact 24366144 23783941 1.02
tpcds_q64/duckdb:vortex-compact 112945527 107599915 1.05
tpcds_q65/duckdb:vortex-compact 29023681 28084514 1.03
tpcds_q66/duckdb:vortex-compact 103658590 100887913 1.03
tpcds_q67/duckdb:vortex-compact 162097440 150409667 1.08
tpcds_q68/duckdb:vortex-compact 59843072 57260467 1.05
tpcds_q69/duckdb:vortex-compact 51891339 48451996 1.07
tpcds_q70/duckdb:vortex-compact 29661110 29573894 1.00
tpcds_q71/duckdb:vortex-compact 🚨 29778485 25678317 1.16
tpcds_q72/duckdb:vortex-compact 205136283 197643932 1.04
tpcds_q73/duckdb:vortex-compact 29513716 29222236 1.01
tpcds_q74/duckdb:vortex-compact 62658700 59696191 1.05
tpcds_q75/duckdb:vortex-compact 72899092 68829295 1.06
tpcds_q76/duckdb:vortex-compact 140437853 137061938 1.02
tpcds_q77/duckdb:vortex-compact 144631388 135133315 1.07
tpcds_q78/duckdb:vortex-compact 93671337 87514453 1.07
tpcds_q79/duckdb:vortex-compact 🚨 73851244 61975250 1.19
tpcds_q80/duckdb:vortex-compact 177983455 169287460 1.05
tpcds_q81/duckdb:vortex-compact 41372757 39886532 1.04
tpcds_q82/duckdb:vortex-compact 32925144 32512144 1.01
tpcds_q83/duckdb:vortex-compact 47370367 44605983 1.06
tpcds_q84/duckdb:vortex-compact 22205246 20891071 1.06
tpcds_q85/duckdb:vortex-compact 62283557 61233498 1.02
tpcds_q86/duckdb:vortex-compact 20660810 19612413 1.05
tpcds_q87/duckdb:vortex-compact 43265945 44539550 0.97
tpcds_q88/duckdb:vortex-compact 46304443 43697743 1.06
tpcds_q89/duckdb:vortex-compact 24989564 24414132 1.02
tpcds_q90/duckdb:vortex-compact 17460934 15886431 1.10
tpcds_q91/duckdb:vortex-compact 47805163 44575710 1.07
tpcds_q92/duckdb:vortex-compact 20915395 21255038 0.98
tpcds_q93/duckdb:vortex-compact 40959189 38759104 1.06
tpcds_q94/duckdb:vortex-compact 28500141 26969232 1.06
tpcds_q95/duckdb:vortex-compact 🚨 166726104 147566319 1.13
tpcds_q96/duckdb:vortex-compact 18761786 18010992 1.04
tpcds_q97/duckdb:vortex-compact 45950291 44513043 1.03
tpcds_q98/duckdb:vortex-compact 24162838 22938592 1.05
tpcds_q99/duckdb:vortex-compact 36141722 35285949 1.02
duckdb / parquet (1.030x ➖, 1↑ 4↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 46493227 44922956 1.03
tpcds_q02/duckdb:parquet 🚨 62994295 57170748 1.10
tpcds_q03/duckdb:parquet 12409105 12075617 1.03
tpcds_q04/duckdb:parquet 129952179 126999080 1.02
tpcds_q05/duckdb:parquet 75085106 75310243 1.00
tpcds_q06/duckdb:parquet 29515772 27872602 1.06
tpcds_q07/duckdb:parquet 24329249 22881537 1.06
tpcds_q08/duckdb:parquet 28058226 27859620 1.01
tpcds_q09/duckdb:parquet 40654488 39237885 1.04
tpcds_q10/duckdb:parquet 35578996 36261892 0.98
tpcds_q11/duckdb:parquet 87966927 87018344 1.01
tpcds_q12/duckdb:parquet 15223274 14627613 1.04
tpcds_q13/duckdb:parquet 35298671 35175967 1.00
tpcds_q14/duckdb:parquet 163034155 167937456 0.97
tpcds_q15/duckdb:parquet 30719099 29779689 1.03
tpcds_q16/duckdb:parquet 22277634 21109919 1.06
tpcds_q17/duckdb:parquet 38564892 37740608 1.02
tpcds_q18/duckdb:parquet 45664791 46141532 0.99
tpcds_q19/duckdb:parquet 31207847 29225447 1.07
tpcds_q20/duckdb:parquet 15027044 15052774 1.00
tpcds_q21/duckdb:parquet 🚀 11209152 12504937 0.90
tpcds_q22/duckdb:parquet 71576768 66135867 1.08
tpcds_q23/duckdb:parquet 118517755 115624549 1.03
tpcds_q24/duckdb:parquet 46954663 44675621 1.05
tpcds_q25/duckdb:parquet 34597524 32520336 1.06
tpcds_q26/duckdb:parquet 36309161 36467058 1.00
tpcds_q27/duckdb:parquet 90188344 88564055 1.02
tpcds_q28/duckdb:parquet 37848687 37387664 1.01
tpcds_q29/duckdb:parquet 36381378 36202809 1.00
tpcds_q30/duckdb:parquet 40375044 39659546 1.02
tpcds_q31/duckdb:parquet 23938958 22613340 1.06
tpcds_q32/duckdb:parquet 11577506 11323134 1.02
tpcds_q33/duckdb:parquet 70752031 72869756 0.97
tpcds_q34/duckdb:parquet 21298171 20903785 1.02
tpcds_q35/duckdb:parquet 62454929 57775560 1.08
tpcds_q36/duckdb:parquet 20993425 20546067 1.02
tpcds_q37/duckdb:parquet 14030761 13907148 1.01
tpcds_q38/duckdb:parquet 34748373 32763361 1.06
tpcds_q39/duckdb:parquet 33560429 33308137 1.01
tpcds_q40/duckdb:parquet 18597779 17927351 1.04
tpcds_q41/duckdb:parquet 7775054 7766524 1.00
tpcds_q42/duckdb:parquet 10467622 9927464 1.05
tpcds_q43/duckdb:parquet 16235898 15899596 1.02
tpcds_q44/duckdb:parquet 21943153 21480995 1.02
tpcds_q45/duckdb:parquet 27311210 26215011 1.04
tpcds_q46/duckdb:parquet 46759825 44793767 1.04
tpcds_q47/duckdb:parquet 48259809 45993848 1.05
tpcds_q48/duckdb:parquet 31129671 30136861 1.03
tpcds_q49/duckdb:parquet 24474709 24078807 1.02
tpcds_q50/duckdb:parquet 25267572 24803459 1.02
tpcds_q51/duckdb:parquet 96969238 94994541 1.02
tpcds_q52/duckdb:parquet 11284270 10953691 1.03
tpcds_q53/duckdb:parquet 17221434 16404077 1.05
tpcds_q54/duckdb:parquet 🚨 41870933 38028825 1.10
tpcds_q55/duckdb:parquet 🚨 12365046 10721721 1.15
tpcds_q56/duckdb:parquet 69263866 69222256 1.00
tpcds_q57/duckdb:parquet 36122369 34493599 1.05
tpcds_q58/duckdb:parquet 21818539 21663624 1.01
tpcds_q59/duckdb:parquet 37230506 36977517 1.01
tpcds_q60/duckdb:parquet 74144738 73040219 1.02
tpcds_q61/duckdb:parquet 32813838 31183779 1.05
tpcds_q62/duckdb:parquet 12377855 11392656 1.09
tpcds_q63/duckdb:parquet 15911611 15486830 1.03
tpcds_q64/duckdb:parquet 75589476 73958913 1.02
tpcds_q65/duckdb:parquet 20403858 19696377 1.04
tpcds_q66/duckdb:parquet 63047008 60819474 1.04
tpcds_q67/duckdb:parquet 139047260 132613685 1.05
tpcds_q68/duckdb:parquet 38915664 37650549 1.03
tpcds_q69/duckdb:parquet 38089752 37589687 1.01
tpcds_q70/duckdb:parquet 19897578 19594118 1.02
tpcds_q71/duckdb:parquet 19424450 18757807 1.04
tpcds_q72/duckdb:parquet 164372217 164276954 1.00
tpcds_q73/duckdb:parquet 18717801 18358299 1.02
tpcds_q74/duckdb:parquet 52322511 48634813 1.08
tpcds_q75/duckdb:parquet 54638126 53617319 1.02
tpcds_q76/duckdb:parquet 69284772 74309839 0.93
tpcds_q77/duckdb:parquet 64639538 63932378 1.01
tpcds_q78/duckdb:parquet 74555740 72163303 1.03
tpcds_q79/duckdb:parquet 28270731 27414423 1.03
tpcds_q80/duckdb:parquet 88442428 83486974 1.06
tpcds_q81/duckdb:parquet 48186661 46762754 1.03
tpcds_q82/duckdb:parquet 15592014 15469958 1.01
tpcds_q83/duckdb:parquet 🚨 17869968 16230399 1.10
tpcds_q84/duckdb:parquet 19928079 19207299 1.04
tpcds_q85/duckdb:parquet 40662570 38274525 1.06
tpcds_q86/duckdb:parquet 12354863 12415217 1.00
tpcds_q87/duckdb:parquet 36891927 34915206 1.06
tpcds_q88/duckdb:parquet 30007201 29170587 1.03
tpcds_q89/duckdb:parquet 17962327 17159028 1.05
tpcds_q90/duckdb:parquet 7901216 7282668 1.08
tpcds_q91/duckdb:parquet 23554143 23725856 0.99
tpcds_q92/duckdb:parquet 11750452 11268054 1.04
tpcds_q93/duckdb:parquet 29678493 30598050 0.97
tpcds_q94/duckdb:parquet 16799120 16184272 1.04
tpcds_q95/duckdb:parquet 138011033 139762120 0.99
tpcds_q96/duckdb:parquet 9681927 9228443 1.05
tpcds_q97/duckdb:parquet 37102320 34297043 1.08
tpcds_q98/duckdb:parquet 18853572 18119291 1.04
tpcds_q99/duckdb:parquet 20371508 19787736 1.03
duckdb / duckdb (1.035x ➖, 1↑ 8↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 21465365 20106773 1.07
tpcds_q02/duckdb:duckdb 🚨 19912594 17972299 1.11
tpcds_q03/duckdb:duckdb 8771097 8005466 1.10
tpcds_q04/duckdb:duckdb 164789942 161416721 1.02
tpcds_q05/duckdb:duckdb 19225114 17977048 1.07
tpcds_q06/duckdb:duckdb 22720185 21939295 1.04
tpcds_q07/duckdb:duckdb 39191664 37978250 1.03
tpcds_q08/duckdb:duckdb 121065811 119515400 1.01
tpcds_q09/duckdb:duckdb 20235427 19910983 1.02
tpcds_q10/duckdb:duckdb 24843455 23438688 1.06
tpcds_q11/duckdb:duckdb 142819671 140413396 1.02
tpcds_q12/duckdb:duckdb 11788722 11871016 0.99
tpcds_q13/duckdb:duckdb 24642658 24439090 1.01
tpcds_q14/duckdb:duckdb 92932777 92043660 1.01
tpcds_q15/duckdb:duckdb 25389692 25524969 0.99
tpcds_q16/duckdb:duckdb 17539915 18625838 0.94
tpcds_q17/duckdb:duckdb 22580166 21983862 1.03
tpcds_q18/duckdb:duckdb 45914519 44125128 1.04
tpcds_q19/duckdb:duckdb 16624781 15718573 1.06
tpcds_q20/duckdb:duckdb 11472408 11482117 1.00
tpcds_q21/duckdb:duckdb 7044396 6870274 1.03
tpcds_q22/duckdb:duckdb 63367294 62068604 1.02
tpcds_q23/duckdb:duckdb 77961773 75016030 1.04
tpcds_q24/duckdb:duckdb 24331113 22260089 1.09
tpcds_q25/duckdb:duckdb 16781497 17833380 0.94
tpcds_q26/duckdb:duckdb 26743367 26542256 1.01
tpcds_q27/duckdb:duckdb 41802366 38737221 1.08
tpcds_q28/duckdb:duckdb 21235050 21600729 0.98
tpcds_q29/duckdb:duckdb 20458854 19907459 1.03
tpcds_q30/duckdb:duckdb 28801530 29276977 0.98
tpcds_q31/duckdb:duckdb 20630658 19704963 1.05
tpcds_q32/duckdb:duckdb 7056541 7074541 1.00
tpcds_q33/duckdb:duckdb 🚨 13390247 12116716 1.11
tpcds_q34/duckdb:duckdb 🚨 15441681 13924005 1.11
tpcds_q35/duckdb:duckdb 33970260 32633112 1.04
tpcds_q36/duckdb:duckdb 73326072 69428197 1.06
tpcds_q37/duckdb:duckdb 7582788 7851461 0.97
tpcds_q38/duckdb:duckdb 29556988 29104121 1.02
tpcds_q39/duckdb:duckdb 26166081 28704426 0.91
tpcds_q40/duckdb:duckdb 14588645 13879897 1.05
tpcds_q41/duckdb:duckdb 🚨 8608580 7644810 1.13
tpcds_q42/duckdb:duckdb 6759766 6327537 1.07
tpcds_q43/duckdb:duckdb 11338381 10741534 1.06
tpcds_q44/duckdb:duckdb 13943393 13308936 1.05
tpcds_q45/duckdb:duckdb 17033659 17197919 0.99
tpcds_q46/duckdb:duckdb 38104893 35854760 1.06
tpcds_q47/duckdb:duckdb 41634564 41222263 1.01
tpcds_q48/duckdb:duckdb 23477769 21715369 1.08
tpcds_q49/duckdb:duckdb 16329261 16402933 1.00
tpcds_q50/duckdb:duckdb 14944089 13866966 1.08
tpcds_q51/duckdb:duckdb 91816460 90248092 1.02
tpcds_q52/duckdb:duckdb 7383242 6991457 1.06
tpcds_q53/duckdb:duckdb 12019479 11542450 1.04
tpcds_q54/duckdb:duckdb 17020442 16621144 1.02
tpcds_q55/duckdb:duckdb 7105163 6636035 1.07
tpcds_q56/duckdb:duckdb 🚨 15061301 12776181 1.18
tpcds_q57/duckdb:duckdb 🚨 33996829 30788153 1.10
tpcds_q58/duckdb:duckdb 13233404 12736364 1.04
tpcds_q59/duckdb:duckdb 34723255 34232395 1.01
tpcds_q60/duckdb:duckdb 14858866 15458107 0.96
tpcds_q61/duckdb:duckdb 14508627 14539382 1.00
tpcds_q62/duckdb:duckdb 9528225 9020591 1.06
tpcds_q63/duckdb:duckdb 11756071 10755429 1.09
tpcds_q64/duckdb:duckdb 55059378 54602370 1.01
tpcds_q65/duckdb:duckdb 34573986 34506866 1.00
tpcds_q66/duckdb:duckdb 25636389 23449143 1.09
tpcds_q67/duckdb:duckdb 131970766 127879087 1.03
tpcds_q68/duckdb:duckdb 25515795 24255649 1.05
tpcds_q69/duckdb:duckdb 25149328 23426338 1.07
tpcds_q70/duckdb:duckdb 14696664 13820806 1.06
tpcds_q71/duckdb:duckdb 12685089 12973344 0.98
tpcds_q72/duckdb:duckdb 42972145 42446411 1.01
tpcds_q73/duckdb:duckdb 10916618 10761783 1.01
tpcds_q74/duckdb:duckdb 98930301 96583470 1.02
tpcds_q75/duckdb:duckdb 44463054 42243510 1.05
tpcds_q76/duckdb:duckdb 12228920 11611217 1.05
tpcds_q77/duckdb:duckdb 11830567 11533974 1.03
tpcds_q78/duckdb:duckdb 64507519 61744365 1.04
tpcds_q79/duckdb:duckdb 18477905 17786964 1.04
tpcds_q80/duckdb:duckdb 29741375 27281064 1.09
tpcds_q81/duckdb:duckdb 38266653 36602592 1.05
tpcds_q82/duckdb:duckdb 8392372 8141967 1.03
tpcds_q83/duckdb:duckdb 9490591 8884024 1.07
tpcds_q84/duckdb:duckdb 14088060 13692662 1.03
tpcds_q85/duckdb:duckdb 23947536 22819057 1.05
tpcds_q86/duckdb:duckdb 11008791 10296315 1.07
tpcds_q87/duckdb:duckdb 🚨 34941868 31244064 1.12
tpcds_q88/duckdb:duckdb 24187639 23763782 1.02
tpcds_q89/duckdb:duckdb 14201642 13579005 1.05
tpcds_q90/duckdb:duckdb 5706217 5355462 1.07
tpcds_q91/duckdb:duckdb 12737410 11596976 1.10
tpcds_q92/duckdb:duckdb 8707321 8510354 1.02
tpcds_q93/duckdb:duckdb 🚨 22451708 20250900 1.11
tpcds_q94/duckdb:duckdb 12323965 13449433 0.92
tpcds_q95/duckdb:duckdb 🚀 111450093 128123165 0.87
tpcds_q96/duckdb:duckdb 4556468 4435192 1.03
tpcds_q97/duckdb:duckdb 31048012 30009889 1.03
tpcds_q98/duckdb:duckdb 13525052 13036537 1.04
tpcds_q99/duckdb:duckdb 16802107 16596786 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +7.5% +7.8% -0.3% +12.4% ➖ noise
1 datafusion:vortex-file-compressed +49.4% +7.8% +38.6% +17.0% 🚨 regression
1 duckdb:duckdb +6.8% +7.8% -1.0% +17.7% ➖ noise
1 duckdb:vortex-compact +4.3% +7.8% -3.2% +12.1% ➖ noise
1 duckdb:vortex-file-compressed -1.6% +7.8% -8.8% +15.7% ➖ noise
2 datafusion:vortex-compact +7.2% +6.8% +0.3% +10.8% ➖ noise
2 datafusion:vortex-file-compressed +3.4% +6.8% -3.3% +10.3% ➖ noise
2 duckdb:duckdb +10.8% +6.8% +3.7% +11.8% ➖ noise
2 duckdb:vortex-compact +3.9% +6.8% -2.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.7% +6.8% -9.0% +13.0% ➖ noise
3 datafusion:vortex-compact +9.0% -1.7% +10.9% +13.3% ➖ noise
3 datafusion:vortex-file-compressed +3.3% -1.7% +5.1% +13.3% ➖ noise
3 duckdb:duckdb +9.6% -1.7% +11.5% +18.7% ➖ noise
3 duckdb:vortex-compact +238.6% -1.7% +244.6% +11.5% 🚨 regression
3 duckdb:vortex-file-compressed +553.6% -1.7% +565.2% +12.2% 🚨 regression
4 datafusion:vortex-compact +12.4% +2.8% +9.4% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +8.9% +2.8% +6.0% +10.0% ➖ noise
4 duckdb:duckdb +2.1% +2.8% -0.7% +10.0% ➖ noise
4 duckdb:vortex-compact +0.3% +2.8% -2.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -7.0% +2.8% -9.5% +10.0% ✅ faster
5 datafusion:vortex-compact +1.6% +1.6% +0.0% +10.7% ➖ noise
5 datafusion:vortex-file-compressed +9.1% +1.6% +7.5% +12.5% ➖ noise
5 duckdb:duckdb +6.9% +1.6% +5.3% +11.5% ➖ noise
5 duckdb:vortex-compact +9.1% +1.6% +7.4% +10.5% ➖ noise
5 duckdb:vortex-file-compressed -0.5% +1.6% -2.1% +16.0% ➖ noise
6 datafusion:vortex-compact +3.6% +4.8% -1.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +7.4% +4.8% +2.4% +10.0% ➖ noise
6 duckdb:duckdb +3.6% +4.8% -1.2% +15.2% ➖ noise
6 duckdb:vortex-compact +7.5% +4.8% +2.6% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +6.0% +4.8% +1.1% +10.0% ➖ noise
7 datafusion:vortex-compact +7.5% +7.2% +0.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +14.9% +7.2% +7.2% +10.0% ➖ noise
7 duckdb:duckdb +3.2% +7.2% -3.7% +17.4% ➖ noise
7 duckdb:vortex-compact +6.2% +7.2% -1.0% +12.5% ➖ noise
7 duckdb:vortex-file-compressed +7.4% +7.2% +0.2% +10.0% ➖ noise
8 datafusion:vortex-compact +9.3% +5.1% +4.0% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +10.2% +5.1% +4.9% +10.0% ➖ noise
8 duckdb:duckdb +1.3% +5.1% -3.6% +10.0% ➖ noise
8 duckdb:vortex-compact +2.5% +5.1% -2.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +9.1% +5.1% +3.8% +10.0% ➖ noise
9 datafusion:vortex-compact +293.0% +3.6% +279.5% +10.0% 🚨 regression
9 datafusion:vortex-file-compressed +655.5% +3.6% +629.5% +10.0% 🚨 regression
9 duckdb:duckdb +1.6% +3.6% -1.9% +10.0% ➖ noise
9 duckdb:vortex-compact +26.1% +3.6% +21.7% +10.0% 🚨 regression
9 duckdb:vortex-file-compressed +80.4% +3.6% +74.2% +10.0% 🚨 regression
10 datafusion:vortex-compact +12.6% +2.6% +9.6% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +27.6% +2.6% +24.3% +10.0% 🚨 regression
10 duckdb:duckdb +6.0% +2.6% +3.3% +10.0% ➖ noise
10 duckdb:vortex-compact +1.9% +2.6% -0.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +6.0% +2.6% +3.3% +10.0% ➖ noise
11 datafusion:vortex-compact +6.7% +3.1% +3.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.6% +3.1% +1.5% +10.0% ➖ noise
11 duckdb:duckdb +1.7% +3.1% -1.4% +10.0% ➖ noise
11 duckdb:vortex-compact -2.7% +3.1% -5.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +6.3% +3.1% +3.1% +10.0% ➖ noise
12 datafusion:vortex-compact +5.2% +2.3% +2.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +7.2% +2.3% +4.7% +10.0% ➖ noise
12 duckdb:duckdb -0.7% +2.3% -3.0% +12.3% ➖ noise
12 duckdb:vortex-compact +5.0% +2.3% +2.6% +15.3% ➖ noise
12 duckdb:vortex-file-compressed +4.7% +2.3% +2.3% +10.0% ➖ noise
13 datafusion:vortex-compact +68.4% -1.0% +70.1% +10.0% 🚨 regression
13 datafusion:vortex-file-compressed +135.2% -1.0% +137.5% +11.3% 🚨 regression
13 duckdb:duckdb +0.8% -1.0% +1.8% +10.0% ➖ noise
13 duckdb:vortex-compact +2.2% -1.0% +3.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.6% -1.0% +4.6% +10.0% ➖ noise
14 datafusion:vortex-compact +20.2% +0.7% +19.4% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +25.3% +0.7% +24.5% +10.0% 🚨 regression
14 duckdb:duckdb +1.0% +0.7% +0.3% +10.0% ➖ noise
14 duckdb:vortex-compact +5.6% +0.7% +4.9% +12.0% ➖ noise
14 duckdb:vortex-file-compressed +0.2% +0.7% -0.5% +10.0% ➖ noise
15 datafusion:vortex-compact +5.8% +2.9% +2.8% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +6.2% +2.9% +3.2% +10.0% ➖ noise
15 duckdb:duckdb -0.5% +2.9% -3.4% +15.6% ➖ noise
15 duckdb:vortex-compact +5.3% +2.9% +2.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.2% +2.9% +0.3% +11.0% ➖ noise
16 datafusion:vortex-compact +28.2% +5.1% +22.0% +10.0% 🚨 regression
16 datafusion:vortex-file-compressed +48.5% +5.1% +41.3% +10.0% 🚨 regression
16 duckdb:duckdb -5.8% +5.1% -10.4% +11.0% ✅ faster
16 duckdb:vortex-compact +6.9% +5.1% +1.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -3.8% +5.1% -8.4% +10.0% ➖ noise
17 datafusion:vortex-compact +8.5% +0.5% +7.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +15.3% +0.5% +14.6% +10.0% 🚨 regression
17 duckdb:duckdb +2.7% +0.5% +2.2% +13.5% ➖ noise
17 duckdb:vortex-compact +6.8% +0.5% +6.2% +10.8% ➖ noise
17 duckdb:vortex-file-compressed +2.4% +0.5% +1.8% +10.0% ➖ noise
18 datafusion:vortex-compact +16.4% +1.8% +14.3% +10.0% 🚨 regression
18 datafusion:vortex-file-compressed +14.6% +1.8% +12.6% +10.0% 🚨 regression
18 duckdb:duckdb +4.1% +1.8% +2.2% +10.7% ➖ noise
18 duckdb:vortex-compact +6.4% +1.8% +4.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +6.6% +1.8% +4.7% +10.0% ➖ noise
19 datafusion:vortex-compact +6.2% +4.0% +2.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +8.8% +4.0% +4.6% +10.0% ➖ noise
19 duckdb:duckdb +5.8% +4.0% +1.7% +12.2% ➖ noise
19 duckdb:vortex-compact +0.5% +4.0% -3.4% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +10.6% +4.0% +6.3% +11.4% ➖ noise
20 datafusion:vortex-compact +10.4% +3.0% +7.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +11.5% +3.0% +8.3% +10.9% ➖ noise
20 duckdb:duckdb -0.1% +3.0% -2.9% +10.6% ➖ noise
20 duckdb:vortex-compact +1.8% +3.0% -1.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +14.0% +3.0% +10.7% +14.9% ➖ noise
21 datafusion:vortex-compact -0.6% +0.9% -1.5% +11.9% ➖ noise
21 datafusion:vortex-file-compressed +0.6% +0.9% -0.3% +12.4% ➖ noise
21 duckdb:duckdb +2.5% +0.9% +1.6% +23.4% ➖ noise
21 duckdb:vortex-compact +1.6% +0.9% +0.7% +13.9% ➖ noise
21 duckdb:vortex-file-compressed +0.5% +0.9% -0.3% +16.9% ➖ noise
22 datafusion:vortex-compact +6.2% +5.9% +0.3% +12.3% ➖ noise
22 datafusion:vortex-file-compressed +8.1% +5.9% +2.0% +13.7% ➖ noise
22 duckdb:duckdb +2.1% +5.9% -3.6% +13.0% ➖ noise
22 duckdb:vortex-compact +5.8% +5.9% -0.2% +12.8% ➖ noise
22 duckdb:vortex-file-compressed +10.2% +5.9% +4.0% +11.5% ➖ noise
23 datafusion:vortex-compact +7.9% +5.2% +2.6% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +13.0% +5.2% +7.5% +10.0% ➖ noise
23 duckdb:duckdb +3.9% +5.2% -1.2% +16.0% ➖ noise
23 duckdb:vortex-compact +6.8% +5.2% +1.6% +12.5% ➖ noise
23 duckdb:vortex-file-compressed +10.2% +5.2% +4.8% +11.0% ➖ noise
24 datafusion:vortex-compact -1.7% +4.0% -5.4% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +5.8% +4.0% +1.8% +10.0% ➖ noise
24 duckdb:duckdb +9.3% +4.0% +5.1% +10.0% ➖ noise
24 duckdb:vortex-compact +7.5% +4.0% +3.4% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +7.7% +4.0% +3.6% +10.5% ➖ noise
25 datafusion:vortex-compact +5.7% +2.9% +2.7% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +10.8% +2.9% +7.7% +10.0% ➖ noise
25 duckdb:duckdb -5.9% +2.9% -8.6% +12.2% ➖ noise
25 duckdb:vortex-compact +1.9% +2.9% -1.0% +10.8% ➖ noise
25 duckdb:vortex-file-compressed +6.6% +2.9% +3.6% +10.0% ➖ noise
26 datafusion:vortex-compact +8.2% +1.5% +6.7% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +5.0% +1.5% +3.5% +10.2% ➖ noise
26 duckdb:duckdb +0.8% +1.5% -0.7% +10.0% ➖ noise
26 duckdb:vortex-compact -3.3% +1.5% -4.7% +12.7% ➖ noise
26 duckdb:vortex-file-compressed +6.1% +1.5% +4.6% +10.0% ➖ noise
27 datafusion:vortex-compact +3.7% +4.1% -0.4% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +8.5% +4.1% +4.2% +10.0% ➖ noise
27 duckdb:duckdb +7.9% +4.1% +3.6% +18.7% ➖ noise
27 duckdb:vortex-compact +3.9% +4.1% -0.2% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +4.2% +4.1% +0.1% +10.0% ➖ noise
28 datafusion:vortex-compact +376.3% +1.9% +367.3% +10.0% 🚨 regression
28 datafusion:vortex-file-compressed +845.8% +1.9% +827.9% +10.0% 🚨 regression
28 duckdb:duckdb -1.7% +1.9% -3.5% +22.6% ➖ noise
28 duckdb:vortex-compact +24.2% +1.9% +21.9% +10.0% 🚨 regression
28 duckdb:vortex-file-compressed +67.5% +1.9% +64.3% +10.0% 🚨 regression
29 datafusion:vortex-compact +10.9% -0.5% +11.4% +10.0% 🚨 regression
29 datafusion:vortex-file-compressed +20.3% -0.5% +20.8% +10.0% 🚨 regression
29 duckdb:duckdb +2.8% -0.5% +3.3% +10.0% ➖ noise
29 duckdb:vortex-compact +2.1% -0.5% +2.6% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +10.2% -0.5% +10.7% +13.7% ➖ noise
30 datafusion:vortex-compact -4.0% +2.9% -6.8% +18.0% ➖ noise
30 datafusion:vortex-file-compressed +0.6% +2.9% -2.3% +10.4% ➖ noise
30 duckdb:duckdb -1.6% +2.9% -4.4% +10.0% ➖ noise
30 duckdb:vortex-compact +7.3% +2.9% +4.3% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +3.0% +2.9% +0.1% +10.0% ➖ noise
31 datafusion:vortex-compact +7.6% +6.1% +1.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +7.0% +6.1% +0.8% +10.0% ➖ noise
31 duckdb:duckdb +4.7% +6.1% -1.3% +13.6% ➖ noise
31 duckdb:vortex-compact -0.3% +6.1% -6.0% +15.8% ➖ noise
31 duckdb:vortex-file-compressed -1.5% +6.1% -7.2% +10.0% ➖ noise
32 datafusion:vortex-compact +23.7% +4.4% +18.5% +13.9% 🚨 regression
32 datafusion:vortex-file-compressed +39.9% +4.4% +34.1% +12.7% 🚨 regression
32 duckdb:duckdb -0.3% +4.4% -4.4% +17.1% ➖ noise
32 duckdb:vortex-compact -0.3% +4.4% -4.5% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +3.6% +4.4% -0.7% +12.6% ➖ noise
33 datafusion:vortex-compact +17.3% +2.0% +15.0% +10.0% 🚨 regression
33 datafusion:vortex-file-compressed +24.4% +2.0% +21.9% +10.8% 🚨 regression
33 duckdb:duckdb +10.5% +2.0% +8.3% +12.4% ➖ noise
33 duckdb:vortex-compact +0.3% +2.0% -1.6% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +9.3% +2.0% +7.1% +10.6% ➖ noise
34 datafusion:vortex-compact +4.7% +7.1% -2.3% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +17.0% +7.1% +9.2% +10.0% ➖ noise
34 duckdb:duckdb +10.9% +7.1% +3.5% +11.0% ➖ noise
34 duckdb:vortex-compact +0.6% +7.1% -6.1% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +10.3% +7.1% +3.0% +12.9% ➖ noise
35 datafusion:vortex-compact +16.1% +8.3% +7.1% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +20.9% +8.3% +11.6% +10.0% 🚨 regression
35 duckdb:duckdb +4.1% +8.3% -3.9% +11.1% ➖ noise
35 duckdb:vortex-compact +5.3% +8.3% -2.8% +10.3% ➖ noise
35 duckdb:vortex-file-compressed +8.1% +8.3% -0.2% +10.0% ➖ noise
36 datafusion:vortex-compact +7.4% +4.5% +2.8% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +3.8% +4.5% -0.7% +10.0% ➖ noise
36 duckdb:duckdb +5.6% +4.5% +1.1% +10.0% ➖ noise
36 duckdb:vortex-compact +1.0% +4.5% -3.3% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +3.0% +4.5% -1.4% +10.0% ➖ noise
37 datafusion:vortex-compact +24.9% +3.9% +20.3% +10.6% 🚨 regression
37 datafusion:vortex-file-compressed +40.9% +3.9% +35.6% +10.3% 🚨 regression
37 duckdb:duckdb -3.4% +3.9% -7.0% +17.4% ➖ noise
37 duckdb:vortex-compact +4.7% +3.9% +0.8% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +4.9% +3.9% +1.0% +12.3% ➖ noise
38 datafusion:vortex-compact +8.2% +8.2% +0.0% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +7.3% +8.2% -0.8% +10.0% ➖ noise
38 duckdb:duckdb +1.6% +8.2% -6.1% +12.2% ➖ noise
38 duckdb:vortex-compact +3.4% +8.2% -4.5% +10.7% ➖ noise
38 duckdb:vortex-file-compressed +1.7% +8.2% -6.0% +16.0% ➖ noise
39 datafusion:vortex-compact +3.4% +4.1% -0.7% +15.5% ➖ noise
39 datafusion:vortex-file-compressed +4.6% +4.1% +0.5% +16.2% ➖ noise
39 duckdb:duckdb -8.8% +4.1% -12.4% +24.5% ➖ noise
39 duckdb:vortex-compact +6.5% +4.1% +2.3% +11.7% ➖ noise
39 duckdb:vortex-file-compressed +2.1% +4.1% -1.9% +18.5% ➖ noise
40 datafusion:vortex-compact +13.7% +5.3% +8.0% +13.6% ➖ noise
40 datafusion:vortex-file-compressed +25.7% +5.3% +19.4% +10.5% 🚨 regression
40 duckdb:duckdb +5.1% +5.3% -0.2% +15.9% ➖ noise
40 duckdb:vortex-compact +4.6% +5.3% -0.7% +12.2% ➖ noise
40 duckdb:vortex-file-compressed +1.6% +5.3% -3.6% +15.3% ➖ noise
41 datafusion:vortex-compact +16.0% +1.2% +14.6% +18.1% ➖ noise
41 datafusion:vortex-file-compressed +12.2% +1.2% +10.9% +16.9% ➖ noise
41 duckdb:duckdb +12.6% +1.2% +11.3% +11.4% ➖ noise
41 duckdb:vortex-compact +10.5% +1.2% +9.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +11.1% +1.2% +9.8% +10.0% ➖ noise
42 datafusion:vortex-compact +19.8% +7.4% +11.6% +18.1% ➖ noise
42 datafusion:vortex-file-compressed +3.9% +7.4% -3.2% +10.0% ➖ noise
42 duckdb:duckdb +6.8% +7.4% -0.5% +14.9% ➖ noise
42 duckdb:vortex-compact -2.2% +7.4% -8.9% +10.6% ➖ noise
42 duckdb:vortex-file-compressed +5.6% +7.4% -1.7% +18.3% ➖ noise
43 datafusion:vortex-compact -1.6% +2.8% -4.2% +10.3% ➖ noise
43 datafusion:vortex-file-compressed +1.5% +2.8% -1.2% +11.7% ➖ noise
43 duckdb:duckdb +5.6% +2.8% +2.7% +10.4% ➖ noise
43 duckdb:vortex-compact +6.2% +2.8% +3.3% +22.5% ➖ noise
43 duckdb:vortex-file-compressed +4.1% +2.8% +1.3% +10.0% ➖ noise
44 datafusion:vortex-compact +35.9% +5.1% +29.3% +12.2% 🚨 regression
44 datafusion:vortex-file-compressed +101.6% +5.1% +91.8% +12.9% 🚨 regression
44 duckdb:duckdb +4.8% +5.1% -0.3% +19.2% ➖ noise
44 duckdb:vortex-compact +0.9% +5.1% -4.0% +11.5% ➖ noise
44 duckdb:vortex-file-compressed +9.9% +5.1% +4.5% +13.9% ➖ noise
45 datafusion:vortex-compact +7.7% +3.6% +3.9% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +10.8% +3.6% +7.0% +10.0% ➖ noise
45 duckdb:duckdb -1.0% +3.6% -4.4% +11.7% ➖ noise
45 duckdb:vortex-compact +8.3% +3.6% +4.5% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +4.1% +3.6% +0.4% +10.0% ➖ noise
46 datafusion:vortex-compact +8.9% +2.0% +6.8% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +13.2% +2.0% +11.0% +11.3% ➖ noise
46 duckdb:duckdb +6.3% +2.0% +4.2% +24.3% ➖ noise
46 duckdb:vortex-compact +6.0% +2.0% +3.9% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +6.3% +2.0% +4.2% +10.0% ➖ noise
47 datafusion:vortex-compact +3.4% +4.9% -1.4% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +9.9% +4.9% +4.8% +10.0% ➖ noise
47 duckdb:duckdb +1.0% +4.9% -3.7% +10.0% ➖ noise
47 duckdb:vortex-compact +5.7% +4.9% +0.8% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -1.1% +4.9% -5.8% +11.9% ➖ noise
48 datafusion:vortex-compact +77.6% +4.6% +69.7% +14.2% 🚨 regression
48 datafusion:vortex-file-compressed +130.2% +4.6% +120.1% +11.7% 🚨 regression
48 duckdb:duckdb +8.1% +4.6% +3.4% +10.0% ➖ noise
48 duckdb:vortex-compact +5.6% +4.6% +0.9% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -6.3% +4.6% -10.4% +10.0% ✅ faster
49 datafusion:vortex-compact +98.7% +3.5% +91.9% +10.0% 🚨 regression
49 datafusion:vortex-file-compressed +136.5% +3.5% +128.4% +10.1% 🚨 regression
49 duckdb:duckdb -0.4% +3.5% -3.8% +11.2% ➖ noise
49 duckdb:vortex-compact +8.5% +3.5% +4.8% +10.0% ➖ noise
49 duckdb:vortex-file-compressed -1.6% +3.5% -4.9% +11.0% ➖ noise
50 datafusion:vortex-compact +3.8% +3.8% +0.1% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +7.5% +3.8% +3.6% +10.0% ➖ noise
50 duckdb:duckdb +7.8% +3.8% +3.8% +10.0% ➖ noise
50 duckdb:vortex-compact +9.5% +3.8% +5.5% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -4.5% +3.8% -8.0% +10.0% ➖ noise
51 datafusion:vortex-compact +23.1% +5.6% +16.5% +10.0% 🚨 regression
51 datafusion:vortex-file-compressed +20.9% +5.6% +14.4% +12.1% 🚨 regression
51 duckdb:duckdb +1.7% +5.6% -3.7% +10.0% ➖ noise
51 duckdb:vortex-compact +1.7% +5.6% -3.7% +16.2% ➖ noise
51 duckdb:vortex-file-compressed +22.8% +5.6% +16.2% +19.1% ➖ noise
52 datafusion:vortex-compact +12.8% +5.0% +7.4% +12.2% ➖ noise
52 datafusion:vortex-file-compressed +3.7% +5.0% -1.2% +13.0% ➖ noise
52 duckdb:duckdb +5.6% +5.0% +0.5% +16.3% ➖ noise
52 duckdb:vortex-compact +2.8% +5.0% -2.2% +14.9% ➖ noise
52 duckdb:vortex-file-compressed +1.9% +5.0% -3.0% +17.8% ➖ noise
53 datafusion:vortex-compact -0.1% +5.4% -5.3% +14.7% ➖ noise
53 datafusion:vortex-file-compressed +7.3% +5.4% +1.8% +10.4% ➖ noise
53 duckdb:duckdb +4.1% +5.4% -1.2% +11.3% ➖ noise
53 duckdb:vortex-compact +1.0% +5.4% -4.2% +10.0% ➖ noise
53 duckdb:vortex-file-compressed -2.4% +5.4% -7.5% +11.8% ➖ noise
54 datafusion:vortex-compact +19.2% +6.2% +12.2% +10.0% 🚨 regression
54 datafusion:vortex-file-compressed +33.3% +6.2% +25.5% +10.0% 🚨 regression
54 duckdb:duckdb +2.4% +6.2% -3.6% +12.1% ➖ noise
54 duckdb:vortex-compact +3.7% +6.2% -2.4% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +6.1% +6.2% -0.1% +11.3% ➖ noise
55 datafusion:vortex-compact +4.9% +15.2% -8.9% +14.8% ➖ noise
55 datafusion:vortex-file-compressed +9.7% +15.2% -4.8% +15.4% ➖ noise
55 duckdb:duckdb +7.1% +15.2% -7.0% +18.9% ➖ noise
55 duckdb:vortex-compact -9.9% +15.2% -21.8% +14.3% ✅ faster
55 duckdb:vortex-file-compressed +12.3% +15.2% -2.5% +16.2% ➖ noise
56 datafusion:vortex-compact +19.7% +1.5% +17.9% +10.0% 🚨 regression
56 datafusion:vortex-file-compressed +14.9% +1.5% +13.2% +15.2% ➖ noise
56 duckdb:duckdb +17.9% +1.5% +16.2% +16.2% ➖ noise
56 duckdb:vortex-compact +4.7% +1.5% +3.2% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +9.5% +1.5% +7.9% +10.2% ➖ noise
57 datafusion:vortex-compact +5.8% +4.1% +1.7% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +9.0% +4.1% +4.7% +10.0% ➖ noise
57 duckdb:duckdb +10.4% +4.1% +6.1% +11.6% ➖ noise
57 duckdb:vortex-compact -0.3% +4.1% -4.2% +16.1% ➖ noise
57 duckdb:vortex-file-compressed +1.5% +4.1% -2.5% +20.9% ➖ noise
58 datafusion:vortex-compact +7.4% +0.5% +6.8% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +7.0% +0.5% +6.5% +10.0% ➖ noise
58 duckdb:duckdb +3.9% +0.5% +3.4% +15.9% ➖ noise
58 duckdb:vortex-compact +0.4% +0.5% -0.1% +13.4% ➖ noise
58 duckdb:vortex-file-compressed +4.4% +0.5% +3.9% +16.6% ➖ noise
59 datafusion:vortex-compact +10.6% -0.8% +11.5% +10.0% 🚨 regression
59 datafusion:vortex-file-compressed +9.4% -0.8% +10.3% +10.0% 🚨 regression
59 duckdb:duckdb +1.4% -0.8% +2.3% +10.0% ➖ noise
59 duckdb:vortex-compact +6.5% -0.8% +7.4% +11.4% ➖ noise
59 duckdb:vortex-file-compressed +6.2% -0.8% +7.0% +10.0% ➖ noise
60 datafusion:vortex-compact +18.8% +2.9% +15.5% +10.6% 🚨 regression
60 datafusion:vortex-file-compressed +19.3% +2.9% +15.9% +14.7% 🚨 regression
60 duckdb:duckdb -3.9% +2.9% -6.6% +28.7% ➖ noise
60 duckdb:vortex-compact +2.6% +2.9% -0.3% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +7.6% +2.9% +4.6% +11.7% ➖ noise
61 datafusion:vortex-compact +19.6% +3.7% +15.4% +10.0% 🚨 regression
61 datafusion:vortex-file-compressed +12.4% +3.7% +8.4% +11.6% ➖ noise
61 duckdb:duckdb -0.2% +3.7% -3.8% +10.0% ➖ noise
61 duckdb:vortex-compact -0.8% +3.7% -4.3% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +10.8% +3.7% +6.8% +13.2% ➖ noise
62 datafusion:vortex-compact +4.9% +6.9% -1.8% +15.0% ➖ noise
62 datafusion:vortex-file-compressed +18.0% +6.9% +10.4% +14.9% ➖ noise
62 duckdb:duckdb +5.6% +6.9% -1.2% +15.4% ➖ noise
62 duckdb:vortex-compact +0.2% +6.9% -6.3% +25.1% ➖ noise
62 duckdb:vortex-file-compressed -10.5% +6.9% -16.3% +21.7% ➖ noise
63 datafusion:vortex-compact +10.6% +3.2% +7.1% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +12.1% +3.2% +8.6% +10.0% ➖ noise
63 duckdb:duckdb +9.3% +3.2% +5.9% +10.0% ➖ noise
63 duckdb:vortex-compact +2.4% +3.2% -0.7% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +12.1% +3.2% +8.6% +10.0% ➖ noise
64 datafusion:vortex-compact +6.2% +2.0% +4.1% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +5.7% +2.0% +3.6% +10.0% ➖ noise
64 duckdb:duckdb +0.8% +2.0% -1.2% +10.0% ➖ noise
64 duckdb:vortex-compact +5.0% +2.0% +2.9% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +5.0% +2.0% +2.9% +10.0% ➖ noise
65 datafusion:vortex-compact +24.9% +2.6% +21.8% +10.0% 🚨 regression
65 datafusion:vortex-file-compressed +32.3% +2.6% +29.0% +10.0% 🚨 regression
65 duckdb:duckdb +0.2% +2.6% -2.3% +12.9% ➖ noise
65 duckdb:vortex-compact +3.3% +2.6% +0.7% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +5.7% +2.6% +3.1% +20.6% ➖ noise
66 datafusion:vortex-compact +6.7% +2.9% +3.7% +15.2% ➖ noise
66 datafusion:vortex-file-compressed +7.6% +2.9% +4.6% +12.7% ➖ noise
66 duckdb:duckdb +9.3% +2.9% +6.2% +15.0% ➖ noise
66 duckdb:vortex-compact +2.7% +2.9% -0.2% +12.9% ➖ noise
66 duckdb:vortex-file-compressed +12.2% +2.9% +9.0% +15.9% ➖ noise
67 datafusion:vortex-compact +5.4% +7.2% -1.7% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +8.0% +7.2% +0.7% +10.0% ➖ noise
67 duckdb:duckdb +3.2% +7.2% -3.8% +10.0% ➖ noise
67 duckdb:vortex-compact +7.8% +7.2% +0.5% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +2.4% +7.2% -4.5% +10.0% ➖ noise
68 datafusion:vortex-compact +11.9% +3.1% +8.6% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +16.4% +3.1% +12.9% +10.0% 🚨 regression
68 duckdb:duckdb +5.2% +3.1% +2.1% +10.0% ➖ noise
68 duckdb:vortex-compact +4.5% +3.1% +1.4% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +1.5% +3.1% -1.5% +10.0% ➖ noise
69 datafusion:vortex-compact +16.5% +4.4% +11.6% +10.0% 🚨 regression
69 datafusion:vortex-file-compressed +30.5% +4.4% +25.0% +10.0% 🚨 regression
69 duckdb:duckdb +7.4% +4.4% +2.9% +10.0% ➖ noise
69 duckdb:vortex-compact +7.1% +4.4% +2.6% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +4.4% +4.4% -0.0% +10.0% ➖ noise
70 datafusion:vortex-compact +6.2% +3.0% +3.1% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +3.7% +3.0% +0.7% +10.0% ➖ noise
70 duckdb:duckdb +6.3% +3.0% +3.3% +13.2% ➖ noise
70 duckdb:vortex-compact +0.3% +3.0% -2.6% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +9.0% +3.0% +5.8% +10.6% ➖ noise
71 datafusion:vortex-compact +48.0% +4.7% +41.4% +10.7% 🚨 regression
71 datafusion:vortex-file-compressed +61.4% +4.7% +54.2% +11.7% 🚨 regression
71 duckdb:duckdb -2.2% +4.7% -6.6% +16.7% ➖ noise
71 duckdb:vortex-compact +16.0% +4.7% +10.8% +14.2% ➖ noise
71 duckdb:vortex-file-compressed +12.2% +4.7% +7.2% +15.5% ➖ noise
72 datafusion:vortex-compact +9.7% +3.6% +5.9% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +11.9% +3.6% +8.0% +10.0% ➖ noise
72 duckdb:duckdb +1.2% +3.6% -2.2% +15.0% ➖ noise
72 duckdb:vortex-compact +3.8% +3.6% +0.2% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +1.1% +3.6% -2.4% +10.0% ➖ noise
73 datafusion:vortex-compact +6.1% +3.1% +3.0% +20.0% ➖ noise
73 datafusion:vortex-file-compressed +9.9% +3.1% +6.7% +23.5% ➖ noise
73 duckdb:duckdb +1.4% +3.1% -1.6% +13.1% ➖ noise
73 duckdb:vortex-compact +1.0% +3.1% -2.0% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +6.5% +3.1% +3.4% +10.0% ➖ noise
74 datafusion:vortex-compact +8.0% +6.6% +1.3% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +6.5% +6.6% -0.1% +10.0% ➖ noise
74 duckdb:duckdb +2.4% +6.6% -3.9% +10.0% ➖ noise
74 duckdb:vortex-compact +5.0% +6.6% -1.5% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +4.1% +6.6% -2.3% +10.0% ➖ noise
75 datafusion:vortex-compact +30.5% +4.6% +24.7% +10.0% 🚨 regression
75 datafusion:vortex-file-compressed +49.2% +4.6% +42.7% +10.0% 🚨 regression
75 duckdb:duckdb +5.3% +4.6% +0.6% +10.0% ➖ noise
75 duckdb:vortex-compact +5.9% +4.6% +1.3% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +6.1% +4.6% +1.5% +10.8% ➖ noise
76 datafusion:vortex-compact +5.5% -0.4% +5.8% +10.8% ➖ noise
76 datafusion:vortex-file-compressed +9.2% -0.4% +9.6% +11.7% ➖ noise
76 duckdb:duckdb +5.3% -0.4% +5.7% +16.2% ➖ noise
76 duckdb:vortex-compact +2.5% -0.4% +2.8% +10.9% ➖ noise
76 duckdb:vortex-file-compressed +10.6% -0.4% +11.0% +20.7% ➖ noise
77 datafusion:vortex-compact +9.5% +3.7% +5.6% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +28.7% +3.7% +24.1% +10.0% 🚨 regression
77 duckdb:duckdb +2.6% +3.7% -1.1% +10.0% ➖ noise
77 duckdb:vortex-compact +7.0% +3.7% +3.2% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +9.4% +3.7% +5.4% +13.7% ➖ noise
78 datafusion:vortex-compact +25.8% +4.0% +21.0% +10.0% 🚨 regression
78 datafusion:vortex-file-compressed +28.7% +4.0% +23.8% +10.0% 🚨 regression
78 duckdb:duckdb +4.5% +4.0% +0.5% +10.0% ➖ noise
78 duckdb:vortex-compact +7.0% +4.0% +2.9% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +9.2% +4.0% +5.0% +10.0% ➖ noise
79 datafusion:vortex-compact +20.7% +7.5% +12.3% +10.0% 🚨 regression
79 datafusion:vortex-file-compressed +21.6% +7.5% +13.0% +10.0% 🚨 regression
79 duckdb:duckdb +3.9% +7.5% -3.4% +10.4% ➖ noise
79 duckdb:vortex-compact +19.2% +7.5% +10.8% +12.4% ➖ noise
79 duckdb:vortex-file-compressed +40.5% +7.5% +30.6% +12.4% 🚨 regression
80 datafusion:vortex-compact +33.3% +5.5% +26.3% +10.0% 🚨 regression
80 datafusion:vortex-file-compressed +45.8% +5.5% +38.2% +10.0% 🚨 regression
80 duckdb:duckdb +9.0% +5.5% +3.3% +12.3% ➖ noise
80 duckdb:vortex-compact +5.1% +5.5% -0.3% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +14.1% +5.5% +8.1% +10.0% ➖ noise
81 datafusion:vortex-compact +15.0% +4.7% +9.9% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +12.1% +4.7% +7.1% +12.9% ➖ noise
81 duckdb:duckdb +4.5% +4.7% -0.1% +10.7% ➖ noise
81 duckdb:vortex-compact +3.7% +4.7% -0.9% +12.1% ➖ noise
81 duckdb:vortex-file-compressed +1.5% +4.7% -3.0% +12.4% ➖ noise
82 datafusion:vortex-compact +23.5% +1.8% +21.2% +12.9% 🚨 regression
82 datafusion:vortex-file-compressed +41.2% +1.8% +38.6% +12.9% 🚨 regression
82 duckdb:duckdb +3.1% +1.8% +1.2% +14.6% ➖ noise
82 duckdb:vortex-compact +1.3% +1.8% -0.6% +10.0% ➖ noise
82 duckdb:vortex-file-compressed +4.3% +1.8% +2.4% +15.8% ➖ noise
83 datafusion:vortex-compact +9.1% +6.1% +2.8% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +10.5% +6.1% +4.1% +10.0% ➖ noise
83 duckdb:duckdb +6.8% +6.1% +0.7% +14.7% ➖ noise
83 duckdb:vortex-compact +6.2% +6.1% +0.1% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +4.1% +6.1% -1.9% +12.5% ➖ noise
84 datafusion:vortex-compact +7.8% +2.8% +4.9% +10.0% ➖ noise
84 datafusion:vortex-file-compressed +26.3% +2.8% +22.9% +11.7% 🚨 regression
84 duckdb:duckdb +2.9% +2.8% +0.1% +13.1% ➖ noise
84 duckdb:vortex-compact +6.3% +2.8% +3.4% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +8.4% +2.8% +5.4% +10.6% ➖ noise
85 datafusion:vortex-compact +63.4% +4.2% +56.9% +10.0% 🚨 regression
85 datafusion:vortex-file-compressed +72.6% +4.2% +65.7% +10.0% 🚨 regression
85 duckdb:duckdb +4.9% +4.2% +0.7% +10.4% ➖ noise
85 duckdb:vortex-compact +1.7% +4.2% -2.4% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +9.6% +4.2% +5.2% +10.0% ➖ noise
86 datafusion:vortex-compact +3.6% +3.9% -0.3% +11.1% ➖ noise
86 datafusion:vortex-file-compressed +5.4% +3.9% +1.4% +13.6% ➖ noise
86 duckdb:duckdb +6.9% +3.9% +2.9% +18.1% ➖ noise
86 duckdb:vortex-compact +5.3% +3.9% +1.4% +16.4% ➖ noise
86 duckdb:vortex-file-compressed +10.5% +3.9% +6.4% +20.4% ➖ noise
87 datafusion:vortex-compact +4.9% +4.6% +0.3% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +5.3% +4.6% +0.7% +10.0% ➖ noise
87 duckdb:duckdb +11.8% +4.6% +7.0% +12.9% ➖ noise
87 duckdb:vortex-compact -2.9% +4.6% -7.1% +16.8% ➖ noise
87 duckdb:vortex-file-compressed -3.5% +4.6% -7.8% +10.6% ➖ noise
88 datafusion:vortex-compact +21.3% +3.4% +17.3% +10.0% 🚨 regression
88 datafusion:vortex-file-compressed +34.5% +3.4% +30.1% +12.5% 🚨 regression
88 duckdb:duckdb +1.8% +3.4% -1.5% +10.0% ➖ noise
88 duckdb:vortex-compact +6.0% +3.4% +2.5% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +7.7% +3.4% +4.2% +10.0% ➖ noise
89 datafusion:vortex-compact +9.6% +8.8% +0.7% +11.4% ➖ noise
89 datafusion:vortex-file-compressed +17.9% +8.8% +8.3% +12.7% ➖ noise
89 duckdb:duckdb +4.6% +8.8% -3.9% +11.1% ➖ noise
89 duckdb:vortex-compact +2.4% +8.8% -5.9% +30.0% ➖ noise
89 duckdb:vortex-file-compressed +3.4% +8.8% -5.0% +10.7% ➖ noise
90 datafusion:vortex-compact +40.8% +7.9% +30.5% +10.0% 🚨 regression
90 datafusion:vortex-file-compressed +63.3% +7.9% +51.3% +10.0% 🚨 regression
90 duckdb:duckdb +6.5% +7.9% -1.3% +10.8% ➖ noise
90 duckdb:vortex-compact +9.9% +7.9% +1.9% +10.0% ➖ noise
90 duckdb:vortex-file-compressed +4.1% +7.9% -3.6% +11.8% ➖ noise
91 datafusion:vortex-compact +10.1% -0.4% +10.6% +10.4% 🚨 regression
91 datafusion:vortex-file-compressed +7.5% -0.4% +8.0% +10.0% ➖ noise
91 duckdb:duckdb +9.8% -0.4% +10.3% +12.7% ➖ noise
91 duckdb:vortex-compact +7.2% -0.4% +7.7% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +9.8% -0.4% +10.3% +10.0% 🚨 regression
92 datafusion:vortex-compact +44.2% +7.7% +33.9% +10.0% 🚨 regression
92 datafusion:vortex-file-compressed +44.7% +7.7% +34.4% +10.0% 🚨 regression
92 duckdb:duckdb +2.3% +7.7% -5.0% +10.0% ➖ noise
92 duckdb:vortex-compact -1.6% +7.7% -8.6% +15.1% ➖ noise
92 duckdb:vortex-file-compressed +5.5% +7.7% -2.1% +10.0% ➖ noise
93 datafusion:vortex-compact +26.4% +2.9% +22.9% +10.0% 🚨 regression
93 datafusion:vortex-file-compressed +42.2% +2.9% +38.2% +13.5% 🚨 regression
93 duckdb:duckdb +10.9% +2.9% +7.8% +11.6% ➖ noise
93 duckdb:vortex-compact +5.7% +2.9% +2.7% +10.4% ➖ noise
93 duckdb:vortex-file-compressed +0.7% +2.9% -2.1% +10.0% ➖ noise
94 datafusion:vortex-compact +40.9% +3.6% +36.0% +10.0% 🚨 regression
94 datafusion:vortex-file-compressed +52.6% +3.6% +47.4% +10.0% 🚨 regression
94 duckdb:duckdb -8.4% +3.6% -11.5% +11.4% ✅ faster
94 duckdb:vortex-compact +5.7% +3.6% +2.0% +12.4% ➖ noise
94 duckdb:vortex-file-compressed +4.7% +3.6% +1.0% +10.0% ➖ noise
95 datafusion:vortex-compact +20.0% +1.4% +18.4% +11.5% 🚨 regression
95 datafusion:vortex-file-compressed +20.0% +1.4% +18.4% +12.0% 🚨 regression
95 duckdb:duckdb -13.0% +1.4% -14.2% +18.9% ➖ noise
95 duckdb:vortex-compact +13.0% +1.4% +11.5% +24.1% ➖ noise
95 duckdb:vortex-file-compressed -10.2% +1.4% -11.4% +15.4% ➖ noise
96 datafusion:vortex-compact +14.4% +7.8% +6.1% +13.8% ➖ noise
96 datafusion:vortex-file-compressed +32.6% +7.8% +23.0% +17.0% 🚨 regression
96 duckdb:duckdb +2.7% +7.8% -4.7% +14.3% ➖ noise
96 duckdb:vortex-compact +4.2% +7.8% -3.3% +17.3% ➖ noise
96 duckdb:vortex-file-compressed +11.9% +7.8% +3.8% +11.2% ➖ noise
97 datafusion:vortex-compact +33.4% +4.9% +27.2% +10.0% 🚨 regression
97 datafusion:vortex-file-compressed +43.6% +4.9% +36.9% +10.0% 🚨 regression
97 duckdb:duckdb +3.5% +4.9% -1.4% +15.0% ➖ noise
97 duckdb:vortex-compact +3.2% +4.9% -1.6% +11.1% ➖ noise
97 duckdb:vortex-file-compressed +6.3% +4.9% +1.3% +10.0% ➖ noise
98 datafusion:vortex-compact +8.6% +4.1% +4.4% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +6.1% +4.1% +2.0% +10.2% ➖ noise
98 duckdb:duckdb +3.7% +4.1% -0.3% +12.8% ➖ noise
98 duckdb:vortex-compact +5.3% +4.1% +1.2% +10.2% ➖ noise
98 duckdb:vortex-file-compressed +5.0% +4.1% +0.9% +10.0% ➖ noise
99 datafusion:vortex-compact +3.5% +2.5% +1.0% +13.5% ➖ noise
99 datafusion:vortex-file-compressed +5.2% +2.5% +2.6% +12.8% ➖ noise
99 duckdb:duckdb +1.2% +2.5% -1.2% +34.2% ➖ noise
99 duckdb:vortex-compact +2.4% +2.5% -0.1% +20.0% ➖ noise
99 duckdb:vortex-file-compressed +3.6% +2.5% +1.1% +34.5% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.8%
Vortex (geomean): 0.960x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish -4.0%


datafusion / vortex-file-compressed (0.938x ➖, 1↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 807463806 743600746 1.09
tpch_q02/datafusion:vortex-file-compressed 832676361 935624304 0.89
tpch_q03/datafusion:vortex-file-compressed 964687959 809927073 1.19
tpch_q04/datafusion:vortex-file-compressed 748186594 661338054 1.13
tpch_q05/datafusion:vortex-file-compressed 1022228875 1017257069 1.00
tpch_q06/datafusion:vortex-file-compressed 725754390 610077907 1.19
tpch_q07/datafusion:vortex-file-compressed 1211228053 1118572575 1.08
tpch_q08/datafusion:vortex-file-compressed 1228328557 1195271097 1.03
tpch_q09/datafusion:vortex-file-compressed 1419338663 1597578537 0.89
tpch_q10/datafusion:vortex-file-compressed 1025500107 1215438753 0.84
tpch_q11/datafusion:vortex-file-compressed 481620152 560159347 0.86
tpch_q12/datafusion:vortex-file-compressed 904363163 998815336 0.91
tpch_q13/datafusion:vortex-file-compressed 559285641 473328328 1.18
tpch_q14/datafusion:vortex-file-compressed 566498410 642843858 0.88
tpch_q15/datafusion:vortex-file-compressed 1165275445 1380146608 0.84
tpch_q16/datafusion:vortex-file-compressed 🚀 351926776 710825371 0.50
tpch_q17/datafusion:vortex-file-compressed 1253982527 1396073479 0.90
tpch_q18/datafusion:vortex-file-compressed 1351859006 1656004906 0.82
tpch_q19/datafusion:vortex-file-compressed 806572401 833982589 0.97
tpch_q20/datafusion:vortex-file-compressed 1021794806 1043613635 0.98
tpch_q21/datafusion:vortex-file-compressed 1838213997 1769332838 1.04
tpch_q22/datafusion:vortex-file-compressed 414644888 537267672 0.77
datafusion / vortex-compact (1.009x ➖, 1↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 874168788 734555817 1.19
tpch_q02/datafusion:vortex-compact 1094250406 1140598521 0.96
tpch_q03/datafusion:vortex-compact 885258158 952304142 0.93
tpch_q04/datafusion:vortex-compact 743702351 622499809 1.19
tpch_q05/datafusion:vortex-compact 964508892 1047441486 0.92
tpch_q06/datafusion:vortex-compact 605715617 641410594 0.94
tpch_q07/datafusion:vortex-compact 1122958001 1125581672 1.00
tpch_q08/datafusion:vortex-compact 1123576129 1171290955 0.96
tpch_q09/datafusion:vortex-compact 1320616057 1398345668 0.94
tpch_q10/datafusion:vortex-compact 973684016 917144074 1.06
tpch_q11/datafusion:vortex-compact 413113251 419795510 0.98
tpch_q12/datafusion:vortex-compact 1052561852 917585113 1.15
tpch_q13/datafusion:vortex-compact 521501034 421183544 1.24
tpch_q14/datafusion:vortex-compact 641581517 745480809 0.86
tpch_q15/datafusion:vortex-compact 1089386680 1083694050 1.01
tpch_q16/datafusion:vortex-compact 🚀 321620533 560075744 0.57
tpch_q17/datafusion:vortex-compact 1205227163 1218392106 0.99
tpch_q18/datafusion:vortex-compact 1234259070 1246473604 0.99
tpch_q19/datafusion:vortex-compact 761601391 691713377 1.10
tpch_q20/datafusion:vortex-compact 969647400 889324998 1.09
tpch_q21/datafusion:vortex-compact 1833059804 1426210337 1.29
tpch_q22/datafusion:vortex-compact 394446883 356287566 1.11
datafusion / parquet (1.098x ➖, 0↑ 2↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 896346405 894475831 1.00
tpch_q02/datafusion:parquet 717411074 758604113 0.95
tpch_q03/datafusion:parquet 1011201493 1131541936 0.89
tpch_q04/datafusion:parquet 500084993 498310026 1.00
tpch_q05/datafusion:parquet 1268645634 1285092319 0.99
tpch_q06/datafusion:parquet 542987350 513283443 1.06
tpch_q07/datafusion:parquet 1543127909 1475599163 1.05
tpch_q08/datafusion:parquet 2009906212 1704189641 1.18
tpch_q09/datafusion:parquet 2246266729 1903060412 1.18
tpch_q10/datafusion:parquet 🚨 3059226266 2047766149 1.49
tpch_q11/datafusion:parquet 🚨 974516214 624944889 1.56
tpch_q12/datafusion:parquet 822578408 701451165 1.17
tpch_q13/datafusion:parquet 775648491 710322701 1.09
tpch_q14/datafusion:parquet 946644737 869464823 1.09
tpch_q15/datafusion:parquet 1269133023 1203622624 1.05
tpch_q16/datafusion:parquet 475896335 387368142 1.23
tpch_q17/datafusion:parquet 1508442046 1393900881 1.08
tpch_q18/datafusion:parquet 1840534173 1631498229 1.13
tpch_q19/datafusion:parquet 982231896 1063065819 0.92
tpch_q20/datafusion:parquet 1207729464 1135936415 1.06
tpch_q21/datafusion:parquet 1785250764 1693849771 1.05
tpch_q22/datafusion:parquet 749595664 655873832 1.14
duckdb / vortex-file-compressed (0.983x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 592694914 646391727 0.92
tpch_q02/duckdb:vortex-file-compressed 1245273306 1136422020 1.10
tpch_q03/duckdb:vortex-file-compressed 920461255 992553939 0.93
tpch_q04/duckdb:vortex-file-compressed 660698413 793819527 0.83
tpch_q05/duckdb:vortex-file-compressed 1283840953 1169900468 1.10
tpch_q06/duckdb:vortex-file-compressed 964325461 775054756 1.24
tpch_q07/duckdb:vortex-file-compressed 1189785172 1178830293 1.01
tpch_q08/duckdb:vortex-file-compressed 1400568663 1511918827 0.93
tpch_q09/duckdb:vortex-file-compressed 1545672428 1586918864 0.97
tpch_q10/duckdb:vortex-file-compressed 1301102085 1217203826 1.07
tpch_q11/duckdb:vortex-file-compressed 576344843 641934480 0.90
tpch_q12/duckdb:vortex-file-compressed 763875012 778845943 0.98
tpch_q13/duckdb:vortex-file-compressed 1073682509 988641404 1.09
tpch_q14/duckdb:vortex-file-compressed 940963749 855503410 1.10
tpch_q15/duckdb:vortex-file-compressed 631424974 618962307 1.02
tpch_q16/duckdb:vortex-file-compressed 415583361 532609481 0.78
tpch_q17/duckdb:vortex-file-compressed 995175266 1040889057 0.96
tpch_q18/duckdb:vortex-file-compressed 880003079 880415608 1.00
tpch_q19/duckdb:vortex-file-compressed 809910185 799539635 1.01
tpch_q20/duckdb:vortex-file-compressed 1343320379 1243211344 1.08
tpch_q21/duckdb:vortex-file-compressed 1860662613 2175791982 0.86
tpch_q22/duckdb:vortex-file-compressed 528367805 595231250 0.89
duckdb / vortex-compact (0.913x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 618011104 589027904 1.05
tpch_q02/duckdb:vortex-compact 1138370394 1163874150 0.98
tpch_q03/duckdb:vortex-compact 860100767 1102815839 0.78
tpch_q04/duckdb:vortex-compact 431138827 551343017 0.78
tpch_q05/duckdb:vortex-compact 991523241 1139573206 0.87
tpch_q06/duckdb:vortex-compact 733743047 922129470 0.80
tpch_q07/duckdb:vortex-compact 1008235090 1110781660 0.91
tpch_q08/duckdb:vortex-compact 1260603021 1507512586 0.84
tpch_q09/duckdb:vortex-compact 1309492405 1384472568 0.95
tpch_q10/duckdb:vortex-compact 1168028799 1323650038 0.88
tpch_q11/duckdb:vortex-compact 705850670 762853049 0.93
tpch_q12/duckdb:vortex-compact 665229950 639736582 1.04
tpch_q13/duckdb:vortex-compact 823564887 971833594 0.85
tpch_q14/duckdb:vortex-compact 920994171 865712619 1.06
tpch_q15/duckdb:vortex-compact 536055951 604046368 0.89
tpch_q16/duckdb:vortex-compact 423772254 502407142 0.84
tpch_q17/duckdb:vortex-compact 871928061 918846067 0.95
tpch_q18/duckdb:vortex-compact 671139303 709101140 0.95
tpch_q19/duckdb:vortex-compact 763540745 809310755 0.94
tpch_q20/duckdb:vortex-compact 1177943586 1307779788 0.90
tpch_q21/duckdb:vortex-compact 1783882361 1664788146 1.07
tpch_q22/duckdb:vortex-compact 649414165 703911164 0.92
duckdb / parquet (0.925x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 981686636 1009549464 0.97
tpch_q02/duckdb:parquet 1582158159 1670377194 0.95
tpch_q03/duckdb:parquet 1724529527 1621673799 1.06
tpch_q04/duckdb:parquet 988322544 1185829517 0.83
tpch_q05/duckdb:parquet 2047155861 2177094568 0.94
tpch_q06/duckdb:parquet 637002209 731867168 0.87
tpch_q07/duckdb:parquet 1675082369 1693780377 0.99
tpch_q08/duckdb:parquet 2430201775 2779941320 0.87
tpch_q09/duckdb:parquet 2191928717 2291000562 0.96
tpch_q10/duckdb:parquet 2997463418 3410836694 0.88
tpch_q11/duckdb:parquet 1053108111 1082069713 0.97
tpch_q12/duckdb:parquet 983664850 1088187650 0.90
tpch_q13/duckdb:parquet 1235001427 1502047982 0.82
tpch_q14/duckdb:parquet 1156371854 1568687443 0.74
tpch_q15/duckdb:parquet 916263805 900307679 1.02
tpch_q16/duckdb:parquet 827292974 767537410 1.08
tpch_q17/duckdb:parquet 1296314631 1328126828 0.98
tpch_q18/duckdb:parquet 1466782599 1503515221 0.98
tpch_q19/duckdb:parquet 1531416847 1920833020 0.80
tpch_q20/duckdb:parquet 1719209362 1872426651 0.92
tpch_q21/duckdb:parquet 1823216668 1929038593 0.95
tpch_q22/duckdb:parquet 1115939726 1151200914 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +19.0% -1.3% +20.6% +85.7% ➖ noise
1 datafusion:vortex-file-compressed +8.6% -1.3% +10.0% +82.3% ➖ noise
1 duckdb:vortex-compact +4.9% -1.3% +6.3% +43.7% ➖ noise
1 duckdb:vortex-file-compressed -8.3% -1.3% -7.1% +30.4% ➖ noise
2 datafusion:vortex-compact -4.1% -5.4% +1.4% +57.6% ➖ noise
2 datafusion:vortex-file-compressed -11.0% -5.4% -6.0% +68.8% ➖ noise
2 duckdb:vortex-compact -2.2% -5.4% +3.3% +46.8% ➖ noise
2 duckdb:vortex-file-compressed +9.6% -5.4% +15.8% +43.7% ➖ noise
3 datafusion:vortex-compact -7.0% -2.5% -4.6% +101.8% ➖ noise
3 datafusion:vortex-file-compressed +19.1% -2.5% +22.2% +97.6% ➖ noise
3 duckdb:vortex-compact -22.0% -2.5% -20.0% +63.9% ➖ noise
3 duckdb:vortex-file-compressed -7.3% -2.5% -4.9% +52.0% ➖ noise
4 datafusion:vortex-compact +19.5% -8.5% +30.6% +30.0% 🚨 regression
4 datafusion:vortex-file-compressed +13.1% -8.5% +23.7% +30.0% ➖ noise
4 duckdb:vortex-compact -21.8% -8.5% -14.5% +49.3% ➖ noise
4 duckdb:vortex-file-compressed -16.8% -8.5% -9.0% +48.9% ➖ noise
5 datafusion:vortex-compact -7.9% -3.7% -4.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +0.5% -3.7% +4.3% +30.0% ➖ noise
5 duckdb:vortex-compact -13.0% -3.7% -9.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +9.7% -3.7% +13.9% +50.5% ➖ noise
6 datafusion:vortex-compact -5.6% -4.0% -1.6% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +19.0% -4.0% +24.0% +30.0% ➖ noise
6 duckdb:vortex-compact -20.4% -4.0% -17.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +24.4% -4.0% +29.7% +30.0% ➖ noise
7 datafusion:vortex-compact -0.2% +1.7% -1.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +8.3% +1.7% +6.5% +30.0% ➖ noise
7 duckdb:vortex-compact -9.2% +1.7% -10.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +0.9% +1.7% -0.8% +30.0% ➖ noise
8 datafusion:vortex-compact -4.1% +1.5% -5.5% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +2.8% +1.5% +1.2% +30.0% ➖ noise
8 duckdb:vortex-compact -16.4% +1.5% -17.6% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -7.4% +1.5% -8.8% +30.0% ➖ noise
9 datafusion:vortex-compact -5.6% +6.3% -11.1% +30.0% ➖ noise
9 datafusion:vortex-file-compressed -11.2% +6.3% -16.4% +30.0% ➖ noise
9 duckdb:vortex-compact -5.4% +6.3% -11.0% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -2.6% +6.3% -8.3% +30.0% ➖ noise
10 datafusion:vortex-compact +6.2% +14.6% -7.3% +31.5% ➖ noise
10 datafusion:vortex-file-compressed -15.6% +14.6% -26.4% +50.0% ➖ noise
10 duckdb:vortex-compact -11.8% +14.6% -23.0% +52.3% ➖ noise
10 duckdb:vortex-file-compressed +6.9% +14.6% -6.7% +40.2% ➖ noise
11 datafusion:vortex-compact -1.6% +23.2% -20.1% +55.5% ➖ noise
11 datafusion:vortex-file-compressed -14.0% +23.2% -30.2% +42.6% ✅ faster
11 duckdb:vortex-compact -7.5% +23.2% -24.9% +30.0% ✅ faster
11 duckdb:vortex-file-compressed -10.2% +23.2% -27.1% +30.0% ✅ faster
12 datafusion:vortex-compact +14.7% +3.0% +11.4% +45.7% ➖ noise
12 datafusion:vortex-file-compressed -9.5% +3.0% -12.1% +40.0% ➖ noise
12 duckdb:vortex-compact +4.0% +3.0% +1.0% +37.3% ➖ noise
12 duckdb:vortex-file-compressed -1.9% +3.0% -4.7% +35.6% ➖ noise
13 datafusion:vortex-compact +23.8% -5.2% +30.7% +38.0% ➖ noise
13 datafusion:vortex-file-compressed +18.2% -5.2% +24.7% +42.1% ➖ noise
13 duckdb:vortex-compact -15.3% -5.2% -10.6% +68.6% ➖ noise
13 duckdb:vortex-file-compressed +8.6% -5.2% +14.6% +77.7% ➖ noise
14 datafusion:vortex-compact -13.9% -10.4% -3.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -11.9% -10.4% -1.6% +30.0% ➖ noise
14 duckdb:vortex-compact +6.4% -10.4% +18.8% +47.0% ➖ noise
14 duckdb:vortex-file-compressed +10.0% -10.4% +22.8% +30.0% ➖ noise
15 datafusion:vortex-compact +0.5% +3.6% -3.0% +58.0% ➖ noise
15 datafusion:vortex-file-compressed -15.6% +3.6% -18.5% +55.6% ➖ noise
15 duckdb:vortex-compact -11.3% +3.6% -14.3% +57.6% ➖ noise
15 duckdb:vortex-file-compressed +2.0% +3.6% -1.5% +61.7% ➖ noise
16 datafusion:vortex-compact -42.6% +15.1% -50.1% +42.4% ✅ faster
16 datafusion:vortex-file-compressed -50.5% +15.1% -57.0% +54.6% ✅ faster
16 duckdb:vortex-compact -15.7% +15.1% -26.7% +30.0% ✅ faster
16 duckdb:vortex-file-compressed -22.0% +15.1% -32.2% +34.7% ✅ faster
17 datafusion:vortex-compact -1.1% +2.8% -3.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -10.2% +2.8% -12.6% +30.0% ➖ noise
17 duckdb:vortex-compact -5.1% +2.8% -7.7% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -4.4% +2.8% -7.0% +30.0% ➖ noise
18 datafusion:vortex-compact -1.0% +4.9% -5.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -18.4% +4.9% -22.2% +30.0% ➖ noise
18 duckdb:vortex-compact -5.4% +4.9% -9.8% +53.7% ➖ noise
18 duckdb:vortex-file-compressed -0.0% +4.9% -4.7% +30.0% ➖ noise
19 datafusion:vortex-compact +10.1% -14.2% +28.3% +40.2% ➖ noise
19 datafusion:vortex-file-compressed -3.3% -14.2% +12.7% +30.0% ➖ noise
19 duckdb:vortex-compact -5.7% -14.2% +9.9% +32.9% ➖ noise
19 duckdb:vortex-file-compressed +1.3% -14.2% +18.0% +30.0% ➖ noise
20 datafusion:vortex-compact +9.0% -1.2% +10.4% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -2.1% -1.2% -0.9% +30.0% ➖ noise
20 duckdb:vortex-compact -9.9% -1.2% -8.8% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +8.1% -1.2% +9.4% +30.0% ➖ noise
21 datafusion:vortex-compact +28.5% -0.2% +28.8% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +3.9% -0.2% +4.1% +30.0% ➖ noise
21 duckdb:vortex-compact +7.2% -0.2% +7.4% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -14.5% -0.2% -14.3% +30.0% ➖ noise
22 datafusion:vortex-compact +10.7% +5.3% +5.2% +47.4% ➖ noise
22 datafusion:vortex-file-compressed -22.8% +5.3% -26.7% +50.7% ➖ noise
22 duckdb:vortex-compact -7.7% +5.3% -12.3% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -11.2% +5.3% -15.7% +30.0% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: FineWeb NVMe

Verdict: Likely regression (low confidence)
Attributed Vortex impact: +22.6%
Vortex (geomean): 1.417x ❌
Parquet (geomean): 1.156x ❌
Shifts: Parquet (control) +15.6% · Median polish +23.7%


datafusion / vortex-file-compressed (1.830x ❌, 0↑ 9↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 6952159 4000173 1.74
fineweb_q01/datafusion:vortex-file-compressed 🚨 57902347 26763187 2.16
fineweb_q02/datafusion:vortex-file-compressed 🚨 57095224 29235179 1.95
fineweb_q03/datafusion:vortex-file-compressed 🚨 154940793 81833583 1.89
fineweb_q04/datafusion:vortex-file-compressed 🚨 261596516 222845023 1.17
fineweb_q05/datafusion:vortex-file-compressed 🚨 235302913 184363624 1.28
fineweb_q06/datafusion:vortex-file-compressed 🚨 150671318 67776472 2.22
fineweb_q07/datafusion:vortex-file-compressed 🚨 137007056 64854138 2.11
fineweb_q08/datafusion:vortex-file-compressed 🚨 55227487 23514387 2.35
datafusion / vortex-compact (1.385x ❌, 0↑ 9↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 7233639 4199873 1.72
fineweb_q01/datafusion:vortex-compact 🚨 204382962 162041545 1.26
fineweb_q02/datafusion:vortex-compact 🚨 210454188 162451887 1.30
fineweb_q03/datafusion:vortex-compact 🚨 1703330066 1432552395 1.19
fineweb_q04/datafusion:vortex-compact 🚨 1796752594 1558573564 1.15
fineweb_q05/datafusion:vortex-compact 🚨 1487640114 1232010298 1.21
fineweb_q06/datafusion:vortex-compact 🚨 885754136 699192990 1.27
fineweb_q07/datafusion:vortex-compact 🚨 903820093 729051180 1.24
fineweb_q08/datafusion:vortex-compact 🚨 58344601 22776857 2.56
datafusion / parquet (1.151x ❌, 0↑ 9↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚨 6689180 5839048 1.15
fineweb_q01/datafusion:parquet 🚨 311142285 272016912 1.14
fineweb_q02/datafusion:parquet 🚨 312800752 273987798 1.14
fineweb_q03/datafusion:parquet 🚨 311815257 271680595 1.15
fineweb_q04/datafusion:parquet 🚨 334844666 284113694 1.18
fineweb_q05/datafusion:parquet 🚨 330092413 280687438 1.18
fineweb_q06/datafusion:parquet 🚨 315990657 286031881 1.10
fineweb_q07/datafusion:parquet 🚨 314891594 272163083 1.16
fineweb_q08/datafusion:parquet 🚨 309946514 266771222 1.16
duckdb / vortex-file-compressed (1.320x ❌, 0↑ 9↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 4453609 3279424 1.36
fineweb_q01/duckdb:vortex-file-compressed 🚨 35054754 27529684 1.27
fineweb_q02/duckdb:vortex-file-compressed 🚨 37096009 30895455 1.20
fineweb_q03/duckdb:vortex-file-compressed 🚨 178657643 127078589 1.41
fineweb_q04/duckdb:vortex-file-compressed 🚨 232423996 189388376 1.23
fineweb_q05/duckdb:vortex-file-compressed 🚨 208155177 165049065 1.26
fineweb_q06/duckdb:vortex-file-compressed 🚨 92865039 68804993 1.35
fineweb_q07/duckdb:vortex-file-compressed 🚨 92142789 61364303 1.50
fineweb_q08/duckdb:vortex-file-compressed 🚨 33501350 25238192 1.33
duckdb / vortex-compact (1.205x ❌, 0↑ 9↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 4825008 3850703 1.25
fineweb_q01/duckdb:vortex-compact 🚨 130268641 107385757 1.21
fineweb_q02/duckdb:vortex-compact 🚨 131442771 113433530 1.16
fineweb_q03/duckdb:vortex-compact 🚨 1030973761 868731348 1.19
fineweb_q04/duckdb:vortex-compact 🚨 1076479033 897726743 1.20
fineweb_q05/duckdb:vortex-compact 🚨 966050224 809733177 1.19
fineweb_q06/duckdb:vortex-compact 🚨 561015283 462828442 1.21
fineweb_q07/duckdb:vortex-compact 🚨 576544974 475358364 1.21
fineweb_q08/duckdb:vortex-compact 🚨 29733703 24386539 1.22
duckdb / parquet (1.161x ❌, 0↑ 9↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚨 40527932 35932370 1.13
fineweb_q01/duckdb:parquet 🚨 107425820 91947405 1.17
fineweb_q02/duckdb:parquet 🚨 112062657 95287142 1.18
fineweb_q03/duckdb:parquet 🚨 362008123 304935059 1.19
fineweb_q04/duckdb:parquet 🚨 501535316 438906626 1.14
fineweb_q05/duckdb:parquet 🚨 467454494 408388362 1.14
fineweb_q06/duckdb:parquet 🚨 230070761 197630206 1.16
fineweb_q07/duckdb:parquet 🚨 243706123 210165524 1.16
fineweb_q08/duckdb:parquet 🚨 66612644 56512810 1.18
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +72.2% +13.7% +51.5% +50.2% 🚨 regression
0 datafusion:vortex-file-compressed +73.8% +13.7% +52.9% +78.1% ➖ noise
0 duckdb:vortex-compact +25.3% +13.7% +10.2% +45.0% ➖ noise
0 duckdb:vortex-file-compressed +35.8% +13.7% +19.5% +53.9% ➖ noise
1 datafusion:vortex-compact +26.1% +15.6% +9.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +116.4% +15.6% +87.2% +17.8% 🚨 regression
1 duckdb:vortex-compact +21.3% +15.6% +4.9% +26.6% ➖ noise
1 duckdb:vortex-file-compressed +27.3% +15.6% +10.1% +35.9% ➖ noise
2 datafusion:vortex-compact +29.5% +15.9% +11.8% +10.0% 🚨 regression
2 datafusion:vortex-file-compressed +95.3% +15.9% +68.5% +17.8% 🚨 regression
2 duckdb:vortex-compact +15.9% +15.9% +0.0% +15.1% ➖ noise
2 duckdb:vortex-file-compressed +20.1% +15.9% +3.6% +12.3% ➖ noise
3 datafusion:vortex-compact +18.9% +16.7% +1.9% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +89.3% +16.7% +62.2% +11.6% 🚨 regression
3 duckdb:vortex-compact +18.7% +16.7% +1.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +40.6% +16.7% +20.4% +23.2% ➖ noise
4 datafusion:vortex-compact +15.3% +16.0% -0.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +17.4% +16.0% +1.2% +11.4% ➖ noise
4 duckdb:vortex-compact +19.9% +16.0% +3.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +22.7% +16.0% +5.8% +10.0% ➖ noise
5 datafusion:vortex-compact +20.7% +16.0% +4.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +27.6% +16.0% +10.0% +10.0% 🚨 regression
5 duckdb:vortex-compact +19.3% +16.0% +2.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +26.1% +16.0% +8.7% +10.0% ➖ noise
6 datafusion:vortex-compact +26.7% +13.4% +11.7% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +122.3% +13.4% +96.0% +10.0% 🚨 regression
6 duckdb:vortex-compact +21.2% +13.4% +6.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +35.0% +13.4% +19.0% +15.0% 🚨 regression
7 datafusion:vortex-compact +24.0% +15.8% +7.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +111.3% +15.8% +82.4% +10.0% 🚨 regression
7 duckdb:vortex-compact +21.3% +15.8% +4.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +50.2% +15.8% +29.6% +11.7% 🚨 regression
8 datafusion:vortex-compact +156.2% +17.0% +118.9% +14.3% 🚨 regression
8 datafusion:vortex-file-compressed +134.9% +17.0% +100.7% +12.6% 🚨 regression
8 duckdb:vortex-compact +21.9% +17.0% +4.2% +12.5% ➖ noise
8 duckdb:vortex-file-compressed +32.7% +17.0% +13.4% +21.8% ➖ noise

@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: Likely regression (low confidence)
Attributed Vortex impact: +14.2%
Vortex (geomean): 1.159x ❌
Parquet (geomean): 0.945x ➖
Shifts: Parquet (control) -5.5% · Median polish -1.4%


datafusion / vortex-file-compressed (1.212x ❌, 0↑ 9↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 480819549 475271312 1.01
tpch_q02/datafusion:vortex-file-compressed 176381708 178380428 0.99
tpch_q03/datafusion:vortex-file-compressed 274628375 284270134 0.97
tpch_q04/datafusion:vortex-file-compressed 🚨 168149652 121256476 1.39
tpch_q05/datafusion:vortex-file-compressed 498049291 523758644 0.95
tpch_q06/datafusion:vortex-file-compressed 🚨 135625269 43367986 3.13
tpch_q07/datafusion:vortex-file-compressed 676900060 715620171 0.95
tpch_q08/datafusion:vortex-file-compressed 497001551 510827064 0.97
tpch_q09/datafusion:vortex-file-compressed 822948642 903924717 0.91
tpch_q10/datafusion:vortex-file-compressed 342318557 312997115 1.09
tpch_q11/datafusion:vortex-file-compressed 116780134 128741043 0.91
tpch_q12/datafusion:vortex-file-compressed 🚨 252004824 136403398 1.85
tpch_q13/datafusion:vortex-file-compressed 🚨 316531784 238881160 1.33
tpch_q14/datafusion:vortex-file-compressed 🚨 118208178 81376113 1.45
tpch_q15/datafusion:vortex-file-compressed 🚨 212560817 121147103 1.75
tpch_q16/datafusion:vortex-file-compressed 🚨 121652266 104231028 1.17
tpch_q17/datafusion:vortex-file-compressed 751548809 816529328 0.92
tpch_q18/datafusion:vortex-file-compressed 975827562 1078237847 0.91
tpch_q19/datafusion:vortex-file-compressed 🚨 396099111 137698603 2.88
tpch_q20/datafusion:vortex-file-compressed 238029980 220127689 1.08
tpch_q21/datafusion:vortex-file-compressed 810139367 862485038 0.94
tpch_q22/datafusion:vortex-file-compressed 🚨 76307680 65749603 1.16
datafusion / vortex-compact (1.133x ❌, 0↑ 9↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 522226205 501787263 1.04
tpch_q02/datafusion:vortex-compact 179843210 178506540 1.01
tpch_q03/datafusion:vortex-compact 291242155 292325427 1.00
tpch_q04/datafusion:vortex-compact 🚨 183967113 139803708 1.32
tpch_q05/datafusion:vortex-compact 508485852 522991450 0.97
tpch_q06/datafusion:vortex-compact 🚨 152804179 71550668 2.14
tpch_q07/datafusion:vortex-compact 685862251 743911125 0.92
tpch_q08/datafusion:vortex-compact 507440119 529441076 0.96
tpch_q09/datafusion:vortex-compact 845458634 914053502 0.92
tpch_q10/datafusion:vortex-compact 359644659 345837062 1.04
tpch_q11/datafusion:vortex-compact 123124514 132066210 0.93
tpch_q12/datafusion:vortex-compact 🚨 302493470 199510419 1.52
tpch_q13/datafusion:vortex-compact 🚨 367154956 294051402 1.25
tpch_q14/datafusion:vortex-compact 🚨 122480997 95599824 1.28
tpch_q15/datafusion:vortex-compact 🚨 261421384 185705840 1.41
tpch_q16/datafusion:vortex-compact 🚨 126370545 108762730 1.16
tpch_q17/datafusion:vortex-compact 768120194 847865828 0.91
tpch_q18/datafusion:vortex-compact 987194808 1065714773 0.93
tpch_q19/datafusion:vortex-compact 🚨 471338421 243600267 1.93
tpch_q20/datafusion:vortex-compact 251548838 246841965 1.02
tpch_q21/datafusion:vortex-compact 835417736 892708503 0.94
tpch_q22/datafusion:vortex-compact 🚨 86454077 76304847 1.13
datafusion / parquet (0.920x ➖, 5↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 459540727 516833129 0.89
tpch_q02/datafusion:parquet 259253339 272185291 0.95
tpch_q03/datafusion:parquet 392080174 419798095 0.93
tpch_q04/datafusion:parquet 151008702 158955689 0.95
tpch_q05/datafusion:parquet 571792373 632059329 0.90
tpch_q06/datafusion:parquet 🚀 120693674 137214710 0.88
tpch_q07/datafusion:parquet 791930270 858565007 0.92
tpch_q08/datafusion:parquet 641039343 704758890 0.91
tpch_q09/datafusion:parquet 960763315 1058554127 0.91
tpch_q10/datafusion:parquet 611857897 643607141 0.95
tpch_q11/datafusion:parquet 191338836 209281306 0.91
tpch_q12/datafusion:parquet 253364018 268140131 0.94
tpch_q13/datafusion:parquet 343321344 360531750 0.95
tpch_q14/datafusion:parquet 195559021 210893085 0.93
tpch_q15/datafusion:parquet 🚀 254079374 303947032 0.84
tpch_q16/datafusion:parquet 182550915 192455532 0.95
tpch_q17/datafusion:parquet 🚀 839628227 937844665 0.90
tpch_q18/datafusion:parquet 1030626027 1142722021 0.90
tpch_q19/datafusion:parquet 333400148 358156758 0.93
tpch_q20/datafusion:parquet 376038237 401289741 0.94
tpch_q21/datafusion:parquet 🚀 887653078 996537980 0.89
tpch_q22/datafusion:parquet 225321246 231588349 0.97
datafusion / arrow (0.902x ➖, 11↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 727947065 788359435 0.92
tpch_q02/datafusion:arrow 206899358 214049832 0.97
tpch_q03/datafusion:arrow 🚀 557217902 626669917 0.89
tpch_q04/datafusion:arrow 🚀 392730145 464805175 0.84
tpch_q05/datafusion:arrow 1063817884 1152971533 0.92
tpch_q06/datafusion:arrow 328180565 364067213 0.90
tpch_q07/datafusion:arrow 1365401966 1504247809 0.91
tpch_q08/datafusion:arrow 1320584899 1455239443 0.91
tpch_q09/datafusion:arrow 1560072014 1694747695 0.92
tpch_q10/datafusion:arrow 🚀 672654065 753586110 0.89
tpch_q11/datafusion:arrow 🚀 178441808 198421070 0.90
tpch_q12/datafusion:arrow 🚀 732256178 817297445 0.90
tpch_q13/datafusion:arrow 529311261 558761333 0.95
tpch_q14/datafusion:arrow 🚀 371137191 420050804 0.88
tpch_q15/datafusion:arrow 🚀 762310886 896143765 0.85
tpch_q16/datafusion:arrow 127474713 133523510 0.95
tpch_q17/datafusion:arrow 1642147137 1734095074 0.95
tpch_q18/datafusion:arrow 2137876729 2372964623 0.90
tpch_q19/datafusion:arrow 🚀 588228902 658201504 0.89
tpch_q20/datafusion:arrow 🚀 573933377 639351298 0.90
tpch_q21/datafusion:arrow 🚀 3854142039 4750748714 0.81
tpch_q22/datafusion:arrow 🚀 180365167 200454488 0.90
duckdb / vortex-file-compressed (1.229x ❌, 0↑ 8↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 186636143 179288177 1.04
tpch_q02/duckdb:vortex-file-compressed 59356983 57564044 1.03
tpch_q03/duckdb:vortex-file-compressed 143282440 141723905 1.01
tpch_q04/duckdb:vortex-file-compressed 🚨 187766721 165137971 1.14
tpch_q05/duckdb:vortex-file-compressed 136936460 142020910 0.96
tpch_q06/duckdb:vortex-file-compressed 🚨 195590827 54101880 3.62
tpch_q07/duckdb:vortex-file-compressed 🚨 251385941 163406256 1.54
tpch_q08/duckdb:vortex-file-compressed 182441095 194181802 0.94
tpch_q09/duckdb:vortex-file-compressed 344475727 351366606 0.98
tpch_q10/duckdb:vortex-file-compressed 175466725 168997023 1.04
tpch_q11/duckdb:vortex-file-compressed 40515335 40639526 1.00
tpch_q12/duckdb:vortex-file-compressed 🚨 355267571 106451609 3.34
tpch_q13/duckdb:vortex-file-compressed 267411408 266931983 1.00
tpch_q14/duckdb:vortex-file-compressed 🚨 180665090 76344264 2.37
tpch_q15/duckdb:vortex-file-compressed 106975599 110814843 0.97
tpch_q16/duckdb:vortex-file-compressed 81462880 84400720 0.97
tpch_q17/duckdb:vortex-file-compressed 🚨 128652039 107302394 1.20
tpch_q18/duckdb:vortex-file-compressed 281556623 291914784 0.96
tpch_q19/duckdb:vortex-file-compressed 🚨 110852857 95188200 1.16
tpch_q20/duckdb:vortex-file-compressed 🚨 257200940 176884063 1.45
tpch_q21/duckdb:vortex-file-compressed 634255985 609507136 1.04
tpch_q22/duckdb:vortex-file-compressed 80751401 81381016 0.99
duckdb / vortex-compact (1.070x ➖, 0↑ 6↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 235845748 234974975 1.00
tpch_q02/duckdb:vortex-compact 63699419 64777290 0.98
tpch_q03/duckdb:vortex-compact 153798570 153891560 1.00
tpch_q04/duckdb:vortex-compact 189627543 191729076 0.99
tpch_q05/duckdb:vortex-compact 152287080 158640169 0.96
tpch_q06/duckdb:vortex-compact 🚨 165933884 89993447 1.84
tpch_q07/duckdb:vortex-compact 230988982 221721892 1.04
tpch_q08/duckdb:vortex-compact 198141251 218822170 0.91
tpch_q09/duckdb:vortex-compact 367952582 383508195 0.96
tpch_q10/duckdb:vortex-compact 206494248 205728345 1.00
tpch_q11/duckdb:vortex-compact 46054606 46234537 1.00
tpch_q12/duckdb:vortex-compact 🚨 279290915 221824070 1.26
tpch_q13/duckdb:vortex-compact 318416935 312905707 1.02
tpch_q14/duckdb:vortex-compact 🚨 161814903 106940835 1.51
tpch_q15/duckdb:vortex-compact 126780100 128125706 0.99
tpch_q16/duckdb:vortex-compact 86836572 89012694 0.98
tpch_q17/duckdb:vortex-compact 🚨 143201824 124322725 1.15
tpch_q18/duckdb:vortex-compact 303701800 304391576 1.00
tpch_q19/duckdb:vortex-compact 🚨 136589044 121637697 1.12
tpch_q20/duckdb:vortex-compact 🚨 257071473 224251777 1.15
tpch_q21/duckdb:vortex-compact 682855153 673586904 1.01
tpch_q22/duckdb:vortex-compact 94705284 94492510 1.00
duckdb / parquet (0.970x ➖, 0↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 251504746 255384478 0.98
tpch_q02/duckdb:parquet 103978440 99910131 1.04
tpch_q03/duckdb:parquet 208200984 223012893 0.93
tpch_q04/duckdb:parquet 135394907 142434410 0.95
tpch_q05/duckdb:parquet 220565703 229961145 0.96
tpch_q06/duckdb:parquet 65664943 68959827 0.95
tpch_q07/duckdb:parquet 181826601 188125754 0.97
tpch_q08/duckdb:parquet 252660691 267396244 0.94
tpch_q09/duckdb:parquet 461212764 481597594 0.96
tpch_q10/duckdb:parquet 601739536 624562839 0.96
tpch_q11/duckdb:parquet 47115884 46322231 1.02
tpch_q12/duckdb:parquet 127550025 126312578 1.01
tpch_q13/duckdb:parquet 440779170 460920015 0.96
tpch_q14/duckdb:parquet 175199645 178812787 0.98
tpch_q15/duckdb:parquet 98779705 100557278 0.98
tpch_q16/duckdb:parquet 161369912 163659230 0.99
tpch_q17/duckdb:parquet 176876677 179559383 0.99
tpch_q18/duckdb:parquet 347377596 366760234 0.95
tpch_q19/duckdb:parquet 283689063 293043349 0.97
tpch_q20/duckdb:parquet 227722762 239364458 0.95
tpch_q21/duckdb:parquet 570065904 604615494 0.94
tpch_q22/duckdb:parquet 289802234 298716363 0.97
duckdb / duckdb (0.968x ➖, 1↑ 0↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117865081 119831112 0.98
tpch_q02/duckdb:duckdb 🚀 45632394 51317575 0.89
tpch_q03/duckdb:duckdb 96479419 98432675 0.98
tpch_q04/duckdb:duckdb 132406259 136977087 0.97
tpch_q05/duckdb:duckdb 109986213 113332334 0.97
tpch_q06/duckdb:duckdb 39269131 37376049 1.05
tpch_q07/duckdb:duckdb 85752062 89225450 0.96
tpch_q08/duckdb:duckdb 110322148 113758908 0.97
tpch_q09/duckdb:duckdb 275029672 294551322 0.93
tpch_q10/duckdb:duckdb 202517931 220161592 0.92
tpch_q11/duckdb:duckdb 16757256 15563166 1.08
tpch_q12/duckdb:duckdb 85663181 87864485 0.97
tpch_q13/duckdb:duckdb 255270727 267195735 0.96
tpch_q14/duckdb:duckdb 69788843 72729294 0.96
tpch_q15/duckdb:duckdb 79417656 81410832 0.98
tpch_q16/duckdb:duckdb 74089614 77442027 0.96
tpch_q17/duckdb:duckdb 84451991 85954300 0.98
tpch_q18/duckdb:duckdb 212072505 224010240 0.95
tpch_q19/duckdb:duckdb 116096692 118607873 0.98
tpch_q20/duckdb:duckdb 111570200 113254824 0.99
tpch_q21/duckdb:duckdb 299932372 316097413 0.95
tpch_q22/duckdb:duckdb 67952296 71562991 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -7.7% -6.4% -1.3% +12.1% ➖ noise
1 datafusion:vortex-compact +4.1% -6.4% +11.2% +13.9% ➖ noise
1 datafusion:vortex-file-compressed +1.2% -6.4% +8.1% +13.4% ➖ noise
1 duckdb:duckdb -1.6% -6.4% +5.1% +12.3% ➖ noise
1 duckdb:vortex-compact +0.4% -6.4% +7.3% +12.2% ➖ noise
1 duckdb:vortex-file-compressed +4.1% -6.4% +11.2% +13.3% ➖ noise
2 datafusion:arrow -3.3% -0.4% -2.9% +10.0% ➖ noise
2 datafusion:vortex-compact +0.7% -0.4% +1.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.1% -0.4% -0.7% +10.0% ➖ noise
2 duckdb:duckdb -11.1% -0.4% -10.7% +10.0% ✅ faster
2 duckdb:vortex-compact -1.7% -0.4% -1.2% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +3.1% -0.4% +3.6% +11.7% ➖ noise
3 datafusion:arrow -11.1% -6.6% -4.8% +10.0% ➖ noise
3 datafusion:vortex-compact -0.4% -6.6% +6.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -3.4% -6.6% +3.5% +10.0% ➖ noise
3 duckdb:duckdb -2.0% -6.6% +5.0% +10.0% ➖ noise
3 duckdb:vortex-compact -0.1% -6.6% +7.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.1% -6.6% +8.3% +10.0% ➖ noise
4 datafusion:arrow -15.5% -5.0% -11.1% +10.0% ✅ faster
4 datafusion:vortex-compact +31.6% -5.0% +38.5% +10.0% 🚨 regression
4 datafusion:vortex-file-compressed +38.7% -5.0% +45.9% +10.0% 🚨 regression
4 duckdb:duckdb -3.3% -5.0% +1.7% +10.0% ➖ noise
4 duckdb:vortex-compact -1.1% -5.0% +4.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +13.7% -5.0% +19.7% +10.0% 🚨 regression
5 datafusion:arrow -7.7% -6.9% -0.9% +10.0% ➖ noise
5 datafusion:vortex-compact -2.8% -6.9% +4.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -4.9% -6.9% +2.1% +10.0% ➖ noise
5 duckdb:duckdb -3.0% -6.9% +4.2% +10.0% ➖ noise
5 duckdb:vortex-compact -4.0% -6.9% +3.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.6% -6.9% +3.5% +10.0% ➖ noise
6 datafusion:arrow -9.9% -8.5% -1.5% +10.0% ➖ noise
6 datafusion:vortex-compact +113.6% -8.5% +133.4% +10.0% 🚨 regression
6 datafusion:vortex-file-compressed +212.7% -8.5% +241.7% +10.0% 🚨 regression
6 duckdb:duckdb +5.1% -8.5% +14.8% +13.7% 🚨 regression
6 duckdb:vortex-compact +84.4% -8.5% +101.5% +16.0% 🚨 regression
6 duckdb:vortex-file-compressed +261.5% -8.5% +295.0% +10.0% 🚨 regression
7 datafusion:arrow -9.2% -5.6% -3.9% +10.0% ➖ noise
7 datafusion:vortex-compact -7.8% -5.6% -2.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -5.4% -5.6% +0.2% +10.0% ➖ noise
7 duckdb:duckdb -3.9% -5.6% +1.8% +10.0% ➖ noise
7 duckdb:vortex-compact +4.2% -5.6% +10.3% +10.0% 🚨 regression
7 duckdb:vortex-file-compressed +53.8% -5.6% +62.9% +10.0% 🚨 regression
8 datafusion:arrow -9.3% -7.3% -2.1% +10.0% ➖ noise
8 datafusion:vortex-compact -4.2% -7.3% +3.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -2.7% -7.3% +4.9% +10.0% ➖ noise
8 duckdb:duckdb -3.0% -7.3% +4.6% +10.0% ➖ noise
8 duckdb:vortex-compact -9.5% -7.3% -2.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -6.0% -7.3% +1.3% +10.0% ➖ noise
9 datafusion:arrow -7.9% -6.8% -1.3% +10.0% ➖ noise
9 datafusion:vortex-compact -7.5% -6.8% -0.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -9.0% -6.8% -2.3% +10.0% ➖ noise
9 duckdb:duckdb -6.6% -6.8% +0.2% +10.0% ➖ noise
9 duckdb:vortex-compact -4.1% -6.8% +2.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.0% -6.8% +5.2% +10.0% ➖ noise
10 datafusion:arrow -10.7% -4.3% -6.7% +10.0% ➖ noise
10 datafusion:vortex-compact +4.0% -4.3% +8.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +9.4% -4.3% +14.3% +10.0% 🚨 regression
10 duckdb:duckdb -8.0% -4.3% -3.9% +10.0% ➖ noise
10 duckdb:vortex-compact +0.4% -4.3% +4.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +3.8% -4.3% +8.5% +10.0% ➖ noise
11 datafusion:arrow -10.1% -3.6% -6.7% +10.0% ➖ noise
11 datafusion:vortex-compact -6.8% -3.6% -3.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -9.3% -3.6% -5.9% +10.0% ➖ noise
11 duckdb:duckdb +7.7% -3.6% +11.7% +17.1% ➖ noise
11 duckdb:vortex-compact -0.4% -3.6% +3.3% +11.6% ➖ noise
11 duckdb:vortex-file-compressed -0.3% -3.6% +3.4% +10.6% ➖ noise
12 datafusion:arrow -10.4% -2.3% -8.3% +42.4% ➖ noise
12 datafusion:vortex-compact +51.6% -2.3% +55.2% +10.0% 🚨 regression
12 datafusion:vortex-file-compressed +84.7% -2.3% +89.1% +10.9% 🚨 regression
12 duckdb:duckdb -2.5% -2.3% -0.2% +10.0% ➖ noise
12 duckdb:vortex-compact +25.9% -2.3% +28.9% +11.4% 🚨 regression
12 duckdb:vortex-file-compressed +233.7% -2.3% +241.7% +10.8% 🚨 regression
13 datafusion:arrow -5.3% -4.6% -0.7% +10.4% ➖ noise
13 datafusion:vortex-compact +24.9% -4.6% +30.8% +10.5% 🚨 regression
13 datafusion:vortex-file-compressed +32.5% -4.6% +38.9% +10.0% 🚨 regression
13 duckdb:duckdb -4.5% -4.6% +0.1% +10.0% ➖ noise
13 duckdb:vortex-compact +1.8% -4.6% +6.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.2% -4.6% +5.0% +10.0% ➖ noise
14 datafusion:arrow -11.6% -4.7% -7.3% +10.0% ➖ noise
14 datafusion:vortex-compact +28.1% -4.7% +34.4% +10.0% 🚨 regression
14 datafusion:vortex-file-compressed +45.3% -4.7% +52.4% +10.0% 🚨 regression
14 duckdb:duckdb -4.0% -4.7% +0.7% +10.0% ➖ noise
14 duckdb:vortex-compact +51.3% -4.7% +58.7% +11.2% 🚨 regression
14 duckdb:vortex-file-compressed +136.6% -4.7% +148.3% +10.0% 🚨 regression
15 datafusion:arrow -14.9% -9.4% -6.1% +10.0% ➖ noise
15 datafusion:vortex-compact +40.8% -9.4% +55.3% +10.0% 🚨 regression
15 datafusion:vortex-file-compressed +75.5% -9.4% +93.6% +11.9% 🚨 regression
15 duckdb:duckdb -2.4% -9.4% +7.7% +10.0% ➖ noise
15 duckdb:vortex-compact -1.1% -9.4% +9.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -3.5% -9.4% +6.5% +10.0% ➖ noise
16 datafusion:arrow -4.5% -3.3% -1.3% +15.5% ➖ noise
16 datafusion:vortex-compact +16.2% -3.3% +20.1% +10.0% 🚨 regression
16 datafusion:vortex-file-compressed +16.7% -3.3% +20.7% +10.0% 🚨 regression
16 duckdb:duckdb -4.3% -3.3% -1.1% +10.0% ➖ noise
16 duckdb:vortex-compact -2.4% -3.3% +0.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -3.5% -3.3% -0.2% +10.0% ➖ noise
17 datafusion:arrow -5.3% -6.1% +0.8% +10.0% ➖ noise
17 datafusion:vortex-compact -9.4% -6.1% -3.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -8.0% -6.1% -2.0% +10.0% ➖ noise
17 duckdb:duckdb -1.7% -6.1% +4.6% +10.0% ➖ noise
17 duckdb:vortex-compact +15.2% -6.1% +22.7% +10.0% 🚨 regression
17 duckdb:vortex-file-compressed +19.9% -6.1% +27.7% +10.0% 🚨 regression
18 datafusion:arrow -9.9% -7.6% -2.5% +10.7% ➖ noise
18 datafusion:vortex-compact -7.4% -7.6% +0.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -9.5% -7.6% -2.1% +10.0% ➖ noise
18 duckdb:duckdb -5.3% -7.6% +2.4% +10.0% ➖ noise
18 duckdb:vortex-compact -0.2% -7.6% +8.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.5% -7.6% +4.4% +10.0% ➖ noise
19 datafusion:arrow -10.6% -5.1% -5.9% +10.0% ➖ noise
19 datafusion:vortex-compact +93.5% -5.1% +103.8% +10.0% 🚨 regression
19 datafusion:vortex-file-compressed +187.7% -5.1% +203.0% +10.0% 🚨 regression
19 duckdb:duckdb -2.1% -5.1% +3.1% +10.0% ➖ noise
19 duckdb:vortex-compact +12.3% -5.1% +18.3% +10.0% 🚨 regression
19 duckdb:vortex-file-compressed +16.5% -5.1% +22.7% +10.0% 🚨 regression
20 datafusion:arrow -10.2% -5.6% -4.9% +10.0% ➖ noise
20 datafusion:vortex-compact +1.9% -5.6% +7.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +8.1% -5.6% +14.5% +10.0% 🚨 regression
20 duckdb:duckdb -1.5% -5.6% +4.3% +10.0% ➖ noise
20 duckdb:vortex-compact +14.6% -5.6% +21.4% +10.0% 🚨 regression
20 duckdb:vortex-file-compressed +45.4% -5.6% +54.0% +10.0% 🚨 regression
21 datafusion:arrow -18.9% -8.4% -11.5% +10.0% ✅ faster
21 datafusion:vortex-compact -6.4% -8.4% +2.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -6.1% -8.4% +2.5% +10.0% ➖ noise
21 duckdb:duckdb -5.1% -8.4% +3.5% +10.0% ➖ noise
21 duckdb:vortex-compact +1.4% -8.4% +10.6% +10.0% 🚨 regression
21 duckdb:vortex-file-compressed +4.1% -8.4% +13.6% +10.0% 🚨 regression
22 datafusion:arrow -10.0% -2.8% -7.4% +10.0% ➖ noise
22 datafusion:vortex-compact +13.3% -2.8% +16.6% +10.0% 🚨 regression
22 datafusion:vortex-file-compressed +16.1% -2.8% +19.5% +10.0% 🚨 regression
22 duckdb:duckdb -5.0% -2.8% -2.3% +10.0% ➖ noise
22 duckdb:vortex-compact +0.2% -2.8% +3.2% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.8% -2.8% +2.1% +10.0% ➖ noise

@codspeed-hq
Copy link

codspeed-hq bot commented Mar 19, 2026

Merging this PR will degrade performance by 25.53%

⚡ 2 improved benchmarks
❌ 11 regressed benchmarks
✅ 1003 untouched benchmarks
⏩ 1522 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation dict_canonicalize_zipfian[16, 1000] 64.1 µs 71.3 µs -10.09%
Simulation new_bp_prim_test_between[i32, 32768] 143.9 µs 173.1 µs -16.88%
Simulation new_bp_prim_test_between[i64, 16384] 112.5 µs 142.6 µs -21.09%
Simulation old_alp_prim_test_between[f32, 32768] 399.2 µs 445.8 µs -10.44%
Simulation new_bp_prim_test_between[i64, 32768] 176.5 µs 236.9 µs -25.53%
Simulation new_alp_prim_test_between[f32, 16384] 108.3 µs 122.8 µs -11.83%
Simulation new_bp_prim_test_between[i32, 16384] 95.9 µs 111 µs -13.59%
Simulation new_bp_prim_test_between[i16, 32768] 125.8 µs 140.1 µs -10.23%
Simulation take_10k_random 264.4 µs 206.2 µs +28.19%
Simulation take_10k_contiguous 323.8 µs 266.1 µs +21.68%
Simulation new_alp_prim_test_between[f64, 16384] 125 µs 154.8 µs -19.29%
Simulation new_alp_prim_test_between[f32, 32768] 159.2 µs 188.2 µs -15.4%
Simulation old_bp_prim_test_between[i64, 32768] 475.8 µs 537.8 µs -11.52%

Comparing ngates/id (2232ae5) with develop (cf1c050)

Open in CodSpeed

Footnotes

  1. 1522 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Mar 19, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 2232ae5 1 Explore Profiling Data

Powered by Polar Signals Cloud

@gatesn
Copy link
Contributor Author

gatesn commented Mar 19, 2026

Lol yeah.... I'm not sure this will work unless we hold the Id on the vtable

@github-actions
Copy link
Contributor

Benchmarks: Compression

Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.003x ➖


unknown / unknown (1.005x ➖, 0↑ 1↓)
name PR 2232ae5 (ns) base d260d42 (ns) ratio (PR/base)
compress time/Arade 1141344820 1145049167 1.00
compress time/Bimbo 7230547749 7272943929 0.99
compress time/CMSprovider 3010461566 2974386842 1.01
compress time/Euro2016 437677099 432466374 1.01
compress time/Food 402243335 366333070 1.10
compress time/HashTags 943196823 937357988 1.01
compress time/TPC-H l_comment canonical 1313124489 1314039001 1.00
compress time/TPC-H l_comment chunked 1358122499 1314341013 1.03
compress time/taxi 751794837 740882363 1.01
compress time/wide table cols=100 chunks=1 rows=1000 15794353 15881006 0.99
compress time/wide table cols=100 chunks=50 rows=1000 15592146 16335904 0.95
compress time/wide table cols=1000 chunks=1 rows=1000 156809134 156120861 1.00
compress time/wide table cols=1000 chunks=50 rows=1000 156207765 157505168 0.99
compress time/wide table cols=10000 chunks=1 rows=1000 1501923368 1574280351 0.95
compress time/wide table cols=10000 chunks=50 rows=1000 1520259721 1549949496 0.98
decompress time/Arade 31652787 31703496 1.00
decompress time/Bimbo 98128257 101424624 0.97
decompress time/CMSprovider 88492294 86665024 1.02
decompress time/Euro2016 22447010 22745755 0.99
decompress time/Food 9076026 8940331 1.02
decompress time/HashTags 81860031 80872686 1.01
decompress time/TPC-H l_comment canonical 43590090 42282373 1.03
decompress time/TPC-H l_comment chunked 44190315 41581712 1.06
decompress time/taxi 19250214 18250358 1.05
decompress time/wide table cols=100 chunks=1 rows=1000 2644194 2538608 1.04
decompress time/wide table cols=100 chunks=50 rows=1000 2616786 2603299 1.01
decompress time/wide table cols=1000 chunks=1 rows=1000 23628418 23048283 1.03
decompress time/wide table cols=1000 chunks=50 rows=1000 23345997 22650483 1.03
decompress time/wide table cols=10000 chunks=1 rows=1000 239585800 234252568 1.02
decompress time/wide table cols=10000 chunks=50 rows=1000 235578759 236814504 0.99
parquet size/Arade 305282152 305282152 1.00
parquet size/Bimbo 388935055 388935055 1.00
parquet size/CMSprovider 384634824 384634824 1.00
parquet size/Euro2016 123042700 123042700 1.00
parquet size/Food 36177631 36177631 1.00
parquet size/HashTags 133854962 133854962 1.00
parquet size/TPC-H l_comment canonical 158411391 158411391 1.00
parquet size/TPC-H l_comment chunked 158411391 158411391 1.00
parquet size/taxi 55879185 55879185 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932204 932204 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932204 932204 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9322004 9322004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93220004 93220004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93220004 93220004 1.00
parquet_rs-zstd compress time/Arade 2494954899 2486291380 1.00
parquet_rs-zstd compress time/Bimbo 15867642828 15759873894 1.01
parquet_rs-zstd compress time/CMSprovider 7998274193 7897696245 1.01
parquet_rs-zstd compress time/Euro2016 1455414313 1455468800 1.00
parquet_rs-zstd compress time/Food 924950243 928680181 1.00
parquet_rs-zstd compress time/HashTags 2630728912 2590559677 1.02
parquet_rs-zstd compress time/TPC-H l_comment canonical 3249522013 3198067106 1.02
parquet_rs-zstd compress time/TPC-H l_comment chunked 3225165790 3186531932 1.01
parquet_rs-zstd compress time/taxi 1398107985 1377170719 1.02
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 6464983 6612364 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6358986 6746585 0.94
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 86624625 85824748 1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 82947028 85736024 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 889785640 922311234 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 853456314 922928227 0.92
parquet_rs-zstd decompress time/Arade 680881736 661942551 1.03
parquet_rs-zstd decompress time/Bimbo 2312392362 2252829696 1.03
parquet_rs-zstd decompress time/CMSprovider 2128491632 2116924973 1.01
parquet_rs-zstd decompress time/Euro2016 418075227 418858417 1.00
parquet_rs-zstd decompress time/Food 239873744 237144219 1.01
parquet_rs-zstd decompress time/HashTags 715633723 690464979 1.04
parquet_rs-zstd decompress time/TPC-H l_comment canonical 714321616 707913413 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 725673153 705700820 1.03
parquet_rs-zstd decompress time/taxi 293507052 285853555 1.03
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2551362 2560103 1.00
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2612761 2551286 1.02
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31135910 30258099 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 28610641 30078964 0.95
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 337558174 341550192 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 339351248 337097887 1.01
vortex-file-compressed size/Arade 143320276 143320276 1.00
vortex-file-compressed size/Bimbo 526057964 526057964 1.00
vortex-file-compressed size/CMSprovider 448071556 448071556 1.00
vortex-file-compressed size/Euro2016 164827076 164651524 1.00
vortex-file-compressed size/Food 44159616 44159616 1.00
vortex-file-compressed size/HashTags 195365036 195365036 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179476200 179476200 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179476200 179476200 1.00
vortex-file-compressed size/taxi 51449348 51449348 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884384 884384 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829584 8829584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317584 88317584 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317584 88317584 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.00
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.01
vortex:parquet-zstd ratio compress time/Food 🚨 0 0 1.10
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 2 2 1.02
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 2 2 1.01
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.97
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.94
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio decompress time/Food 0 0 1.00
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.98
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.03
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 1 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.08
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 0.99
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.862x ✅
Parquet (geomean): 1.029x ➖


unknown / unknown (0.959x ➖, 10↑ 4↓)
name PR 2232ae5 (ns) base cf1c050 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2299976 2712405 0.85
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1269887 1280828 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk 13701125760 13806762692 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 13295851057 13445094465 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 7002516 8002081 0.88
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 5633061 6013835 0.94
random-access/feature-vectors/uniform/lance-tokio-local-disk 1457039 1449815 1.00
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2355154 2348991 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk 13308256000 13371844770 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 13289532122 13429360426 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12716631 14022089 0.91
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12454428 14153024 0.88
random-access/lance-tokio-local-disk 744295 735532 1.01
random-access/lance-tokio-local-disk-footer 1341009 1337865 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk 261243 272062 0.96
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 708799 705506 1.00
random-access/nested-lists/correlated/parquet-tokio-local-disk 161627648 159623141 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 161178552 160733324 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk 696297 769690 0.90
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 700082 847975 0.83
random-access/nested-lists/uniform/lance-tokio-local-disk 1166738 1167684 1.00
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1657601 1653822 1.00
random-access/nested-lists/uniform/parquet-tokio-local-disk 161407201 159371012 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 161443190 157434326 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk 2459638 2569973 0.96
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2587905 2672665 0.97
random-access/nested-structs/correlated/lance-tokio-local-disk 430358 431948 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 641787 642388 1.00
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 28809455 25154694 1.15
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 29136362 25283593 1.15
random-access/nested-structs/correlated/vortex-tokio-local-disk 891385 863744 1.03
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 882460 900484 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk 2815490 2836182 0.99
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3057312 3074242 0.99
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 29177964 25266038 1.15
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 28640601 25281427 1.13
random-access/nested-structs/uniform/vortex-tokio-local-disk 1726067 1702837 1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1721259 1696626 1.01
random-access/parquet-tokio-local-disk 186358107 187633067 0.99
random-access/parquet-tokio-local-disk-footer 185798922 187565884 0.99
random-access/taxi/correlated/lance-tokio-local-disk 961754 953873 1.01
random-access/taxi/correlated/lance-tokio-local-disk-footer 1643758 1634573 1.01
random-access/taxi/correlated/parquet-tokio-local-disk 275857728 282981377 0.97
random-access/taxi/correlated/parquet-tokio-local-disk-footer 280623625 282879051 0.99
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1694628 2517806 0.67
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1704541 2450338 0.70
random-access/taxi/uniform/lance-tokio-local-disk 8709316 8322318 1.05
random-access/taxi/uniform/lance-tokio-local-disk-footer 9387733 8975982 1.05
random-access/taxi/uniform/parquet-tokio-local-disk 294049828 295561651 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 292985639 293798276 1.00
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4227124 5285386 0.80
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4273443 5235679 0.82
random-access/vortex-tokio-local-disk 🚀 1192110 1708951 0.70
random-access/vortex-tokio-local-disk-footer 🚀 1208284 1773609 0.68

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use string interning for all ID types

2 participants