Skip to content

perf: search sorted children through one shared probe - #10452

Merged
robert3005 merged 10 commits into
developfrom
ji/adoring-brown-55sw7y
Nov 15, 2026
Merged

robert3005 merged 10 commits into
developfrom
ji/adoring-brown-55sw7y

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Several reads and slices binary search a sorted child, such as patch indices or run ends. Some of them built a new searcher, and so a new probe, for every search. RunEnd's probe lookup didn't use the search-sorted API at all: it hand-rolled a binary search that read the ends one scalar at a time. This PR changes only those call sites. Every sorted search now goes through the search-sorted API with one shared probe. That holds even for a single search inside a scalar read: the search reuses the caller's probe instead of building its own.

Decoding the sorted child once per repeated probe is split out into #11473, which is stacked on this PR.

Instructions per iteration (valgrind/cachegrind) on the new patched_search benchmark: 1M rows, one BitPacked patch or run end every 64 rows.

Benchmark develop This PR Ratio
run_end_read_once (256 reads) 12.16M 5.60M 0.46x
run_end_read_repeated (256 reads) 12.24M 5.46M 0.45x
run_end_slice (64 slices) 7.05M 3.24M 0.46x
patches_slice (64 slices) 2.02M 1.99M 0.99x
sparse_read_once (256 reads) 3.41M 3.44M 1.01x
sparse_read_repeated (256 reads) 3.42M 3.49M 1.02x

Wall-clock medians agree. For example, run_end_read_repeated goes from 1.47 ms to 645 µs, and run_end_slice from 868 µs to 395 µs.

Changes

  • New constructor: SearchSortedPrimitiveArray::with_probe searches through an ArrayProbe the caller already holds, such as a ProbeState child slot. A canonical primitive child still reads its buffer directly.
  • RunEnd lookups: a RunEnd probe lookup now searches its ends slot through with_probe instead of the hand-rolled loop.
  • RunEnd slicing: finds both bounds with one searcher, through find_physical_range.
  • Patches::slice: finds both of its bounds through search_indices, which shares the chunk-offsets probe and the indices searcher.
  • Patches::probe_patched: for repeated reads of Sparse, BitPacked, ALP and ALP-RD, it searches the indices slot and reads the values slot through the probe. One-off reads keep get_patched, which narrows the search by chunk offsets.
  • Error handling: an out-of-range patch range now returns an error instead of panicking.
  • Benchmark: adds encodings/fastlanes/benches/patched_search.rs.

API Changes

All additive:

  • SearchSortedPrimitiveArray::with_probe
  • Patches::probe_patched
  • RunEndArrayExt::find_physical_range

https://claude.ai/code/session_01Jck72aD351kMboqN5g8Ccs

🤖 Generated with Claude Code

Several call sites built a fresh searcher, and with it a fresh probe, for
each search of the same sorted array:

- RunEnd slice searched `ends` twice through two helpers. Add
  `find_physical_range`, which finds both bounds with one searcher.
- `Patches::slice` called `search_index` twice. Both lookups now go
  through `search_indices`, which shares the chunk offsets probe and the
  indices searcher.
- Sparse, BitPacked, ALP and ALP-RD read patches with `get_patched`, which
  builds a searcher over the patch indices per read. Add
  `Patches::probe_patched`, which reads the patch children through the
  `ProbeState` slots so a repeated probe keeps them across reads, and use
  it from each encoding's `probe_scalar`.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Jck72aD351kMboqN5g8Ccs
@codspeed

codspeed Bot commented Oct 12, 2026 •

Copy link
Copy Markdown

Merging this PR will degrade performance by 9.1%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 1 improved benchmark
❌ 4 regressed benchmarks
✅ 1931 untouched benchmarks
🆕 6 new benchmarks
⏩ 50 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation bench_compare_varbin[(50000, 2)] 134.7 µs 163.3 µs -17.5%
❌ CPU Simulation compare[1] 52.2 µs 62 µs -15.78%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(9999, 10000)] 206.9 µs 235 µs -11.96%
❌ CPU Simulation bench_compare_sliced_dict_varbinview[(1000, 10000)] 81.4 µs 92.4 µs -11.88%
⚡ CPU Simulation compare[1] 71.4 µs 62 µs +15.16%
🆕 CPU Simulation patches_slice N/A 294.6 µs N/A
🆕 CPU Simulation run_end_read_once N/A 374.2 µs N/A
🆕 CPU Simulation run_end_read_repeated N/A 364.2 µs N/A
🆕 CPU Simulation run_end_slice N/A 459.3 µs N/A
🆕 CPU Simulation sparse_read_once N/A 243 µs N/A
🆕 CPU Simulation sparse_read_repeated N/A 243.9 µs N/A

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/adoring-brown-55sw7y (43742ab) with develop (d7aa24e)

Open in CodSpeed

Footnotes

  1. 50 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@joseph-isaacs joseph-isaacs added action/bench-random-access Run only the random-access benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Oct 12, 2026 — with Claude
@github-actions github-actions Bot removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-random-access Run only the random-access benchmark on this PR labels Oct 12, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Oct 12, 2026 — with Claude
@github-actions

github-actions Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 43742ab clickbench-nvme 1 Explore Profiling Data
🟢 Done 43742ab fineweb 1 Explore Profiling Data
🟢 Done 43742ab tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 43742ab tpch-nvme-10 1 Explore Profiling Data
🟢 Done 43742ab polarsignals 1 Explore Profiling Data
🟢 Done 43742ab tpch-s3 1 Explore Profiling Data
🟢 Done 43742ab random-access-bench 1 Explore Profiling Data
🟢 Done 43742ab tpcds-nvme 1 Explore Profiling Data
🟢 Done 43742ab tpch-nvme 1 Explore Profiling Data
Previous Runs (34)
Status Commit Job Attempt Link
🟢 Done 7080a70 fineweb 1 Explore Profiling Data
🟢 Done 7080a70 random-access-bench 1 Explore Profiling Data
🟢 Done 7080a70 vortex-queries 1 Explore Profiling Data
🟢 Done 7080a70 clickbench-nvme 1 Explore Profiling Data
🟢 Done 7080a70 tpch-nested-nvme 1 Explore Profiling Data
🟢 Done 7080a70 appian-nvme 1 Explore Profiling Data
🟢 Done 7080a70 tpch-s3-10 1 Explore Profiling Data
🟢 Done 7080a70 job-nvme 1 Explore Profiling Data
🟢 Done 7080a70 tpch-s3 1 Explore Profiling Data
🟢 Done 7080a70 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 7080a70 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 7080a70 tpcds-nvme-10 1 Explore Profiling Data
🟢 Done 7080a70 fineweb-s3 1 Explore Profiling Data
🟢 Done 7080a70 polarsignals 1 Explore Profiling Data
🟢 Done 7080a70 tpch-nvme 1 Explore Profiling Data
🟢 Done 7080a70 statpopgen 1 Explore Profiling Data
🟢 Done 7080a70 tpcds-nvme 1 Explore Profiling Data
🟢 Done 7080a70 string-bench 1 Explore Profiling Data
🟢 Done 7080a70 compress-bench 1 Explore Profiling Data
🟢 Done 14779f5 tpch-nvme-10 2 Explore Profiling Data
🟢 Done 14779f5 clickbench-nvme 2 Explore Profiling Data
🟢 Done 14779f5 fineweb 2 Explore Profiling Data
🟢 Done 14779f5 tpcds-nvme 2 Explore Profiling Data
🟢 Done 14779f5 polarsignals 2 Explore Profiling Data
🟢 Done 14779f5 tpch-nvme 2 Explore Profiling Data
🟢 Done 14779f5 tpch-s3 2 Explore Profiling Data
🟢 Done 73b1ff4 random-access-bench 1 Explore Profiling Data
🟢 Done 73b1ff4 tpch-nvme-10 2 Explore Profiling Data
🟢 Done 73b1ff4 clickbench-nvme 2 Explore Profiling Data
🟢 Done 73b1ff4 tpcds-nvme 2 Explore Profiling Data
🟢 Done 73b1ff4 polarsignals 2 Explore Profiling Data
🟢 Done 73b1ff4 tpch-s3 2 Explore Profiling Data
🟢 Done 73b1ff4 fineweb 2 Explore Profiling Data
🟢 Done 73b1ff4 tpch-nvme 2 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 43742ab2 vs base d7aa24e8
Vortex (geomean): hot 0.991x ➖ · cold 1.049x ➖


datafusion / vortex-file-compressed / ns (0.991x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 81085112 / 80207008 / +1.1% 127146691 / 122170545 / +4.1% 0.64 / 0.66 / -2.9%
polarsignals_q01/datafusion:vortex-file-compressed 89101759 / 88872104 / +0.3% 148513449 / 149565648 / -0.7% 0.60 / 0.59 / +1.0%
polarsignals_q02/datafusion:vortex-file-compressed 11150105 / 12643154 / -11.8% 🟢 50327483 / 42595022 / +18.2% 🔴 0.22 / 0.30 / -25.4%
polarsignals_q03/datafusion:vortex-file-compressed 91733242 / 90806554 / +1.0% 154741734 / 155864427 / -0.7% 0.59 / 0.58 / +1.8%
polarsignals_q04/datafusion:vortex-file-compressed 9306478 / 9359742 / -0.6% 42928022 / 39195029 / +9.5% 0.22 / 0.24 / -9.2%
polarsignals_q05/datafusion:vortex-file-compressed 11712006 / 11584745 / +1.1% 44916172 / 43198399 / +4.0% 0.26 / 0.27 / -2.8%
polarsignals_q06/datafusion:vortex-file-compressed 23312356 / 23150708 / +0.7% 56660708 / 52862560 / +7.2% 0.41 / 0.44 / -6.1%
polarsignals_q07/datafusion:vortex-file-compressed 10737700 / 10706870 / +0.3% 42100285 / 41186256 / +2.2% 0.26 / 0.26 / -1.9%
polarsignals_q08/datafusion:vortex-file-compressed 133476154 / 135182665 / -1.3% 196581816 / 196070645 / +0.3% 0.68 / 0.69 / -1.5%
polarsignals_q09/datafusion:vortex-file-compressed 9954774 / 10085591 / -1.3% 40441099 / 39875650 / +1.4% 0.25 / 0.25 / -2.7%
polarsignals_q10/datafusion:vortex-file-compressed 15315923 / 13465176 / +13.7% 🔴 53588698 / 50399441 / +6.3% 0.29 / 0.27 / +7.0%
polarsignals_q11/datafusion:vortex-file-compressed 14263565 / 16149118 / -11.7% 🟢 51892449 / 48480200 / +7.0% 0.27 / 0.33 / -17.5%
polarsignals_q12/datafusion:vortex-file-compressed 16721740 / 16923686 / -1.2% 49808860 / 46622608 / +6.8% 0.34 / 0.36 / -7.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 43742ab2 vs base d7aa24e8
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.4%
Engines: DataFusion No clear signal (-5.1%, low confidence) · DuckDB No clear signal (-1.7%, low confidence)
Vortex (geomean): hot 0.982x ➖ · cold 0.948x ➖
Parquet (geomean): hot 1.017x ➖ · cold 0.973x ➖
Shifts: Parquet (control) +1.7% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.960x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6064528 / 6067278 / -0.0% 21432128 / 21059985 / +1.8% 0.28 / 0.29 / -1.8%
fineweb_q01/datafusion:vortex-file-compressed 9732336 / 9633082 / +1.0% 35446694 / 36781752 / -3.6% 0.27 / 0.26 / +4.8%
fineweb_q02/datafusion:vortex-file-compressed 12052776 / 11351798 / +6.2% 40086345 / 43148426 / -7.1% 0.30 / 0.26 / +14.3%
fineweb_q03/datafusion:vortex-file-compressed 17594531 / 17431408 / +0.9% 101174513 / 107562391 / -5.9% 0.17 / 0.16 / +7.3%
fineweb_q04/datafusion:vortex-file-compressed 66194243 / 65366990 / +1.3% 143774007 / 146428576 / -1.8% 0.46 / 0.45 / +3.1%
fineweb_q05/datafusion:vortex-file-compressed 62300658 / 61808253 / +0.8% 131444889 / 136679897 / -3.8% 0.47 / 0.45 / +4.8%
fineweb_q06/datafusion:vortex-file-compressed 16703965 / 16453021 / +1.5% 100146870 / 106354986 / -5.8% 0.17 / 0.15 / +7.8%
fineweb_q07/datafusion:vortex-file-compressed 17539004 / 17573036 / -0.2% 102285574 / 104436964 / -2.1% 0.17 / 0.17 / +1.9%
fineweb_q08/datafusion:vortex-file-compressed 7233865 / 11710835 / -38.2% 🟢 26983557 / 31173220 / -13.4% 🟢 0.27 / 0.38 / -28.6%
datafusion / parquet / ns (1.011x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9535849 / 9586358 / -0.5% 32068060 / 32387687 / -1.0% 0.30 / 0.30 / +0.5%
fineweb_q01/datafusion:parquet 76427046 / 74831982 / +2.1% 141958353 / 153189573 / -7.3% 0.54 / 0.49 / +10.2%
fineweb_q02/datafusion:parquet 74815174 / 75553682 / -1.0% 154020404 / 154348918 / -0.2% 0.49 / 0.49 / -0.8%
fineweb_q03/datafusion:parquet 74328990 / 74757180 / -0.6% 140756662 / 150439925 / -6.4% 0.53 / 0.50 / +6.3%
fineweb_q04/datafusion:parquet 82895704 / 82348459 / +0.7% 146412907 / 154498118 / -5.2% 0.57 / 0.53 / +6.2%
fineweb_q05/datafusion:parquet 82072086 / 80349672 / +2.1% 146587586 / 152607785 / -3.9% 0.56 / 0.53 / +6.3%
fineweb_q06/datafusion:parquet 76086850 / 74914664 / +1.6% 150041974 / 159496858 / -5.9% 0.51 / 0.47 / +8.0%
fineweb_q07/datafusion:parquet 77519416 / 73287881 / +5.8% 144493172 / 152779595 / -5.4% 0.54 / 0.48 / +11.8%
fineweb_q08/datafusion:parquet 72692062 / 72793622 / -0.1% 143914183 / 152326317 / -5.5% 0.51 / 0.48 / +5.7%
duckdb / vortex-file-compressed / ns (1.005x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2240395 / 2128975 / +5.2% 7195685 / 8713538 / -17.4% 🟢 0.31 / 0.24 / +27.4%
fineweb_q01/duckdb:vortex-file-compressed 9020134 / 9115610 / -1.0% 26992131 / 29315195 / -7.9% 0.33 / 0.31 / +7.5%
fineweb_q02/duckdb:vortex-file-compressed 10490668 / 10649331 / -1.5% 28895709 / 31635082 / -8.7% 0.36 / 0.34 / +7.8%
fineweb_q03/duckdb:vortex-file-compressed 17612642 / 17755047 / -0.8% 87279190 / 96568771 / -9.6% 0.20 / 0.18 / +9.8%
fineweb_q04/duckdb:vortex-file-compressed 69953778 / 70352541 / -0.6% 109652052 / 111997973 / -2.1% 0.64 / 0.63 / +1.6%
fineweb_q05/duckdb:vortex-file-compressed 67744934 / 68742922 / -1.5% 110510283 / 107394828 / +2.9% 0.61 / 0.64 / -4.2%
fineweb_q06/duckdb:vortex-file-compressed 18786822 / 18317284 / +2.6% 85822806 / 88668795 / -3.2% 0.22 / 0.21 / +6.0%
fineweb_q07/duckdb:vortex-file-compressed 19724608 / 19457084 / +1.4% 87593519 / 88817710 / -1.4% 0.23 / 0.22 / +2.8%
fineweb_q08/duckdb:vortex-file-compressed 4366796 / 4311257 / +1.3% 13446680 / 13685961 / -1.7% 0.32 / 0.32 / +3.1%
duckdb / parquet / ns (1.023x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23799509 / 22859516 / +4.1% 28496318 / 27571377 / +3.4% 0.84 / 0.83 / +0.7%
fineweb_q01/duckdb:parquet 53463272 / 53319876 / +0.3% 71803020 / 73175083 / -1.9% 0.74 / 0.73 / +2.2%
fineweb_q02/duckdb:parquet 58192298 / 56970692 / +2.1% 71990572 / 80112905 / -10.1% 🟢 0.81 / 0.71 / +13.7%
fineweb_q03/duckdb:parquet 122660060 / 117366814 / +4.5% 180819229 / 178403413 / +1.4% 0.68 / 0.66 / +3.1%
fineweb_q04/duckdb:parquet 161370445 / 162799730 / -0.9% 203503727 / 201601982 / +0.9% 0.79 / 0.81 / -1.8%
fineweb_q05/duckdb:parquet 160143323 / 156353200 / +2.4% 197556520 / 198611530 / -0.5% 0.81 / 0.79 / +3.0%
fineweb_q06/duckdb:parquet 88072936 / 87204256 / +1.0% 143197776 / 143345903 / -0.1% 0.62 / 0.61 / +1.1%
fineweb_q07/duckdb:parquet 91235464 / 88988136 / +2.5% 144684828 / 145412729 / -0.5% 0.63 / 0.61 / +3.0%
fineweb_q08/duckdb:parquet 29281022 / 28070532 / +4.3% 30572350 / 30041810 / +1.8% 0.96 / 0.93 / +2.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 43742ab2 vs base d7aa24e8
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.986x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.003x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15471520 / 15708166 / -1.5% 40861307 / 42160434 / -3.1% 0.38 / 0.37 / +1.6%
tpch_q02/datafusion:vortex-file-compressed 17418676 / 17735831 / -1.8% 35439081 / 36361044 / -2.5% 0.49 / 0.49 / +0.8%
tpch_q03/datafusion:vortex-file-compressed 19549449 / 19275996 / +1.4% 42766597 / 43226363 / -1.1% 0.46 / 0.45 / +2.5%
tpch_q04/datafusion:vortex-file-compressed 10134545 / 10628425 / -4.6% 33220385 / 35280355 / -5.8% 0.31 / 0.30 / +1.3%
tpch_q05/datafusion:vortex-file-compressed 37636788 / 37162632 / +1.3% 64348291 / 66420141 / -3.1% 0.58 / 0.56 / +4.5%
tpch_q06/datafusion:vortex-file-compressed 4252085 / 4595931 / -7.5% 24102088 / 27239354 / -11.5% 🟢 0.18 / 0.17 / +4.6%
tpch_q07/datafusion:vortex-file-compressed 52841744 / 52689678 / +0.3% 78827064 / 82558756 / -4.5% 0.67 / 0.64 / +5.0%
tpch_q08/datafusion:vortex-file-compressed 52348645 / 51736045 / +1.2% 84177401 / 77922709 / +8.0% 0.62 / 0.66 / -6.3%
tpch_q09/datafusion:vortex-file-compressed 47962130 / 47894231 / +0.1% 77470411 / 80588072 / -3.9% 0.62 / 0.59 / +4.2%
tpch_q10/datafusion:vortex-file-compressed 17229254 / 17382514 / -0.9% 47248531 / 47793642 / -1.1% 0.36 / 0.36 / +0.3%
tpch_q11/datafusion:vortex-file-compressed 14808758 / 14847615 / -0.3% 34091122 / 33487351 / +1.8% 0.43 / 0.44 / -2.0%
tpch_q12/datafusion:vortex-file-compressed 18459724 / 18742356 / -1.5% 39650338 / 43214659 / -8.2% 0.47 / 0.43 / +7.3%
tpch_q13/datafusion:vortex-file-compressed 19046693 / 18991960 / +0.3% 39105008 / 41801647 / -6.5% 0.49 / 0.45 / +7.2%
tpch_q14/datafusion:vortex-file-compressed 14163651 / 14087291 / +0.5% 36768279 / 37221952 / -1.2% 0.39 / 0.38 / +1.8%
tpch_q15/datafusion:vortex-file-compressed 18372002 / 18549551 / -1.0% 44234846 / 45885747 / -3.6% 0.42 / 0.40 / +2.7%
tpch_q16/datafusion:vortex-file-compressed 18408398 / 18348662 / +0.3% 37914870 / 37932680 / -0.0% 0.49 / 0.48 / +0.4%
tpch_q17/datafusion:vortex-file-compressed 29090368 / 29327244 / -0.8% 57531640 / 56823800 / +1.2% 0.51 / 0.52 / -2.0%
tpch_q18/datafusion:vortex-file-compressed 36475738 / 36406615 / +0.2% 56898002 / 58234292 / -2.3% 0.64 / 0.63 / +2.5%
tpch_q19/datafusion:vortex-file-compressed 9502542 / 9384463 / +1.3% 33036789 / 32868224 / +0.5% 0.29 / 0.29 / +0.7%
tpch_q20/datafusion:vortex-file-compressed 20920479 / 20748223 / +0.8% 45073252 / 45294394 / -0.5% 0.46 / 0.46 / +1.3%
tpch_q21/datafusion:vortex-file-compressed 35668762 / 35152195 / +1.5% 65040331 / 64155373 / +1.4% 0.55 / 0.55 / +0.1%
tpch_q22/datafusion:vortex-file-compressed 10960691 / 10985616 / -0.2% 29585690 / 30451654 / -2.8% 0.37 / 0.36 / +2.7%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71353555 / 71284842 / +0.1% 87454262 / 86857227 / +0.7% 0.82 / 0.82 / -0.6%
tpch_q02/datafusion:parquet 75943304 / 75804481 / +0.2% 91548791 / 91412069 / +0.1% 0.83 / 0.83 / +0.0%
tpch_q03/datafusion:parquet 82201236 / 81763234 / +0.5% 102886609 / 101305055 / +1.6% 0.80 / 0.81 / -1.0%
tpch_q04/datafusion:parquet 39773520 / 39496580 / +0.7% 55769358 / 58009338 / -3.9% 0.71 / 0.68 / +4.7%
tpch_q05/datafusion:parquet 110029044 / 110367841 / -0.3% 137221675 / 135918063 / +1.0% 0.80 / 0.81 / -1.3%
tpch_q06/datafusion:parquet 31243877 / 31615700 / -1.2% 47128986 / 46854849 / +0.6% 0.66 / 0.67 / -1.8%
tpch_q07/datafusion:parquet 111934796 / 112622408 / -0.6% 135643240 / 138563611 / -2.1% 0.83 / 0.81 / +1.5%
tpch_q08/datafusion:parquet 117634658 / 117439216 / +0.2% 142201734 / 141624609 / +0.4% 0.83 / 0.83 / -0.2%
tpch_q09/datafusion:parquet 137640708 / 137425928 / +0.2% 165523695 / 165735503 / -0.1% 0.83 / 0.83 / +0.3%
tpch_q10/datafusion:parquet 103960365 / 103902783 / +0.1% 126103027 / 125414392 / +0.5% 0.82 / 0.83 / -0.5%
tpch_q11/datafusion:parquet 61725811 / 62092975 / -0.6% 79631569 / 78137480 / +1.9% 0.78 / 0.79 / -2.5%
tpch_q12/datafusion:parquet 63883059 / 63756924 / +0.2% 82223663 / 82472865 / -0.3% 0.78 / 0.77 / +0.5%
tpch_q13/datafusion:parquet 143264055 / 142502979 / +0.5% 160599943 / 161066364 / -0.3% 0.89 / 0.88 / +0.8%
tpch_q14/datafusion:parquet 47688749 / 47966037 / -0.6% 67203453 / 67550259 / -0.5% 0.71 / 0.71 / -0.1%
tpch_q15/datafusion:parquet 73895905 / 74322916 / -0.6% 93128521 / 94205745 / -1.1% 0.79 / 0.79 / +0.6%
tpch_q16/datafusion:parquet 43568374 / 43765582 / -0.5% 61152813 / 60751859 / +0.7% 0.71 / 0.72 / -1.1%
tpch_q17/datafusion:parquet 122862112 / 122868920 / -0.0% 144116790 / 144273328 / -0.1% 0.85 / 0.85 / +0.1%
tpch_q18/datafusion:parquet 120756673 / 120858757 / -0.1% 139532240 / 141250777 / -1.2% 0.87 / 0.86 / +1.1%
tpch_q19/datafusion:parquet 57735241 / 56757323 / +1.7% 81443856 / 79197448 / +2.8% 0.71 / 0.72 / -1.1%
tpch_q20/datafusion:parquet 78527549 / 78514613 / +0.0% 98284778 / 99742546 / -1.5% 0.80 / 0.79 / +1.5%
tpch_q21/datafusion:parquet 113380931 / 113257373 / +0.1% 139452972 / 140429738 / -0.7% 0.81 / 0.81 / +0.8%
tpch_q22/datafusion:parquet 52291627 / 51689426 / +1.2% 65967254 / 66142217 / -0.3% 0.79 / 0.78 / +1.4%
duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9366282 / 8943460 / +4.7% 18060784 / 18181383 / -0.7% 0.52 / 0.49 / +5.4%
tpch_q02/duckdb:vortex-file-compressed 15046043 / 14993435 / +0.4% 25342383 / 25230893 / +0.4% 0.59 / 0.59 / -0.1%
tpch_q03/duckdb:vortex-file-compressed 18472396 / 18498894 / -0.1% 32679525 / 34011740 / -3.9% 0.57 / 0.54 / +3.9%
tpch_q04/duckdb:vortex-file-compressed 11961448 / 12181556 / -1.8% 25092736 / 24757368 / +1.4% 0.48 / 0.49 / -3.1%
tpch_q05/duckdb:vortex-file-compressed 19727470 / 19380833 / +1.8% 34269654 / 34750533 / -1.4% 0.58 / 0.56 / +3.2%
tpch_q06/duckdb:vortex-file-compressed 4447312 / 4690955 / -5.2% 13229397 / 13325587 / -0.7% 0.34 / 0.35 / -4.5%
tpch_q07/duckdb:vortex-file-compressed 23989846 / 24054114 / -0.3% 39209841 / 40325598 / -2.8% 0.61 / 0.60 / +2.6%
tpch_q08/duckdb:vortex-file-compressed 21083685 / 21188863 / -0.5% 36518525 / 36295424 / +0.6% 0.58 / 0.58 / -1.1%
tpch_q09/duckdb:vortex-file-compressed 21941914 / 22488113 / -2.4% 37158859 / 36810285 / +0.9% 0.59 / 0.61 / -3.3%
tpch_q10/duckdb:vortex-file-compressed 27202213 / 27367174 / -0.6% 43969821 / 43452402 / +1.2% 0.62 / 0.63 / -1.8%
tpch_q11/duckdb:vortex-file-compressed 8034750 / 8221511 / -2.3% 17021138 / 16483612 / +3.3% 0.47 / 0.50 / -5.4%
tpch_q12/duckdb:vortex-file-compressed 14765044 / 14374289 / +2.7% 25016763 / 25468796 / -1.8% 0.59 / 0.56 / +4.6%
tpch_q13/duckdb:vortex-file-compressed 20080449 / 19428107 / +3.4% 32035609 / 31974556 / +0.2% 0.63 / 0.61 / +3.2%
tpch_q14/duckdb:vortex-file-compressed 11318417 / 11313066 / +0.0% 23099679 / 23854561 / -3.2% 0.49 / 0.47 / +3.3%
tpch_q15/duckdb:vortex-file-compressed 8257537 / 8319908 / -0.7% 18937807 / 18995256 / -0.3% 0.44 / 0.44 / -0.4%
tpch_q16/duckdb:vortex-file-compressed 16538259 / 16328434 / +1.3% 23072793 / 22777354 / +1.3% 0.72 / 0.72 / -0.0%
tpch_q17/duckdb:vortex-file-compressed 12563909 / 12733002 / -1.3% 27052366 / 26703794 / +1.3% 0.46 / 0.48 / -2.6%
tpch_q18/duckdb:vortex-file-compressed 24111244 / 24327486 / -0.9% 33444998 / 33906009 / -1.4% 0.72 / 0.72 / +0.5%
tpch_q19/duckdb:vortex-file-compressed 11736185 / 11706255 / +0.3% 23974365 / 25054473 / -4.3% 0.49 / 0.47 / +4.8%
tpch_q20/duckdb:vortex-file-compressed 14474193 / 14250277 / +1.6% 29610502 / 29712006 / -0.3% 0.49 / 0.48 / +1.9%
tpch_q21/duckdb:vortex-file-compressed 49051991 / 48863097 / +0.4% 64219029 / 65067087 / -1.3% 0.76 / 0.75 / +1.7%
tpch_q22/duckdb:vortex-file-compressed 16773869 / 16510478 / +1.6% 26394886 / 26442559 / -0.2% 0.64 / 0.62 / +1.8%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 47459378 / 47469901 / -0.0% 53164286 / 53641260 / -0.9% 0.89 / 0.88 / +0.9%
tpch_q02/duckdb:parquet 48439615 / 48252529 / +0.4% 55434619 / 54735397 / +1.3% 0.87 / 0.88 / -0.9%
tpch_q03/duckdb:parquet 60225530 / 60381018 / -0.3% 67863698 / 67552334 / +0.5% 0.89 / 0.89 / -0.7%
tpch_q04/duckdb:parquet 34742348 / 34933178 / -0.5% 42148987 / 42091485 / +0.1% 0.82 / 0.83 / -0.7%
tpch_q05/duckdb:parquet 67296750 / 67183513 / +0.2% 76501278 / 75995137 / +0.7% 0.88 / 0.88 / -0.5%
tpch_q06/duckdb:parquet 21518399 / 21940222 / -1.9% 27238121 / 26184920 / +4.0% 0.79 / 0.84 / -5.7%
tpch_q07/duckdb:parquet 63854831 / 63827685 / +0.0% 72205868 / 71786142 / +0.6% 0.88 / 0.89 / -0.5%
tpch_q08/duckdb:parquet 75457587 / 75570158 / -0.1% 85663904 / 85936262 / -0.3% 0.88 / 0.88 / +0.2%
tpch_q09/duckdb:parquet 107777724 / 107475986 / +0.3% 119459351 / 117606505 / +1.6% 0.90 / 0.91 / -1.3%
tpch_q10/duckdb:parquet 105366896 / 105555143 / -0.2% 116075034 / 115668353 / +0.4% 0.91 / 0.91 / -0.5%
tpch_q11/duckdb:parquet 29372264 / 29454515 / -0.3% 34678665 / 34372343 / +0.9% 0.85 / 0.86 / -1.2%
tpch_q12/duckdb:parquet 37125964 / 37062804 / +0.2% 43388129 / 43474471 / -0.2% 0.86 / 0.85 / +0.4%
tpch_q13/duckdb:parquet 174159791 / 174740981 / -0.3% 181077487 / 180748808 / +0.2% 0.96 / 0.97 / -0.5%
tpch_q14/duckdb:parquet 42270020 / 42239252 / +0.1% 50718267 / 50667472 / +0.1% 0.83 / 0.83 / -0.0%
tpch_q15/duckdb:parquet 32606216 / 32488450 / +0.4% 40670064 / 40555434 / +0.3% 0.80 / 0.80 / +0.1%
tpch_q16/duckdb:parquet 46887677 / 46885581 / +0.0% 52172287 / 51356589 / +1.6% 0.90 / 0.91 / -1.6%
tpch_q17/duckdb:parquet 47837711 / 47757183 / +0.2% 57431993 / 56517768 / +1.6% 0.83 / 0.84 / -1.4%
tpch_q18/duckdb:parquet 73875487 / 73277812 / +0.8% 80248020 / 80222718 / +0.0% 0.92 / 0.91 / +0.8%
tpch_q19/duckdb:parquet 48688123 / 48275460 / +0.9% 56953961 / 56726606 / +0.4% 0.85 / 0.85 / +0.5%
tpch_q20/duckdb:parquet 63444982 / 63333903 / +0.2% 72725859 / 72324816 / +0.6% 0.87 / 0.88 / -0.4%
tpch_q21/duckdb:parquet 106445490 / 106464589 / -0.0% 115477776 / 115133640 / +0.3% 0.92 / 0.92 / -0.3%
tpch_q22/duckdb:parquet 50380168 / 50310482 / +0.1% 57949630 / 57572003 / +0.7% 0.87 / 0.87 / -0.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 43742ab2 vs base d7aa24e8
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.980x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.976x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.992x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1257312 / 1231584 / +2.1% 21528060 / 22563118 / -4.6% 0.06 / 0.05 / +7.0%
clickbench_q01/datafusion:vortex-file-compressed 5790926 / 5598512 / +3.4% 28792225 / 30049883 / -4.2% 0.20 / 0.19 / +8.0%
clickbench_q02/datafusion:vortex-file-compressed 10517637 / 10906792 / -3.6% 42049549 / 46546481 / -9.7% 0.25 / 0.23 / +6.7%
clickbench_q03/datafusion:vortex-file-compressed 13002776 / 13365216 / -2.7% 51108679 / 58617903 / -12.8% 🟢 0.25 / 0.23 / +11.6%
clickbench_q04/datafusion:vortex-file-compressed 58965321 / 57775408 / +2.1% 100172971 / 105127146 / -4.7% 0.59 / 0.55 / +7.1%
clickbench_q05/datafusion:vortex-file-compressed 77832559 / 77663014 / +0.2% 126794795 / 131851616 / -3.8% 0.61 / 0.59 / +4.2%
clickbench_q06/datafusion:vortex-file-compressed 1216169 / 1259746 / -3.5% 21633134 / 23163069 / -6.6% 0.06 / 0.05 / +3.4%
clickbench_q07/datafusion:vortex-file-compressed 8887258 / 8951519 / -0.7% 33899982 / 33809896 / +0.3% 0.26 / 0.26 / -1.0%
clickbench_q08/datafusion:vortex-file-compressed 79576374 / 79139944 / +0.6% 127310668 / 130163597 / -2.2% 0.63 / 0.61 / +2.8%
clickbench_q09/datafusion:vortex-file-compressed 171532726 / 175615552 / -2.3% 212836295 / 218929560 / -2.8% 0.81 / 0.80 / +0.5%
clickbench_q10/datafusion:vortex-file-compressed 21674488 / 23472476 / -7.7% 66702920 / 70165937 / -4.9% 0.32 / 0.33 / -2.9%
clickbench_q11/datafusion:vortex-file-compressed 23572938 / 23992488 / -1.7% 65698057 / 71094279 / -7.6% 0.36 / 0.34 / +6.3%
clickbench_q12/datafusion:vortex-file-compressed 73964221 / 73270975 / +0.9% 125135415 / 126159459 / -0.8% 0.59 / 0.58 / +1.8%
clickbench_q13/datafusion:vortex-file-compressed 114729152 / 115853852 / -1.0% 187195379 / 185165589 / +1.1% 0.61 / 0.63 / -2.0%
clickbench_q14/datafusion:vortex-file-compressed 76548634 / 76265401 / +0.4% 128280334 / 129901119 / -1.2% 0.60 / 0.59 / +1.6%
clickbench_q15/datafusion:vortex-file-compressed 64439314 / 64491220 / -0.1% 102356285 / 99033783 / +3.4% 0.63 / 0.65 / -3.3%
clickbench_q16/datafusion:vortex-file-compressed 155633510 / 153405008 / +1.5% 217788581 / 222355048 / -2.1% 0.71 / 0.69 / +3.6%
clickbench_q17/datafusion:vortex-file-compressed 156200520 / 152154616 / +2.7% 223050823 / 226673397 / -1.6% 0.70 / 0.67 / +4.3%
clickbench_q18/datafusion:vortex-file-compressed 299448471 / 298941856 / +0.2% 386301265 / 389792330 / -0.9% 0.78 / 0.77 / +1.1%
clickbench_q19/datafusion:vortex-file-compressed 6952360 / 7608506 / -8.6% 42257720 / 49156267 / -14.0% 🟢 0.16 / 0.15 / +6.3%
clickbench_q20/datafusion:vortex-file-compressed 64371301 / 67086946 / -4.0% 247428250 / 249200189 / -0.7% 0.26 / 0.27 / -3.4%
clickbench_q21/datafusion:vortex-file-compressed 74307473 / 77488294 / -4.1% 291952864 / 288532138 / +1.2% 0.25 / 0.27 / -5.2%
clickbench_q22/datafusion:vortex-file-compressed 91422155 / 90494402 / +1.0% 399784120 / 393864369 / +1.5% 0.23 / 0.23 / -0.5%
clickbench_q23/datafusion:vortex-file-compressed 96962085 / 84018120 / +15.4% 🔴 383192188 / 394660777 / -2.9% 0.25 / 0.21 / +18.9%
clickbench_q24/datafusion:vortex-file-compressed 8312792 / 8930017 / -6.9% 56490232 / 55065847 / +2.6% 0.15 / 0.16 / -9.3%
clickbench_q25/datafusion:vortex-file-compressed 17936276 / 18281185 / -1.9% 63045749 / 63016025 / +0.0% 0.28 / 0.29 / -1.9%
clickbench_q26/datafusion:vortex-file-compressed 14494898 / 14725291 / -1.6% 68559836 / 68809370 / -0.4% 0.21 / 0.21 / -1.2%
clickbench_q27/datafusion:vortex-file-compressed 95528222 / 99450384 / -3.9% 256377921 / 249892594 / +2.6% 0.37 / 0.40 / -6.4%
clickbench_q28/datafusion:vortex-file-compressed 559546669 / 555080434 / +0.8% 630872351 / 630675762 / +0.0% 0.89 / 0.88 / +0.8%
clickbench_q29/datafusion:vortex-file-compressed 24046718 / 24268222 / -0.9% 57077550 / 58148567 / -1.8% 0.42 / 0.42 / +0.9%
clickbench_q30/datafusion:vortex-file-compressed 54124891 / 55548636 / -2.6% 111155208 / 110720621 / +0.4% 0.49 / 0.50 / -2.9%
clickbench_q31/datafusion:vortex-file-compressed 65680933 / 65224461 / +0.7% 155382450 / 158842744 / -2.2% 0.42 / 0.41 / +2.9%
clickbench_q32/datafusion:vortex-file-compressed 295793577 / 288976620 / +2.4% 382277694 / 388204007 / -1.5% 0.77 / 0.74 / +3.9%
clickbench_q33/datafusion:vortex-file-compressed 318897525 / 319814310 / -0.3% 424978055 / 436389043 / -2.6% 0.75 / 0.73 / +2.4%
clickbench_q34/datafusion:vortex-file-compressed 322050892 / 319607722 / +0.8% 437023177 / 441245251 / -1.0% 0.74 / 0.72 / +1.7%
clickbench_q35/datafusion:vortex-file-compressed 58147376 / 57711351 / +0.8% 91797274 / 92503621 / -0.8% 0.63 / 0.62 / +1.5%
clickbench_q36/datafusion:vortex-file-compressed 37692414 / 37475988 / +0.6% 66937396 / 69574954 / -3.8% 0.56 / 0.54 / +4.5%
clickbench_q37/datafusion:vortex-file-compressed 20735121 / 20921030 / -0.9% 47357093 / 50171404 / -5.6% 0.44 / 0.42 / +5.0%
clickbench_q38/datafusion:vortex-file-compressed 12815336 / 12923860 / -0.8% 42076021 / 42291614 / -0.5% 0.30 / 0.31 / -0.3%
clickbench_q39/datafusion:vortex-file-compressed 78466132 / 78708306 / -0.3% 113183597 / 110468816 / +2.5% 0.69 / 0.71 / -2.7%
clickbench_q40/datafusion:vortex-file-compressed 9878952 / 10170686 / -2.9% 35599603 / 36723643 / -3.1% 0.28 / 0.28 / +0.2%
clickbench_q41/datafusion:vortex-file-compressed 9613216 / 9736702 / -1.3% 34333527 / 37528491 / -8.5% 0.28 / 0.26 / +7.9%
clickbench_q42/datafusion:vortex-file-compressed 9459818 / 9778970 / -3.3% 35384435 / 35878381 / -1.4% 0.27 / 0.27 / -1.9%
datafusion / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1279250 / 1283262 / -0.3% 48926792 / 50629678 / -3.4% 0.03 / 0.03 / +3.2%
clickbench_q01/datafusion:parquet 15909014 / 16507863 / -3.6% 66690649 / 75626636 / -11.8% 🟢 0.24 / 0.22 / +9.3%
clickbench_q02/datafusion:parquet 19032679 / 18962001 / +0.4% 82442713 / 84299890 / -2.2% 0.23 / 0.22 / +2.6%
clickbench_q03/datafusion:parquet 17156470 / 16967894 / +1.1% 78404933 / 82197839 / -4.6% 0.22 / 0.21 / +6.0%
clickbench_q04/datafusion:parquet 63261656 / 63988052 / -1.1% 122413846 / 130607484 / -6.3% 0.52 / 0.49 / +5.5%
clickbench_q05/datafusion:parquet 88156981 / 88828458 / -0.8% 152069333 / 157748315 / -3.6% 0.58 / 0.56 / +3.0%
clickbench_q06/datafusion:parquet 1278509 / 1275362 / +0.2% 50084547 / 51554737 / -2.9% 0.03 / 0.02 / +3.2%
clickbench_q07/datafusion:parquet 16657116 / 16821828 / -1.0% 68380212 / 70650734 / -3.2% 0.24 / 0.24 / +2.3%
clickbench_q08/datafusion:parquet 85132312 / 87905904 / -3.2% 152446091 / 170046097 / -10.4% 🟢 0.56 / 0.52 / +8.0%
clickbench_q09/datafusion:parquet 189393926 / 187073678 / +1.2% 264100632 / 270801791 / -2.5% 0.72 / 0.69 / +3.8%
clickbench_q10/datafusion:parquet 36194287 / 36711324 / -1.4% 98855248 / 102458257 / -3.5% 0.37 / 0.36 / +2.2%
clickbench_q11/datafusion:parquet 43706414 / 43335910 / +0.9% 106711361 / 110189651 / -3.2% 0.41 / 0.39 / +4.1%
clickbench_q12/datafusion:parquet 95737518 / 95701143 / +0.0% 157991969 / 166152796 / -4.9% 0.61 / 0.58 / +5.2%
clickbench_q13/datafusion:parquet 147725857 / 148645272 / -0.6% 226398526 / 230507075 / -1.8% 0.65 / 0.64 / +1.2%
clickbench_q14/datafusion:parquet 101654709 / 102056766 / -0.4% 170187193 / 178091551 / -4.4% 0.60 / 0.57 / +4.2%
clickbench_q15/datafusion:parquet 73215541 / 70676640 / +3.6% 134294336 / 133664505 / +0.5% 0.55 / 0.53 / +3.1%
clickbench_q16/datafusion:parquet 154858798 / 158273696 / -2.2% 232778121 / 242076697 / -3.8% 0.67 / 0.65 / +1.8%
clickbench_q17/datafusion:parquet 156415524 / 157315734 / -0.6% 235640856 / 239357467 / -1.6% 0.66 / 0.66 / +1.0%
clickbench_q18/datafusion:parquet 311233504 / 310494370 / +0.2% 418890190 / 419320923 / -0.1% 0.74 / 0.74 / +0.3%
clickbench_q19/datafusion:parquet 19020782 / 19533232 / -2.6% 77046951 / 81334581 / -5.3% 0.25 / 0.24 / +2.8%
clickbench_q20/datafusion:parquet 177924434 / 180023051 / -1.2% 276316822 / 298310765 / -7.4% 0.64 / 0.60 / +6.7%
clickbench_q21/datafusion:parquet 172219266 / 175004200 / -1.6% 287405726 / 317967094 / -9.6% 0.60 / 0.55 / +8.9%
clickbench_q22/datafusion:parquet 260088441 / 262520834 / -0.9% 416024605 / 456014020 / -8.8% 0.63 / 0.58 / +8.6%
clickbench_q23/datafusion:parquet 1006935200 / 1008622224 / -0.2% 1178242062 / 1184271306 / -0.5% 0.85 / 0.85 / +0.3%
clickbench_q24/datafusion:parquet 29155718 / 30608514 / -4.7% 89334636 / 94137693 / -5.1% 0.33 / 0.33 / +0.4%
clickbench_q25/datafusion:parquet 36422902 / 36150743 / +0.8% 100417109 / 107019594 / -6.2% 0.36 / 0.34 / +7.4%
clickbench_q26/datafusion:parquet 30402625 / 30440332 / -0.1% 87528466 / 94178604 / -7.1% 0.35 / 0.32 / +7.5%
clickbench_q27/datafusion:parquet 192175788 / 192653844 / -0.2% 285085207 / 300622822 / -5.2% 0.67 / 0.64 / +5.2%
clickbench_q28/datafusion:parquet 614770736 / 621838413 / -1.1% 700061236 / 712400913 / -1.7% 0.88 / 0.87 / +0.6%
clickbench_q29/datafusion:parquet 28718658 / 29435682 / -2.4% 90044904 / 90815600 / -0.8% 0.32 / 0.32 / -1.6%
clickbench_q30/datafusion:parquet 89738612 / 91086392 / -1.5% 165659384 / 176307967 / -6.0% 0.54 / 0.52 / +4.9%
clickbench_q31/datafusion:parquet 102789794 / 102942819 / -0.1% 192439493 / 202192637 / -4.8% 0.53 / 0.51 / +4.9%
clickbench_q32/datafusion:parquet 308560800 / 307601552 / +0.3% 422620481 / 430824577 / -1.9% 0.73 / 0.71 / +2.3%
clickbench_q33/datafusion:parquet 375749128 / 377815585 / -0.5% 472491885 / 477155363 / -1.0% 0.80 / 0.79 / +0.4%
clickbench_q34/datafusion:parquet 376215074 / 378838828 / -0.7% 468421177 / 476629289 / -1.7% 0.80 / 0.79 / +1.0%
clickbench_q35/datafusion:parquet 64811552 / 64358212 / +0.7% 122809871 / 127522669 / -3.7% 0.53 / 0.50 / +4.6%
clickbench_q36/datafusion:parquet 73548834 / 74164178 / -0.8% 135455380 / 137929832 / -1.8% 0.54 / 0.54 / +1.0%
clickbench_q37/datafusion:parquet 35764846 / 35832856 / -0.2% 92895039 / 92641075 / +0.3% 0.39 / 0.39 / -0.5%
clickbench_q38/datafusion:parquet 47792734 / 48136081 / -0.7% 108400877 / 108479475 / -0.1% 0.44 / 0.44 / -0.6%
clickbench_q39/datafusion:parquet 143120378 / 143197912 / -0.1% 208518928 / 213713697 / -2.4% 0.69 / 0.67 / +2.4%
clickbench_q40/datafusion:parquet 19869873 / 20259062 / -1.9% 77275758 / 78067557 / -1.0% 0.26 / 0.26 / -0.9%
clickbench_q41/datafusion:parquet 19038268 / 19118340 / -0.4% 76247223 / 75529754 / +0.9% 0.25 / 0.25 / -1.4%
clickbench_q42/datafusion:parquet 19141099 / 18961314 / +0.9% 75250337 / 76291993 / -1.4% 0.25 / 0.25 / +2.3%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2186840 / 2207791 / -0.9% 25802245 / 24598505 / +4.9% 0.08 / 0.09 / -5.6%
clickbench_q01/duckdb:vortex-file-compressed 7508860 / 7056122 / +6.4% 30776378 / 28258177 / +8.9% 0.24 / 0.25 / -2.3%
clickbench_q02/duckdb:vortex-file-compressed 8959600 / 9175024 / -2.3% 35902110 / 34699618 / +3.5% 0.25 / 0.26 / -5.6%
clickbench_q03/duckdb:vortex-file-compressed 14065712 / 13886898 / +1.3% 45480041 / 47971230 / -5.2% 0.31 / 0.29 / +6.8%
clickbench_q04/duckdb:vortex-file-compressed 56156640 / 56466766 / -0.5% 88036927 / 90569148 / -2.8% 0.64 / 0.62 / +2.3%
clickbench_q05/duckdb:vortex-file-compressed 63328165 / 64228346 / -1.4% 93169122 / 96178374 / -3.1% 0.68 / 0.67 / +1.8%
clickbench_q06/duckdb:vortex-file-compressed 2585380 / 2666692 / -3.0% 32163631 / 31514238 / +2.1% 0.08 / 0.08 / -5.0%
clickbench_q07/duckdb:vortex-file-compressed 9158040 / 8884340 / +3.1% 33627142 / 28539420 / +17.8% 🔴 0.27 / 0.31 / -12.5%
clickbench_q08/duckdb:vortex-file-compressed 72023488 / 69621631 / +3.4% 101592411 / 108592420 / -6.4% 0.71 / 0.64 / +10.6%
clickbench_q09/duckdb:vortex-file-compressed 91340992 / 94470864 / -3.3% 117080196 / 127227936 / -8.0% 0.78 / 0.74 / +5.1%
clickbench_q10/duckdb:vortex-file-compressed 27076985 / 27105020 / -0.1% 63076185 / 70934138 / -11.1% 🟢 0.43 / 0.38 / +12.3%
clickbench_q11/duckdb:vortex-file-compressed 29431398 / 29675284 / -0.8% 66352922 / 74269726 / -10.7% 🟢 0.44 / 0.40 / +11.0%
clickbench_q12/duckdb:vortex-file-compressed 68193952 / 68728866 / -0.8% 100451765 / 96996146 / +3.6% 0.68 / 0.71 / -4.2%
clickbench_q13/duckdb:vortex-file-compressed 117079100 / 117102564 / -0.0% 160179772 / 164621994 / -2.7% 0.73 / 0.71 / +2.8%
clickbench_q14/duckdb:vortex-file-compressed 73044302 / 73721694 / -0.9% 100480541 / 103620946 / -3.0% 0.73 / 0.71 / +2.2%
clickbench_q15/duckdb:vortex-file-compressed 76505095 / 76270248 / +0.3% 106737235 / 109508680 / -2.5% 0.72 / 0.70 / +2.9%
clickbench_q16/duckdb:vortex-file-compressed 132098254 / 134845982 / -2.0% 167341205 / 168751142 / -0.8% 0.79 / 0.80 / -1.2%
clickbench_q17/duckdb:vortex-file-compressed 137707908 / 140559530 / -2.0% 166628481 / 173092981 / -3.7% 0.83 / 0.81 / +1.8%
clickbench_q18/duckdb:vortex-file-compressed 257970042 / 256140961 / +0.7% 301522561 / 301396732 / +0.0% 0.86 / 0.85 / +0.7%
clickbench_q19/duckdb:vortex-file-compressed 8893937 / 8654757 / +2.8% 35667409 / 35156735 / +1.5% 0.25 / 0.25 / +1.3%
clickbench_q20/duckdb:vortex-file-compressed 67603644 / 67213822 / +0.6% 161051961 / 166396450 / -3.2% 0.42 / 0.40 / +3.9%
clickbench_q21/duckdb:vortex-file-compressed 72178002 / 74610806 / -3.3% 183650285 / 187061171 / -1.8% 0.39 / 0.40 / -1.5%
clickbench_q22/duckdb:vortex-file-compressed 106753949 / 109514620 / -2.5% 302057300 / 317054272 / -4.7% 0.35 / 0.35 / +2.3%
clickbench_q23/duckdb:vortex-file-compressed 65057826 / 66207525 / -1.7% 180042030 / 180643200 / -0.3% 0.36 / 0.37 / -1.4%
clickbench_q24/duckdb:vortex-file-compressed 16707224 / 17058812 / -2.1% 45116053 / 53504544 / -15.7% 🟢 0.37 / 0.32 / +16.1%
clickbench_q25/duckdb:vortex-file-compressed 18158792 / 18894857 / -3.9% 50803081 / 54402144 / -6.6% 0.36 / 0.35 / +2.9%
clickbench_q26/duckdb:vortex-file-compressed 13105540 / 13815432 / -5.1% 40942455 / 44356334 / -7.7% 0.32 / 0.31 / +2.8%
clickbench_q27/duckdb:vortex-file-compressed 49061348 / 49300377 / -0.5% 172585014 / 174341413 / -1.0% 0.28 / 0.28 / +0.5%
clickbench_q28/duckdb:vortex-file-compressed 510185848 / 515264172 / -1.0% 551950441 / 560008474 / -1.4% 0.92 / 0.92 / +0.5%
clickbench_q29/duckdb:vortex-file-compressed 17312882 / 16988354 / +1.9% 44039713 / 42200896 / +4.4% 0.39 / 0.40 / -2.3%
clickbench_q30/duckdb:vortex-file-compressed 60264684 / 59925225 / +0.6% 103707060 / 112400415 / -7.7% 0.58 / 0.53 / +9.0%
clickbench_q31/duckdb:vortex-file-compressed 108588222 / 109348144 / -0.7% 183698774 / 176867685 / +3.9% 0.59 / 0.62 / -4.4%
clickbench_q32/duckdb:vortex-file-compressed 378157396 / 377674655 / +0.1% 404045010 / 413356198 / -2.3% 0.94 / 0.91 / +2.4%
clickbench_q33/duckdb:vortex-file-compressed 344990928 / 344271764 / +0.2% 397470554 / 400987391 / -0.9% 0.87 / 0.86 / +1.1%
clickbench_q34/duckdb:vortex-file-compressed 353419073 / 348378860 / +1.4% 416006608 / 407763956 / +2.0% 0.85 / 0.85 / -0.6%
clickbench_q35/duckdb:vortex-file-compressed 57964378 / 57514812 / +0.8% 84701779 / 89019476 / -4.9% 0.68 / 0.65 / +5.9%
clickbench_q36/duckdb:vortex-file-compressed 11317754 / 11182206 / +1.2% 31620687 / 32912358 / -3.9% 0.36 / 0.34 / +5.3%
clickbench_q37/duckdb:vortex-file-compressed 7507884 / 7490510 / +0.2% 29458677 / 27858214 / +5.7% 0.25 / 0.27 / -5.2%
clickbench_q38/duckdb:vortex-file-compressed 8273735 / 8323201 / -0.6% 29195539 / 29496330 / -1.0% 0.28 / 0.28 / +0.4%
clickbench_q39/duckdb:vortex-file-compressed 17960432 / 19086515 / -5.9% 42558056 / 41384842 / +2.8% 0.42 / 0.46 / -8.5%
clickbench_q40/duckdb:vortex-file-compressed 6933938 / 6862740 / +1.0% 28506761 / 31229164 / -8.7% 0.24 / 0.22 / +10.7%
clickbench_q41/duckdb:vortex-file-compressed 7759644 / 7770464 / -0.1% 30173055 / 29496028 / +2.3% 0.26 / 0.26 / -2.4%
clickbench_q42/duckdb:vortex-file-compressed 6990001 / 7009892 / -0.3% 28869680 / 25186113 / +14.6% 🔴 0.24 / 0.28 / -13.0%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9603996 / 9557647 / +0.5% 14809686 / 14574642 / +1.6% 0.65 / 0.66 / -1.1%
clickbench_q01/duckdb:parquet 14786788 / 15426185 / -4.1% 20152651 / 21029209 / -4.2% 0.73 / 0.73 / +0.0%
clickbench_q02/duckdb:parquet 22228279 / 22590549 / -1.6% 30015221 / 33032719 / -9.1% 0.74 / 0.68 / +8.3%
clickbench_q03/duckdb:parquet 23376020 / 23886704 / -2.1% 36271979 / 35214299 / +3.0% 0.64 / 0.68 / -5.0%
clickbench_q04/duckdb:parquet 61201664 / 61742696 / -0.9% 71639715 / 74946862 / -4.4% 0.85 / 0.82 / +3.7%
clickbench_q05/duckdb:parquet 82574700 / 84226354 / -2.0% 97467956 / 100298848 / -2.8% 0.85 / 0.84 / +0.9%
clickbench_q06/duckdb:parquet 20658936 / 21012426 / -1.7% 29931699 / 28230322 / +6.0% 0.69 / 0.74 / -7.3%
clickbench_q07/duckdb:parquet 17194414 / 17007672 / +1.1% 22421817 / 22817704 / -1.7% 0.77 / 0.75 / +2.9%
clickbench_q08/duckdb:parquet 75787226 / 75522970 / +0.3% 91790024 / 88117121 / +4.2% 0.83 / 0.86 / -3.7%
clickbench_q09/duckdb:parquet 102776474 / 103906907 / -1.1% 121202389 / 117419340 / +3.2% 0.85 / 0.88 / -4.2%
clickbench_q10/duckdb:parquet 41465309 / 41716046 / -0.6% 54396017 / 54276178 / +0.2% 0.76 / 0.77 / -0.8%
clickbench_q11/duckdb:parquet 46599956 / 46915330 / -0.7% 61665262 / 62806568 / -1.8% 0.76 / 0.75 / +1.2%
clickbench_q12/duckdb:parquet 92522346 / 94157099 / -1.7% 106960571 / 109418248 / -2.2% 0.87 / 0.86 / +0.5%
clickbench_q13/duckdb:parquet 147827166 / 152488185 / -3.1% 165353719 / 167799935 / -1.5% 0.89 / 0.91 / -1.6%
clickbench_q14/duckdb:parquet 99877269 / 101539222 / -1.6% 114241783 / 121067596 / -5.6% 0.87 / 0.84 / +4.2%
clickbench_q15/duckdb:parquet 85970816 / 86494982 / -0.6% 99830309 / 102495971 / -2.6% 0.86 / 0.84 / +2.0%
clickbench_q16/duckdb:parquet 167198671 / 169305826 / -1.2% 180490015 / 177041011 / +1.9% 0.93 / 0.96 / -3.1%
clickbench_q17/duckdb:parquet 172046184 / 165143636 / +4.2% 176726480 / 179220835 / -1.4% 0.97 / 0.92 / +5.7%
clickbench_q18/duckdb:parquet 287565832 / 293431196 / -2.0% 316913785 / 326413318 / -2.9% 0.91 / 0.90 / +0.9%
clickbench_q19/duckdb:parquet 20026771 / 20034800 / -0.0% 26802554 / 27280031 / -1.8% 0.75 / 0.73 / +1.7%
clickbench_q20/duckdb:parquet 179441051 / 184399334 / -2.7% 223477960 / 233208241 / -4.2% 0.80 / 0.79 / +1.5%
clickbench_q21/duckdb:parquet 215517816 / 217594782 / -1.0% 266838888 / 252283735 / +5.8% 0.81 / 0.86 / -6.4%
clickbench_q22/duckdb:parquet 327179351 / 316671470 / +3.3% 355194191 / 365095566 / -2.7% 0.92 / 0.87 / +6.2%
clickbench_q23/duckdb:parquet 169073062 / 171524256 / -1.4% 253291553 / 241460454 / +4.9% 0.67 / 0.71 / -6.0%
clickbench_q24/duckdb:parquet 30273048 / 29668554 / +2.0% 44279770 / 46787248 / -5.4% 0.68 / 0.63 / +7.8%
clickbench_q25/duckdb:parquet 42677652 / 42793428 / -0.3% 61149417 / 61696015 / -0.9% 0.70 / 0.69 / +0.6%
clickbench_q26/duckdb:parquet 30321368 / 31796519 / -4.6% 47421593 / 44533338 / +6.5% 0.64 / 0.71 / -10.4%
clickbench_q27/duckdb:parquet 196248476 / 194939532 / +0.7% 231858777 / 227917437 / +1.7% 0.85 / 0.86 / -1.0%
clickbench_q28/duckdb:parquet 952575816 / 960087446 / -0.8% 941204643 / 946179585 / -0.5% 1.01 / 1.01 / -0.3%
clickbench_q29/duckdb:parquet 24000306 / 24283422 / -1.2% 30624383 / 32798263 / -6.6% 0.78 / 0.74 / +5.8%
clickbench_q30/duckdb:parquet 106829786 / 106533104 / +0.3% 127649239 / 125205867 / +2.0% 0.84 / 0.85 / -1.6%
clickbench_q31/duckdb:parquet 157527110 / 157111873 / +0.3% 175211353 / 199625043 / -12.2% 🟢 0.90 / 0.79 / +14.2%
clickbench_q32/duckdb:parquet 384742307 / 384895152 / -0.0% 415573742 / 415060489 / +0.1% 0.93 / 0.93 / -0.2%
clickbench_q33/duckdb:parquet 467579307 / 490270718 / -4.6% 436713148 / 453299600 / -3.7% 1.07 / 1.08 / -1.0%
clickbench_q34/duckdb:parquet 472355752 / 474331958 / -0.4% 466504212 / 457989292 / +1.9% 1.01 / 1.04 / -2.2%
clickbench_q35/duckdb:parquet 61563024 / 61569118 / -0.0% 71465350 / 72669264 / -1.7% 0.86 / 0.85 / +1.7%
clickbench_q36/duckdb:parquet 29981628 / 30244834 / -0.9% 35619619 / 35452457 / +0.5% 0.84 / 0.85 / -1.3%
clickbench_q37/duckdb:parquet 23170007 / 23386720 / -0.9% 28911363 / 29923650 / -3.4% 0.80 / 0.78 / +2.5%
clickbench_q38/duckdb:parquet 23326896 / 23428532 / -0.4% 30291382 / 30000025 / +1.0% 0.77 / 0.78 / -1.4%
clickbench_q39/duckdb:parquet 53066363 / 52734192 / +0.6% 60971152 / 61061929 / -0.1% 0.87 / 0.86 / +0.8%
clickbench_q40/duckdb:parquet 15549883 / 14471764 / +7.4% 19331624 / 19773791 / -2.2% 0.80 / 0.73 / +9.9%
clickbench_q41/duckdb:parquet 15091716 / 15433256 / -2.2% 20548212 / 20366435 / +0.9% 0.73 / 0.76 / -3.1%
clickbench_q42/duckdb:parquet 15456851 / 14168166 / +9.1% 20239537 / 20376468 / -0.7% 0.76 / 0.70 / +9.8%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 43742ab2 vs base fc931945
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.018x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21659932 / 21465997 / +0.9% 41644623 / 41708280 / -0.2% 0.52 / 0.51 / +1.1%
tpcds_q02/datafusion:vortex-file-compressed 43174744 / 42925726 / +0.6% 66518684 / 65404380 / +1.7% 0.65 / 0.66 / -1.1%
tpcds_q03/datafusion:vortex-file-compressed 11566114 / 11715465 / -1.3% 27088023 / 28958470 / -6.5% 0.43 / 0.40 / +5.5%
tpcds_q04/datafusion:vortex-file-compressed 80160203 / 81537207 / -1.7% 113624576 / 110908791 / +2.4% 0.71 / 0.74 / -4.0%
tpcds_q05/datafusion:vortex-file-compressed 55924519 / 57313760 / -2.4% 78092438 / 78712978 / -0.8% 0.72 / 0.73 / -1.6%
tpcds_q06/datafusion:vortex-file-compressed 21496606 / 22069948 / -2.6% 43672116 / 43152343 / +1.2% 0.49 / 0.51 / -3.8%
tpcds_q07/datafusion:vortex-file-compressed 26758590 / 26716499 / +0.2% 48923079 / 50033849 / -2.2% 0.55 / 0.53 / +2.4%
tpcds_q08/datafusion:vortex-file-compressed 25706080 / 26059339 / -1.4% 46832316 / 44959579 / +4.2% 0.55 / 0.58 / -5.3%
tpcds_q09/datafusion:vortex-file-compressed 20464740 / 20193395 / +1.3% 38575276 / 37360964 / +3.3% 0.53 / 0.54 / -1.8%
tpcds_q10/datafusion:vortex-file-compressed 29296770 / 30268216 / -3.2% 52001651 / 52510437 / -1.0% 0.56 / 0.58 / -2.3%
tpcds_q11/datafusion:vortex-file-compressed 49113560 / 49248656 / -0.3% 76841876 / 78271213 / -1.8% 0.64 / 0.63 / +1.6%
tpcds_q12/datafusion:vortex-file-compressed 15184084 / 15566510 / -2.5% 34431836 / 34618236 / -0.5% 0.44 / 0.45 / -1.9%
tpcds_q13/datafusion:vortex-file-compressed 30562334 / 30832910 / -0.9% 56267173 / 56594877 / -0.6% 0.54 / 0.54 / -0.3%
tpcds_q14/datafusion:vortex-file-compressed 487665567 / 490853084 / -0.6% 543002970 / 547502473 / -0.8% 0.90 / 0.90 / +0.2%
tpcds_q15/datafusion:vortex-file-compressed 12601400 / 13158504 / -4.2% 32697354 / 32691624 / +0.0% 0.39 / 0.40 / -4.3%
tpcds_q16/datafusion:vortex-file-compressed 19391597 / 18937460 / +2.4% 39951756 / 38400880 / +4.0% 0.49 / 0.49 / -1.6%
tpcds_q17/datafusion:vortex-file-compressed 53302320 / 54498682 / -2.2% 76019284 / 71168116 / +6.8% 0.70 / 0.77 / -8.4%
tpcds_q18/datafusion:vortex-file-compressed 63294702 / 54718918 / +15.7% 🔴 73495731 / 72793552 / +1.0% 0.86 / 0.75 / +14.6%
tpcds_q19/datafusion:vortex-file-compressed 16915497 / 17294288 / -2.2% 39227455 / 40482064 / -3.1% 0.43 / 0.43 / +0.9%
tpcds_q20/datafusion:vortex-file-compressed 16513788 / 16877836 / -2.2% 35853302 / 35132535 / +2.1% 0.46 / 0.48 / -4.1%
tpcds_q21/datafusion:vortex-file-compressed 15944214 / 15080922 / +5.7% 37303907 / 36161040 / +3.2% 0.43 / 0.42 / +2.5%
tpcds_q22/datafusion:vortex-file-compressed 48925866 / 49608102 / -1.4% 73695074 / 69249766 / +6.4% 0.66 / 0.72 / -7.3%
tpcds_q23/datafusion:vortex-file-compressed 71760748 / 72051041 / -0.4% 98810030 / 98269914 / +0.5% 0.73 / 0.73 / -0.9%
tpcds_q24/datafusion:vortex-file-compressed 63671876 / 64168641 / -0.8% 89954573 / 86743956 / +3.7% 0.71 / 0.74 / -4.3%
tpcds_q25/datafusion:vortex-file-compressed 45121010 / 45428284 / -0.7% 69839126 / 73262929 / -4.7% 0.65 / 0.62 / +4.2%
tpcds_q26/datafusion:vortex-file-compressed 25910240 / 26867302 / -3.6% 56199037 / 47837672 / +17.5% 🔴 0.46 / 0.56 / -17.9%
tpcds_q27/datafusion:vortex-file-compressed 52101858 / 51792642 / +0.6% 74779691 / 75689186 / -1.2% 0.70 / 0.68 / +1.8%
tpcds_q28/datafusion:vortex-file-compressed 18864108 / 19118272 / -1.3% 41087417 / 39564324 / +3.8% 0.46 / 0.48 / -5.0%
tpcds_q29/datafusion:vortex-file-compressed 50992682 / 51478559 / -0.9% 76341751 / 66383365 / +15.0% 🔴 0.67 / 0.78 / -13.9%
tpcds_q30/datafusion:vortex-file-compressed 26889072 / 27707656 / -3.0% 45893335 / 48018529 / -4.4% 0.59 / 0.58 / +1.5%
tpcds_q31/datafusion:vortex-file-compressed 63341392 / 63396244 / -0.1% 89445222 / 90295363 / -0.9% 0.71 / 0.70 / +0.9%
tpcds_q32/datafusion:vortex-file-compressed 12557158 / 12779889 / -1.7% 33108179 / 31940396 / +3.7% 0.38 / 0.40 / -5.2%
tpcds_q33/datafusion:vortex-file-compressed 27369205 / 28520237 / -4.0% 51250445 / 51653540 / -0.8% 0.53 / 0.55 / -3.3%
tpcds_q34/datafusion:vortex-file-compressed 17361419 / 17648368 / -1.6% 39598743 / 39032219 / +1.5% 0.44 / 0.45 / -3.0%
tpcds_q35/datafusion:vortex-file-compressed 30690536 / 31371210 / -2.2% 56314343 / 55964233 / +0.6% 0.54 / 0.56 / -2.8%
tpcds_q36/datafusion:vortex-file-compressed 48288042 / 47354940 / +2.0% 72955750 / 68534152 / +6.5% 0.66 / 0.69 / -4.2%
tpcds_q37/datafusion:vortex-file-compressed 12777546 / 12880142 / -0.8% 37637564 / 35978427 / +4.6% 0.34 / 0.36 / -5.2%
tpcds_q38/datafusion:vortex-file-compressed 26221845 / 26693356 / -1.8% 51777008 / 48090085 / +7.7% 0.51 / 0.56 / -8.8%
tpcds_q39/datafusion:vortex-file-compressed 65240948 / 63767288 / +2.3% 89585081 / 86521275 / +3.5% 0.73 / 0.74 / -1.2%
tpcds_q40/datafusion:vortex-file-compressed 23171675 / 23080932 / +0.4% 42168118 / 41036322 / +2.8% 0.55 / 0.56 / -2.3%
tpcds_q41/datafusion:vortex-file-compressed 20319494 / 20079219 / +1.2% 34604983 / 34314283 / +0.8% 0.59 / 0.59 / +0.3%
tpcds_q42/datafusion:vortex-file-compressed 11416531 / 11695846 / -2.4% 28270940 / 28252879 / +0.1% 0.40 / 0.41 / -2.5%
tpcds_q43/datafusion:vortex-file-compressed 13549224 / 13419014 / +1.0% 35097555 / 34072266 / +3.0% 0.39 / 0.39 / -2.0%
tpcds_q44/datafusion:vortex-file-compressed 27776680 / 27543418 / +0.8% 51469319 / 51916896 / -0.9% 0.54 / 0.53 / +1.7%
tpcds_q45/datafusion:vortex-file-compressed 16955450 / 17503610 / -3.1% 37419944 / 36508259 / +2.5% 0.45 / 0.48 / -5.5%
tpcds_q46/datafusion:vortex-file-compressed 23841288 / 23600950 / +1.0% 47109123 / 48000431 / -1.9% 0.51 / 0.49 / +2.9%
tpcds_q47/datafusion:vortex-file-compressed 74944876 / 76004059 / -1.4% 106997479 / 103987347 / +2.9% 0.70 / 0.73 / -4.2%
tpcds_q48/datafusion:vortex-file-compressed 28387704 / 28206746 / +0.6% 55108741 / 52639157 / +4.7% 0.52 / 0.54 / -3.9%
tpcds_q49/datafusion:vortex-file-compressed 55977932 / 55567662 / +0.7% 78329706 / 78170011 / +0.2% 0.71 / 0.71 / +0.5%
tpcds_q50/datafusion:vortex-file-compressed 30461564 / 30610350 / -0.5% 56362426 / 52849290 / +6.6% 0.54 / 0.58 / -6.7%
tpcds_q51/datafusion:vortex-file-compressed 67465450 / 66846041 / +0.9% 94699891 / 90495960 / +4.6% 0.71 / 0.74 / -3.6%
tpcds_q52/datafusion:vortex-file-compressed 11837747 / 11879088 / -0.3% 29336172 / 28692107 / +2.2% 0.40 / 0.41 / -2.5%
tpcds_q53/datafusion:vortex-file-compressed 18496122 / 18445270 / +0.3% 40187873 / 40492442 / -0.8% 0.46 / 0.46 / +1.0%
tpcds_q54/datafusion:vortex-file-compressed 31924927 / 32318392 / -1.2% 57718913 / 56584831 / +2.0% 0.55 / 0.57 / -3.2%
tpcds_q55/datafusion:vortex-file-compressed 11660265 / 11414920 / +2.1% 28470541 / 26895013 / +5.9% 0.41 / 0.42 / -3.5%
tpcds_q56/datafusion:vortex-file-compressed 26994094 / 27538654 / -2.0% 49904961 / 50545844 / -1.3% 0.54 / 0.54 / -0.7%
tpcds_q57/datafusion:vortex-file-compressed 62030802 / 62555981 / -0.8% 89705513 / 89620863 / +0.1% 0.69 / 0.70 / -0.9%
tpcds_q58/datafusion:vortex-file-compressed 41127247 / 40292638 / +2.1% 71355216 / 67017930 / +6.5% 0.58 / 0.60 / -4.1%
tpcds_q59/datafusion:vortex-file-compressed 27627164 / 27703032 / -0.3% 55750118 / 54305352 / +2.7% 0.50 / 0.51 / -2.9%
tpcds_q60/datafusion:vortex-file-compressed 26834038 / 27338646 / -1.8% 49045156 / 49110873 / -0.1% 0.55 / 0.56 / -1.7%
tpcds_q61/datafusion:vortex-file-compressed 20467574 / 20771530 / -1.5% 41701499 / 41173020 / +1.3% 0.49 / 0.50 / -2.7%
tpcds_q62/datafusion:vortex-file-compressed 16924606 / 16808866 / +0.7% 34978441 / 36140811 / -3.2% 0.48 / 0.47 / +4.0%
tpcds_q63/datafusion:vortex-file-compressed 17896075 / 18130114 / -1.3% 41992850 / 40303869 / +4.2% 0.43 / 0.45 / -5.3%
tpcds_q64/datafusion:vortex-file-compressed 189263144 / 188590344 / +0.4% 223014937 / 221797042 / +0.5% 0.85 / 0.85 / -0.2%
tpcds_q65/datafusion:vortex-file-compressed 72526706 / 73480942 / -1.3% 94882176 / 95429401 / -0.6% 0.76 / 0.77 / -0.7%
tpcds_q66/datafusion:vortex-file-compressed 50010638 / 50053211 / -0.1% 71489051 / 70814990 / +1.0% 0.70 / 0.71 / -1.0%
tpcds_q67/datafusion:vortex-file-compressed 51483797 / 52155422 / -1.3% 86016007 / 85176669 / +1.0% 0.60 / 0.61 / -2.3%
tpcds_q68/datafusion:vortex-file-compressed 22869678 / 22873438 / -0.0% 47722046 / 45645331 / +4.5% 0.48 / 0.50 / -4.4%
tpcds_q69/datafusion:vortex-file-compressed 27669830 / 27295499 / +1.4% 49733508 / 49675712 / +0.1% 0.56 / 0.55 / +1.3%
tpcds_q70/datafusion:vortex-file-compressed 72710410 / 73041404 / -0.5% 95801265 / 93931740 / +2.0% 0.76 / 0.78 / -2.4%
tpcds_q71/datafusion:vortex-file-compressed 18291953 / 18671058 / -2.0% 42561901 / 40232381 / +5.8% 0.43 / 0.46 / -7.4%
tpcds_q72/datafusion:vortex-file-compressed 251362924 / 262219023 / -4.1% 272455842 / 276243056 / -1.4% 0.92 / 0.95 / -2.8%
tpcds_q73/datafusion:vortex-file-compressed 16344706 / 16611519 / -1.6% 39926365 / 36343031 / +9.9% 0.41 / 0.46 / -10.4%
tpcds_q74/datafusion:vortex-file-compressed 41717971 / 41223570 / +1.2% 68962472 / 69189048 / -0.3% 0.60 / 0.60 / +1.5%
tpcds_q75/datafusion:vortex-file-compressed 135322513 / 138826508 / -2.5% 164528503 / 155410230 / +5.9% 0.82 / 0.89 / -7.9%
tpcds_q76/datafusion:vortex-file-compressed 29314484 / 29610329 / -1.0% 51725553 / 48777456 / +6.0% 0.57 / 0.61 / -6.6%
tpcds_q77/datafusion:vortex-file-compressed 44845496 / 45301296 / -1.0% 71772952 / 67958443 / +5.6% 0.62 / 0.67 / -6.3%
tpcds_q78/datafusion:vortex-file-compressed 60735234 / 61444692 / -1.2% 92912764 / 87504106 / +6.2% 0.65 / 0.70 / -6.9%
tpcds_q79/datafusion:vortex-file-compressed 20160736 / 20008388 / +0.8% 42271828 / 41848004 / +1.0% 0.48 / 0.48 / -0.2%
tpcds_q80/datafusion:vortex-file-compressed 68204123 / 68288721 / -0.1% 96108918 / 93401852 / +2.9% 0.71 / 0.73 / -2.9%
tpcds_q81/datafusion:vortex-file-compressed 27644866 / 27905185 / -0.9% 47977669 / 46527184 / +3.1% 0.58 / 0.60 / -3.9%
tpcds_q82/datafusion:vortex-file-compressed 12419300 / 13382098 / -7.2% 38517190 / 34660029 / +11.1% 🔴 0.32 / 0.39 / -16.5%
tpcds_q83/datafusion:vortex-file-compressed 34411636 / 35471735 / -3.0% 53864326 / 57168509 / -5.8% 0.64 / 0.62 / +3.0%
tpcds_q84/datafusion:vortex-file-compressed 10495190 / 10545768 / -0.5% 28398262 / 27658148 / +2.7% 0.37 / 0.38 / -3.1%
tpcds_q85/datafusion:vortex-file-compressed 52244572 / 52507946 / -0.5% 77953223 / 78248949 / -0.4% 0.67 / 0.67 / -0.1%
tpcds_q86/datafusion:vortex-file-compressed 16005666 / 16653770 / -3.9% 37531582 / 36374966 / +3.2% 0.43 / 0.46 / -6.9%
tpcds_q87/datafusion:vortex-file-compressed 26142712 / 26527319 / -1.4% 50526701 / 51295269 / -1.5% 0.52 / 0.52 / +0.0%
tpcds_q88/datafusion:vortex-file-compressed 31950262 / 32266188 / -1.0% 49690429 / 55883959 / -11.1% 🟢 0.64 / 0.58 / +11.4%
tpcds_q89/datafusion:vortex-file-compressed 22063224 / 21616856 / +2.1% 45045794 / 43951326 / +2.5% 0.49 / 0.49 / -0.4%
tpcds_q90/datafusion:vortex-file-compressed 10509393 / 10753698 / -2.3% 29041048 / 26296856 / +10.4% 🔴 0.36 / 0.41 / -11.5%
tpcds_q91/datafusion:vortex-file-compressed 15809227 / 15842404 / -0.2% 39079842 / 36963471 / +5.7% 0.40 / 0.43 / -5.6%
tpcds_q92/datafusion:vortex-file-compressed 12990510 / 13617809 / -4.6% 33127359 / 30957187 / +7.0% 0.39 / 0.44 / -10.9%
tpcds_q93/datafusion:vortex-file-compressed 20111163 / 20352613 / -1.2% 41646799 / 40661142 / +2.4% 0.48 / 0.50 / -3.5%
tpcds_q94/datafusion:vortex-file-compressed 18585504 / 18709728 / -0.7% 39582971 / 37950233 / +4.3% 0.47 / 0.49 / -4.8%
tpcds_q95/datafusion:vortex-file-compressed 41823630 / 42160198 / -0.8% 63319428 / 62836945 / +0.8% 0.66 / 0.67 / -1.6%
tpcds_q96/datafusion:vortex-file-compressed 7586736 / 7684164 / -1.3% 29621203 / 24630897 / +20.3% 🔴 0.26 / 0.31 / -17.9%
tpcds_q97/datafusion:vortex-file-compressed 17348932 / 17490146 / -0.8% 39363072 / 38963435 / +1.0% 0.44 / 0.45 / -1.8%
tpcds_q98/datafusion:vortex-file-compressed 15914694 / 15885255 / +0.2% 36264391 / 36082481 / +0.5% 0.44 / 0.44 / -0.3%
tpcds_q99/datafusion:vortex-file-compressed 16467811 / 16364970 / +0.6% 35004834 / 34909044 / +0.3% 0.47 / 0.47 / +0.4%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43979371 / 42621076 / +3.2% 61332377 / 59229324 / +3.6% 0.72 / 0.72 / -0.4%
tpcds_q02/datafusion:parquet 54894214 / 54652400 / +0.4% 71911232 / 70623388 / +1.8% 0.76 / 0.77 / -1.4%
tpcds_q03/datafusion:parquet 18840336 / 19054796 / -1.1% 31539353 / 31315398 / +0.7% 0.60 / 0.61 / -1.8%
tpcds_q04/datafusion:parquet 180450900 / 179156052 / +0.7% 205895172 / 202049383 / +1.9% 0.88 / 0.89 / -1.2%
tpcds_q05/datafusion:parquet 67688222 / 67966144 / -0.4% 88665127 / 89646016 / -1.1% 0.76 / 0.76 / +0.7%
tpcds_q06/datafusion:parquet 33578438 / 33645034 / -0.2% 49856730 / 45990604 / +8.4% 0.67 / 0.73 / -7.9%
tpcds_q07/datafusion:parquet 46604699 / 47043488 / -0.9% 66137146 / 65449737 / +1.1% 0.70 / 0.72 / -2.0%
tpcds_q08/datafusion:parquet 31160333 / 30873092 / +0.9% 48395474 / 48714292 / -0.7% 0.64 / 0.63 / +1.6%
tpcds_q09/datafusion:parquet 30891164 / 31939621 / -3.3% 42917887 / 44582316 / -3.7% 0.72 / 0.72 / +0.5%
tpcds_q10/datafusion:parquet 44552716 / 44901194 / -0.8% 59581710 / 56505827 / +5.4% 0.75 / 0.79 / -5.9%
tpcds_q11/datafusion:parquet 97491634 / 98197098 / -0.7% 120871092 / 121122028 / -0.2% 0.81 / 0.81 / -0.5%
tpcds_q12/datafusion:parquet 23758182 / 23770272 / -0.1% 38207306 / 36276345 / +5.3% 0.62 / 0.66 / -5.1%
tpcds_q13/datafusion:parquet 46534268 / 47023439 / -1.0% 67476947 / 67865971 / -0.6% 0.69 / 0.69 / -0.5%
tpcds_q14/datafusion:parquet 535555180 / 534738763 / +0.2% 584574811 / 575744768 / +1.5% 0.92 / 0.93 / -1.4%
tpcds_q15/datafusion:parquet 23169031 / 24116340 / -3.9% 37850443 / 37407566 / +1.2% 0.61 / 0.64 / -5.1%
tpcds_q16/datafusion:parquet 36684488 / 36553158 / +0.4% 54437244 / 51324553 / +6.1% 0.67 / 0.71 / -5.4%
tpcds_q17/datafusion:parquet 74699448 / 75583526 / -1.2% 96409572 / 96957098 / -0.6% 0.77 / 0.78 / -0.6%
tpcds_q18/datafusion:parquet 65853948 / 67923570 / -3.0% 91978801 / 86756415 / +6.0% 0.72 / 0.78 / -8.6%
tpcds_q19/datafusion:parquet 28998726 / 29371692 / -1.3% 44059462 / 42819792 / +2.9% 0.66 / 0.69 / -4.0%
tpcds_q20/datafusion:parquet 24326030 / 25109502 / -3.1% 38299956 / 38546230 / -0.6% 0.64 / 0.65 / -2.5%
tpcds_q21/datafusion:parquet 20369699 / 20198292 / +0.8% 37085579 / 31280050 / +18.6% 🔴 0.55 / 0.65 / -14.9%
tpcds_q22/datafusion:parquet 76865532 / 76874950 / -0.0% 89226215 / 88313870 / +1.0% 0.86 / 0.87 / -1.0%
tpcds_q23/datafusion:parquet 92805990 / 93221477 / -0.4% 114609024 / 113781683 / +0.7% 0.81 / 0.82 / -1.2%
tpcds_q24/datafusion:parquet 92092192 / 90550237 / +1.7% 116879901 / 114396583 / +2.2% 0.79 / 0.79 / -0.5%
tpcds_q25/datafusion:parquet 80016400 / 80771444 / -0.9% 104716076 / 96695282 / +8.3% 0.76 / 0.84 / -8.5%
tpcds_q26/datafusion:parquet 43571368 / 43091352 / +1.1% 59384319 / 59297180 / +0.1% 0.73 / 0.73 / +1.0%
tpcds_q27/datafusion:parquet 75008360 / 75918752 / -1.2% 100826381 / 99971629 / +0.9% 0.74 / 0.76 / -2.0%
tpcds_q28/datafusion:parquet 28969722 / 28944986 / +0.1% 44447681 / 41295376 / +7.6% 0.65 / 0.70 / -7.0%
tpcds_q29/datafusion:parquet 75202136 / 77071220 / -2.4% 102934646 / 95645724 / +7.6% 0.73 / 0.81 / -9.3%
tpcds_q30/datafusion:parquet 45703870 / 44077849 / +3.7% 59467567 / 60183209 / -1.2% 0.77 / 0.73 / +4.9%
tpcds_q31/datafusion:parquet 79441500 / 78486514 / +1.2% 96064738 / 97254733 / -1.2% 0.83 / 0.81 / +2.5%
tpcds_q32/datafusion:parquet 26738052 / 26585888 / +0.6% 42835175 / 41858950 / +2.3% 0.62 / 0.64 / -1.7%
tpcds_q33/datafusion:parquet 38518836 / 38788024 / -0.7% 53864788 / 54234952 / -0.7% 0.72 / 0.72 / -0.0%
tpcds_q34/datafusion:parquet 24030838 / 24198404 / -0.7% 37150813 / 35633554 / +4.3% 0.65 / 0.68 / -4.7%
tpcds_q35/datafusion:parquet 51099804 / 50378760 / +1.4% 64071232 / 65317393 / -1.9% 0.80 / 0.77 / +3.4%
tpcds_q36/datafusion:parquet 52913006 / 52789874 / +0.2% 73584247 / 70490189 / +4.4% 0.72 / 0.75 / -4.0%
tpcds_q37/datafusion:parquet 21391234 / 21601148 / -1.0% 36033602 / 37011067 / -2.6% 0.59 / 0.58 / +1.7%
tpcds_q38/datafusion:parquet 44008408 / 45031084 / -2.3% 64608111 / 65259215 / -1.0% 0.68 / 0.69 / -1.3%
tpcds_q39/datafusion:parquet 68536512 / 68201998 / +0.5% 88303881 / 88210370 / +0.1% 0.78 / 0.77 / +0.4%
tpcds_q40/datafusion:parquet 30669434 / 29397299 / +4.3% 52133475 / 50757042 / +2.7% 0.59 / 0.58 / +1.6%
tpcds_q41/datafusion:parquet 20308233 / 19903542 / +2.0% 32434902 / 32150910 / +0.9% 0.63 / 0.62 / +1.1%
tpcds_q42/datafusion:parquet 18516902 / 18532917 / -0.1% 32067768 / 30577697 / +4.9% 0.58 / 0.61 / -4.7%
tpcds_q43/datafusion:parquet 19057768 / 19260730 / -1.1% 33815906 / 32594162 / +3.7% 0.56 / 0.59 / -4.6%
tpcds_q44/datafusion:parquet 36567759 / 34340959 / +6.5% 51648858 / 49480740 / +4.4% 0.71 / 0.69 / +2.0%
tpcds_q45/datafusion:parquet 27705824 / 28031236 / -1.2% 40965097 / 40207534 / +1.9% 0.68 / 0.70 / -3.0%
tpcds_q46/datafusion:parquet 28890972 / 28886990 / +0.0% 47211675 / 45299240 / +4.2% 0.61 / 0.64 / -4.0%
tpcds_q47/datafusion:parquet 97651635 / 96633892 / +1.1% 115318153 / 119342871 / -3.4% 0.85 / 0.81 / +4.6%
tpcds_q48/datafusion:parquet 42220760 / 41953626 / +0.6% 61298733 / 58056599 / +5.6% 0.69 / 0.72 / -4.7%
tpcds_q49/datafusion:parquet 72768813 / 72643601 / +0.2% 92699680 / 91645527 / +1.2% 0.78 / 0.79 / -1.0%
tpcds_q50/datafusion:parquet 48925300 / 47556055 / +2.9% 65558018 / 65700412 / -0.2% 0.75 / 0.72 / +3.1%
tpcds_q51/datafusion:parquet 75871208 / 75488804 / +0.5% 94657289 / 94505293 / +0.2% 0.80 / 0.80 / +0.3%
tpcds_q52/datafusion:parquet 18686926 / 18733887 / -0.3% 30276237 / 29781696 / +1.7% 0.62 / 0.63 / -1.9%
tpcds_q53/datafusion:parquet 22422956 / 22449044 / -0.1% 38658346 / 38108309 / +1.4% 0.58 / 0.59 / -1.5%
tpcds_q54/datafusion:parquet 53331688 / 54075683 / -1.4% 67864271 / 68168944 / -0.4% 0.79 / 0.79 / -0.9%
tpcds_q55/datafusion:parquet 18146842 / 18156634 / -0.1% 29231210 / 29687076 / -1.5% 0.62 / 0.61 / +1.5%
tpcds_q56/datafusion:parquet 41156481 / 40386254 / +1.9% 56560249 / 60403502 / -6.4% 0.73 / 0.67 / +8.8%
tpcds_q57/datafusion:parquet 100689646 / 103391444 / -2.6% 117492115 / 116231662 / +1.1% 0.86 / 0.89 / -3.7%
tpcds_q58/datafusion:parquet 65557405 / 65287542 / +0.4% 85188799 / 82122073 / +3.7% 0.77 / 0.80 / -3.2%
tpcds_q59/datafusion:parquet 48103834 / 47603362 / +1.1% 66073982 / 66581309 / -0.8% 0.73 / 0.71 / +1.8%
tpcds_q60/datafusion:parquet 39071463 / 42047250 / -7.1% 56004430 / 53491018 / +4.7% 0.70 / 0.79 / -11.2%
tpcds_q61/datafusion:parquet 35549957 / 35899182 / -1.0% 51718308 / 51274194 / +0.9% 0.69 / 0.70 / -1.8%
tpcds_q62/datafusion:parquet 25182356 / 25368768 / -0.7% 37935638 / 38568059 / -1.6% 0.66 / 0.66 / +0.9%
tpcds_q63/datafusion:parquet 22113196 / 22229998 / -0.5% 37322250 / 39157015 / -4.7% 0.59 / 0.57 / +4.4%
tpcds_q64/datafusion:parquet 287187130 / 287291080 / -0.0% 324617254 / 325836569 / -0.4% 0.88 / 0.88 / +0.3%
tpcds_q65/datafusion:parquet 119458618 / 120929096 / -1.2% 134479761 / 141577457 / -5.0% 0.89 / 0.85 / +4.0%
tpcds_q66/datafusion:parquet 61003616 / 61182768 / -0.3% 78909958 / 78618907 / +0.4% 0.77 / 0.78 / -0.7%
tpcds_q67/datafusion:parquet 68337644 / 68760930 / -0.6% 91345528 / 90089151 / +1.4% 0.75 / 0.76 / -2.0%
tpcds_q68/datafusion:parquet 28646578 / 29014735 / -1.3% 47433000 / 47448294 / -0.0% 0.60 / 0.61 / -1.2%
tpcds_q69/datafusion:parquet 44371618 / 43994042 / +0.9% 57728233 / 56778641 / +1.7% 0.77 / 0.77 / -0.8%
tpcds_q70/datafusion:parquet 80794022 / 80804144 / -0.0% 97789493 / 98274417 / -0.5% 0.83 / 0.82 / +0.5%
tpcds_q71/datafusion:parquet 25876996 / 25199736 / +2.7% 38110416 / 37451941 / +1.8% 0.68 / 0.67 / +0.9%
tpcds_q72/datafusion:parquet 522094689 / 524171803 / -0.4% 557926956 / 560318287 / -0.4% 0.94 / 0.94 / +0.0%
tpcds_q73/datafusion:parquet 23805327 / 24100984 / -1.2% 36214306 / 35804527 / +1.1% 0.66 / 0.67 / -2.3%
tpcds_q74/datafusion:parquet 70538172 / 69591944 / +1.4% 88452020 / 90759653 / -2.5% 0.80 / 0.77 / +4.0%
tpcds_q75/datafusion:parquet 151438074 / 150166751 / +0.8% 180290849 / 181911995 / -0.9% 0.84 / 0.83 / +1.8%
tpcds_q76/datafusion:parquet 33039404 / 33200880 / -0.5% 48531493 / 47235540 / +2.7% 0.68 / 0.70 / -3.1%
tpcds_q77/datafusion:parquet 55743521 / 56383627 / -1.1% 74281550 / 75221174 / -1.2% 0.75 / 0.75 / +0.1%
tpcds_q78/datafusion:parquet 87002432 / 87553816 / -0.6% 119174581 / 117051415 / +1.8% 0.73 / 0.75 / -2.4%
tpcds_q79/datafusion:parquet 26770838 / 26965916 / -0.7% 41887892 / 41609468 / +0.7% 0.64 / 0.65 / -1.4%
tpcds_q80/datafusion:parquet 81248820 / 80118956 / +1.4% 112247907 / 109443320 / +2.6% 0.72 / 0.73 / -1.1%
tpcds_q81/datafusion:parquet 38679371 / 38812146 / -0.3% 51792753 / 53823952 / -3.8% 0.75 / 0.72 / +3.6%
tpcds_q82/datafusion:parquet 22246644 / 22814690 / -2.5% 35207410 / 35516035 / -0.9% 0.63 / 0.64 / -1.6%
tpcds_q83/datafusion:parquet 59261281 / 58642018 / +1.1% 76796346 / 74853874 / +2.6% 0.77 / 0.78 / -1.5%
tpcds_q84/datafusion:parquet 26629882 / 26562082 / +0.3% 39249183 / 40255548 / -2.5% 0.68 / 0.66 / +2.8%
tpcds_q85/datafusion:parquet 81111064 / 79649036 / +1.8% 104186575 / 101037030 / +3.1% 0.78 / 0.79 / -1.2%
tpcds_q86/datafusion:parquet 20806008 / 21088466 / -1.3% 32967634 / 33238565 / -0.8% 0.63 / 0.63 / -0.5%
tpcds_q87/datafusion:parquet 44401104 / 44097686 / +0.7% 61624629 / 62079120 / -0.7% 0.72 / 0.71 / +1.4%
tpcds_q88/datafusion:parquet 38154791 / 37926809 / +0.6% 49690186 / 51697673 / -3.9% 0.77 / 0.73 / +4.7%
tpcds_q89/datafusion:parquet 25775984 / 25427666 / +1.4% 41352655 / 41954582 / -1.4% 0.62 / 0.61 / +2.8%
tpcds_q90/datafusion:parquet 15496712 / 15576302 / -0.5% 25498218 / 25900179 / -1.6% 0.61 / 0.60 / +1.1%
tpcds_q91/datafusion:parquet 31897476 / 33586962 / -5.0% 48123684 / 47182026 / +2.0% 0.66 / 0.71 / -6.9%
tpcds_q92/datafusion:parquet 27104808 / 26990122 / +0.4% 41398438 / 43137795 / -4.0% 0.65 / 0.63 / +4.6%
tpcds_q93/datafusion:parquet 27059568 / 26381963 / +2.6% 46920851 / 46330897 / +1.3% 0.58 / 0.57 / +1.3%
tpcds_q94/datafusion:parquet 35125110 / 35401416 / -0.8% 48353812 / 48607567 / -0.5% 0.73 / 0.73 / -0.3%
tpcds_q95/datafusion:parquet 63683422 / 64479714 / -1.2% 80222010 / 80231086 / -0.0% 0.79 / 0.80 / -1.2%
tpcds_q96/datafusion:parquet 13056166 / 12935407 / +0.9% 24315469 / 24619065 / -1.2% 0.54 / 0.53 / +2.2%
tpcds_q97/datafusion:parquet 35176318 / 35378686 / -0.6% 51101120 / 52320235 / -2.3% 0.69 / 0.68 / +1.8%
tpcds_q98/datafusion:parquet 24504952 / 24472318 / +0.1% 40821886 / 40382547 / +1.1% 0.60 / 0.61 / -0.9%
tpcds_q99/datafusion:parquet 29621644 / 29781796 / -0.5% 42071424 / 43396373 / -3.1% 0.70 / 0.69 / +2.6%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15788310 / 15996170 / -1.3% 24552611 / 24517776 / +0.1% 0.64 / 0.65 / -1.4%
tpcds_q02/duckdb:vortex-file-compressed 17641272 / 16504620 / +6.9% 23246056 / 23606439 / -1.5% 0.76 / 0.70 / +8.5%
tpcds_q03/duckdb:vortex-file-compressed 7095946 / 7339380 / -3.3% 16335222 / 15812688 / +3.3% 0.43 / 0.46 / -6.4%
tpcds_q04/duckdb:vortex-file-compressed 59040906 / 58874162 / +0.3% 69648480 / 72156934 / -3.5% 0.85 / 0.82 / +3.9%
tpcds_q05/duckdb:vortex-file-compressed 22951122 / 22943717 / +0.0% 32213001 / 32833596 / -1.9% 0.71 / 0.70 / +2.0%
tpcds_q06/duckdb:vortex-file-compressed 24373830 / 24251214 / +0.5% 38620373 / 37931975 / +1.8% 0.63 / 0.64 / -1.3%
tpcds_q07/duckdb:vortex-file-compressed 22285226 / 22330781 / -0.2% 34289100 / 34028319 / +0.8% 0.65 / 0.66 / -1.0%
tpcds_q08/duckdb:vortex-file-compressed 17128718 / 17545462 / -2.4% 25505415 / 26578069 / -4.0% 0.67 / 0.66 / +1.7%
tpcds_q09/duckdb:vortex-file-compressed 18823228 / 19131830 / -1.6% 29001061 / 29788012 / -2.6% 0.65 / 0.64 / +1.1%
tpcds_q10/duckdb:vortex-file-compressed 27786790 / 27711704 / +0.3% 41280147 / 41137397 / +0.3% 0.67 / 0.67 / -0.1%
tpcds_q11/duckdb:vortex-file-compressed 36231574 / 36371061 / -0.4% 44886477 / 44755018 / +0.3% 0.81 / 0.81 / -0.7%
tpcds_q12/duckdb:vortex-file-compressed 10318878 / 10462747 / -1.4% 17450332 / 16597443 / +5.1% 0.59 / 0.63 / -6.2%
tpcds_q13/duckdb:vortex-file-compressed 19864436 / 20256200 / -1.9% 33195275 / 32319337 / +2.7% 0.60 / 0.63 / -4.5%
tpcds_q14/duckdb:vortex-file-compressed 56080616 / 56220601 / -0.2% 65894021 / 67972913 / -3.1% 0.85 / 0.83 / +2.9%
tpcds_q15/duckdb:vortex-file-compressed 11189765 / 11319174 / -1.1% 18857251 / 16945827 / +11.3% 🔴 0.59 / 0.67 / -11.2%
tpcds_q16/duckdb:vortex-file-compressed 24778854 / 25189134 / -1.6% 35289227 / 35155891 / +0.4% 0.70 / 0.72 / -2.0%
tpcds_q17/duckdb:vortex-file-compressed 20163418 / 19959537 / +1.0% 33118794 / 31998769 / +3.5% 0.61 / 0.62 / -2.4%
tpcds_q18/duckdb:vortex-file-compressed 32305854 / 32350447 / -0.1% 43514257 / 42849700 / +1.6% 0.74 / 0.75 / -1.7%
tpcds_q19/duckdb:vortex-file-compressed 20492568 / 20390660 / +0.5% 28915645 / 28471490 / +1.6% 0.71 / 0.72 / -1.0%
tpcds_q20/duckdb:vortex-file-compressed 10784293 / 10872098 / -0.8% 18373612 / 17968196 / +2.3% 0.59 / 0.61 / -3.0%
tpcds_q21/duckdb:vortex-file-compressed 10105350 / 9906946 / +2.0% 23648729 / 23147813 / +2.2% 0.43 / 0.43 / -0.2%
tpcds_q22/duckdb:vortex-file-compressed 18010415 / 18115441 / -0.6% 34003835 / 30593925 / +11.1% 🔴 0.53 / 0.59 / -10.5%
tpcds_q23/duckdb:vortex-file-compressed 37652726 / 37222122 / +1.2% 49744124 / 48569004 / +2.4% 0.76 / 0.77 / -1.2%
tpcds_q24/duckdb:vortex-file-compressed 26851646 / 25974458 / +3.4% 36447331 / 35916659 / +1.5% 0.74 / 0.72 / +1.9%
tpcds_q25/duckdb:vortex-file-compressed 19104168 / 18974483 / +0.7% 32124822 / 31585618 / +1.7% 0.59 / 0.60 / -1.0%
tpcds_q26/duckdb:vortex-file-compressed 21735192 / 21926454 / -0.9% 32707829 / 32125025 / +1.8% 0.66 / 0.68 / -2.6%
tpcds_q27/duckdb:vortex-file-compressed 24654636 / 24881572 / -0.9% 37536114 / 37971113 / -1.1% 0.66 / 0.66 / +0.2%
tpcds_q28/duckdb:vortex-file-compressed 15276867 / 15055295 / +1.5% 26206369 / 25131881 / +4.3% 0.58 / 0.60 / -2.7%
tpcds_q29/duckdb:vortex-file-compressed 18994071 / 18551970 / +2.4% 30173533 / 29847532 / +1.1% 0.63 / 0.62 / +1.3%
tpcds_q30/duckdb:vortex-file-compressed 18282642 / 18385870 / -0.6% 27164582 / 26923334 / +0.9% 0.67 / 0.68 / -1.4%
tpcds_q31/duckdb:vortex-file-compressed 17761346 / 17985734 / -1.2% 26220029 / 26088601 / +0.5% 0.68 / 0.69 / -1.7%
tpcds_q32/duckdb:vortex-file-compressed 10195171 / 10300535 / -1.0% 18571983 / 18463513 / +0.6% 0.55 / 0.56 / -1.6%
tpcds_q33/duckdb:vortex-file-compressed 18048898 / 17946682 / +0.6% 28223149 / 26916202 / +4.9% 0.64 / 0.67 / -4.1%
tpcds_q34/duckdb:vortex-file-compressed 13114618 / 13287680 / -1.3% 22351877 / 22293373 / +0.3% 0.59 / 0.60 / -1.6%
tpcds_q35/duckdb:vortex-file-compressed 31134486 / 30753232 / +1.2% 44097059 / 43048164 / +2.4% 0.71 / 0.71 / -1.2%
tpcds_q36/duckdb:vortex-file-compressed 14046902 / 14001162 / +0.3% 24160257 / 24285776 / -0.5% 0.58 / 0.58 / +0.8%
tpcds_q37/duckdb:vortex-file-compressed 9981038 / 10034615 / -0.5% 27390991 / 26355249 / +3.9% 0.36 / 0.38 / -4.3%
tpcds_q38/duckdb:vortex-file-compressed 24360902 / 24393910 / -0.1% 31445172 / 31910277 / -1.5% 0.77 / 0.76 / +1.3%
tpcds_q39/duckdb:vortex-file-compressed 19071962 / 18526256 / +2.9% 32636802 / 33203256 / -1.7% 0.58 / 0.56 / +4.7%
tpcds_q40/duckdb:vortex-file-compressed 11188217 / 11112292 / +0.7% 20049624 / 19521471 / +2.7% 0.56 / 0.57 / -2.0%
tpcds_q41/duckdb:vortex-file-compressed 17257336 / 17356238 / -0.6% 23594466 / 24053387 / -1.9% 0.73 / 0.72 / +1.4%
tpcds_q42/duckdb:vortex-file-compressed 6916772 / 6873580 / +0.6% 15886196 / 15233963 / +4.3% 0.44 / 0.45 / -3.5%
tpcds_q43/duckdb:vortex-file-compressed 9822712 / 9671450 / +1.6% 18753223 / 18532345 / +1.2% 0.52 / 0.52 / +0.4%
tpcds_q44/duckdb:vortex-file-compressed 12776534 / 12854795 / -0.6% 25040889 / 24421010 / +2.5% 0.51 / 0.53 / -3.1%
tpcds_q45/duckdb:vortex-file-compressed 23422562 / 23977770 / -2.3% 30450189 / 30728716 / -0.9% 0.77 / 0.78 / -1.4%
tpcds_q46/duckdb:vortex-file-compressed 31643564 / 31715346 / -0.2% 44834451 / 43807539 / +2.3% 0.71 / 0.72 / -2.5%
tpcds_q47/duckdb:vortex-file-compressed 30869390 / 31208347 / -1.1% 40394295 / 39783946 / +1.5% 0.76 / 0.78 / -2.6%
tpcds_q48/duckdb:vortex-file-compressed 22405547 / 22340024 / +0.3% 36379186 / 34506143 / +5.4% 0.62 / 0.65 / -4.9%
tpcds_q49/duckdb:vortex-file-compressed 19214852 / 18177941 / +5.7% 30938219 / 31053952 / -0.4% 0.62 / 0.59 / +6.1%
tpcds_q50/duckdb:vortex-file-compressed 14712626 / 14851460 / -0.9% 26402428 / 24969690 / +5.7% 0.56 / 0.59 / -6.3%
tpcds_q51/duckdb:vortex-file-compressed 48891900 / 49441914 / -1.1% 59370875 / 58350280 / +1.7% 0.82 / 0.85 / -2.8%
tpcds_q52/duckdb:vortex-file-compressed 7068050 / 7154508 / -1.2% 16520580 / 15674688 / +5.4% 0.43 / 0.46 / -6.3%
tpcds_q53/duckdb:vortex-file-compressed 11479560 / 11364892 / +1.0% 20380250 / 20652317 / -1.3% 0.56 / 0.55 / +2.4%
tpcds_q54/duckdb:vortex-file-compressed 19943835 / 19807287 / +0.7% 29225535 / 30268726 / -3.4% 0.68 / 0.65 / +4.3%
tpcds_q55/duckdb:vortex-file-compressed 6870198 / 6798531 / +1.1% 15550094 / 15306968 / +1.6% 0.44 / 0.44 / -0.5%
tpcds_q56/duckdb:vortex-file-compressed 18248014 / 17940986 / +1.7% 29315854 / 28440517 / +3.1% 0.62 / 0.63 / -1.3%
tpcds_q57/duckdb:vortex-file-compressed 25564900 / 25657832 / -0.4% 34230245 / 33975320 / +0.8% 0.75 / 0.76 / -1.1%
tpcds_q58/duckdb:vortex-file-compressed 20288345 / 20750384 / -2.2% 30882005 / 29740346 / +3.8% 0.66 / 0.70 / -5.8%
tpcds_q59/duckdb:vortex-file-compressed 19587430 / 19411992 / +0.9% 26379166 / 26354309 / +0.1% 0.74 / 0.74 / +0.8%
tpcds_q60/duckdb:vortex-file-compressed 18977388 / 18283154 / +3.8% 29729417 / 28022107 / +6.1% 0.64 / 0.65 / -2.2%
tpcds_q61/duckdb:vortex-file-compressed 19856450 / 19862317 / -0.0% 31751768 / 29830079 / +6.4% 0.63 / 0.67 / -6.1%
tpcds_q62/duckdb:vortex-file-compressed 11225486 / 11299591 / -0.7% 18001568 / 18309938 / -1.7% 0.62 / 0.62 / +1.0%
tpcds_q63/duckdb:vortex-file-compressed 10929026 / 10927625 / +0.0% 20854544 / 19653996 / +6.1% 0.52 / 0.56 / -5.7%
tpcds_q64/duckdb:vortex-file-compressed 52397017 / 52647798 / -0.5% 69049818 / 68127877 / +1.4% 0.76 / 0.77 / -1.8%
tpcds_q65/duckdb:vortex-file-compressed 12883335 / 12923878 / -0.3% 22819739 / 22263790 / +2.5% 0.56 / 0.58 / -2.7%
tpcds_q66/duckdb:vortex-file-compressed 31263304 / 31149796 / +0.4% 38529972 / 38779017 / -0.6% 0.81 / 0.80 / +1.0%
tpcds_q67/duckdb:vortex-file-compressed 54884560 / 56187048 / -2.3% 63655539 / 66189328 / -3.8% 0.86 / 0.85 / +1.6%
tpcds_q68/duckdb:vortex-file-compressed 23033796 / 22932079 / +0.4% 35502743 / 35377544 / +0.4% 0.65 / 0.65 / +0.1%
tpcds_q69/duckdb:vortex-file-compressed 22216126 / 22634704 / -1.8% 37897144 / 37869501 / +0.1% 0.59 / 0.60 / -1.9%
tpcds_q70/duckdb:vortex-file-compressed 14612792 / 14923896 / -2.1% 25141444 / 25086422 / +0.2% 0.58 / 0.59 / -2.3%
tpcds_q71/duckdb:vortex-file-compressed 13348190 / 12867354 / +3.7% 23703472 / 22764932 / +4.1% 0.56 / 0.57 / -0.4%
tpcds_q72/duckdb:vortex-file-compressed 42356922 / 42987023 / -1.5% 57446215 / 56330094 / +2.0% 0.74 / 0.76 / -3.4%
tpcds_q73/duckdb:vortex-file-compressed 11734700 / 11914014 / -1.5% 21846196 / 21118083 / +3.4% 0.54 / 0.56 / -4.8%
tpcds_q74/duckdb:vortex-file-compressed 31413840 / 31556098 / -0.5% 40616669 / 40738609 / -0.3% 0.77 / 0.77 / -0.2%
tpcds_q75/duckdb:vortex-file-compressed 37082692 / 37377932 / -0.8% 49457381 / 49777208 / -0.6% 0.75 / 0.75 / -0.1%
tpcds_q76/duckdb:vortex-file-compressed 12733622 / 12651226 / +0.7% 22727718 / 22638601 / +0.4% 0.56 / 0.56 / +0.3%
tpcds_q77/duckdb:vortex-file-compressed 20905791 / 20634220 / +1.3% 31195711 / 31559033 / -1.2% 0.67 / 0.65 / +2.5%
tpcds_q78/duckdb:vortex-file-compressed 42906258 / 43729122 / -1.9% 53995418 / 53754198 / +0.4% 0.79 / 0.81 / -2.3%
tpcds_q79/duckdb:vortex-file-compressed 17116322 / 17052677 / +0.4% 27887417 / 27376581 / +1.9% 0.61 / 0.62 / -1.5%
tpcds_q80/duckdb:vortex-file-compressed 30274744 / 30215569 / +0.2% 44678108 / 42198198 / +5.9% 0.68 / 0.72 / -5.4%
tpcds_q81/duckdb:vortex-file-compressed 21467246 / 21502717 / -0.2% 30090482 / 29626848 / +1.6% 0.71 / 0.73 / -1.7%
tpcds_q82/duckdb:vortex-file-compressed 10033303 / 10455733 / -4.0% 26925792 / 25223968 / +6.7% 0.37 / 0.41 / -10.1%
tpcds_q83/duckdb:vortex-file-compressed 17756884 / 17433814 / +1.9% 24604493 / 24722123 / -0.5% 0.72 / 0.71 / +2.3%
tpcds_q84/duckdb:vortex-file-compressed 15564714 / 15717906 / -1.0% 23546957 / 24138088 / -2.4% 0.66 / 0.65 / +1.5%
tpcds_q85/duckdb:vortex-file-compressed 25067072 / 25460050 / -1.5% 36226962 / 36696758 / -1.3% 0.69 / 0.69 / -0.3%
tpcds_q86/duckdb:vortex-file-compressed 10179922 / 10224453 / -0.4% 17241313 / 17137163 / +0.6% 0.59 / 0.60 / -1.0%
tpcds_q87/duckdb:vortex-file-compressed 25557880 / 25725580 / -0.7% 32847378 / 32933374 / -0.3% 0.78 / 0.78 / -0.4%
tpcds_q88/duckdb:vortex-file-compressed 30313730 / 29997091 / +1.1% 40186071 / 37583546 / +6.9% 0.75 / 0.80 / -5.5%
tpcds_q89/duckdb:vortex-file-compressed 11843098 / 12162964 / -2.6% 21186929 / 20671635 / +2.5% 0.56 / 0.59 / -5.0%
tpcds_q90/duckdb:vortex-file-compressed 7760748 / 7788028 / -0.4% 14542086 / 14978028 / -2.9% 0.53 / 0.52 / +2.6%
tpcds_q91/duckdb:vortex-file-compressed 14829116 / 14779044 / +0.3% 24658254 / 23865717 / +3.3% 0.60 / 0.62 / -2.9%
tpcds_q92/duckdb:vortex-file-compressed 10830367 / 10909024 / -0.7% 19563909 / 19216909 / +1.8% 0.55 / 0.57 / -2.5%
tpcds_q93/duckdb:vortex-file-compressed 10084502 / 10107199 / -0.2% 23693925 / 22329175 / +6.1% 0.43 / 0.45 / -6.0%
tpcds_q94/duckdb:vortex-file-compressed 22015374 / 22082900 / -0.3% 31801460 / 32016365 / -0.7% 0.69 / 0.69 / +0.4%
tpcds_q95/duckdb:vortex-file-compressed 60780645 / 60759294 / +0.0% 69174454 / 69440796 / -0.4% 0.88 / 0.87 / +0.4%
tpcds_q96/duckdb:vortex-file-compressed 6749662 / 6545172 / +3.1% 15251627 / 17141130 / -11.0% 🟢 0.44 / 0.38 / +15.9%
tpcds_q97/duckdb:vortex-file-compressed 23358220 / 23186155 / +0.7% 33472893 / 32510998 / +3.0% 0.70 / 0.71 / -2.2%
tpcds_q98/duckdb:vortex-file-compressed 11201040 / 11160127 / +0.4% 19948870 / 19608832 / +1.7% 0.56 / 0.57 / -1.3%
tpcds_q99/duckdb:vortex-file-compressed 14578634 / 14448012 / +0.9% 22803239 / 22368486 / +1.9% 0.64 / 0.65 / -1.0%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23794868 / 23992330 / -0.8% 30746418 / 30862688 / -0.4% 0.77 / 0.78 / -0.4%
tpcds_q02/duckdb:parquet 18059650 / 17895798 / +0.9% 23630742 / 24130914 / -2.1% 0.76 / 0.74 / +3.1%
tpcds_q03/duckdb:parquet 9881856 / 9881316 / +0.0% 15608877 / 15590793 / +0.1% 0.63 / 0.63 / -0.1%
tpcds_q04/duckdb:parquet 117574796 / 118540024 / -0.8% 125552650 / 124557288 / +0.8% 0.94 / 0.95 / -1.6%
tpcds_q05/duckdb:parquet 28156394 / 28614334 / -1.6% 33425749 / 32830031 / +1.8% 0.84 / 0.87 / -3.4%
tpcds_q06/duckdb:parquet 26164744 / 26375370 / -0.8% 35358966 / 35699977 / -1.0% 0.74 / 0.74 / +0.2%
tpcds_q07/duckdb:parquet 31027278 / 30933221 / +0.3% 39442989 / 38459448 / +2.6% 0.79 / 0.80 / -2.2%
tpcds_q08/duckdb:parquet 19596612 / 19803862 / -1.0% 25692902 / 26230589 / -2.0% 0.76 / 0.75 / +1.0%
tpcds_q09/duckdb:parquet 26937552 / 26194933 / +2.8% 29981731 / 31169973 / -3.8% 0.90 / 0.84 / +6.9%
tpcds_q10/duckdb:parquet 32499428 / 32606990 / -0.3% 40136743 / 40643155 / -1.2% 0.81 / 0.80 / +0.9%
tpcds_q11/duckdb:parquet 68207432 / 68450738 / -0.4% 74848764 / 75771486 / -1.2% 0.91 / 0.90 / +0.9%
tpcds_q12/duckdb:parquet 13925006 / 14075518 / -1.1% 18949685 / 19141132 / -1.0% 0.73 / 0.74 / -0.1%
tpcds_q13/duckdb:parquet 30417550 / 30175895 / +0.8% 39409617 / 39165172 / +0.6% 0.77 / 0.77 / +0.2%
tpcds_q14/duckdb:parquet 64016784 / 65286585 / -1.9% 68199701 / 69052014 / -1.2% 0.94 / 0.95 / -0.7%
tpcds_q15/duckdb:parquet 16456132 / 16577580 / -0.7% 22711341 / 22498651 / +0.9% 0.72 / 0.74 / -1.7%
tpcds_q16/duckdb:parquet 30103597 / 30145744 / -0.1% 37080898 / 36793586 / +0.8% 0.81 / 0.82 / -0.9%
tpcds_q17/duckdb:parquet 34099114 / 34579053 / -1.4% 39549898 / 39879751 / -0.8% 0.86 / 0.87 / -0.6%
tpcds_q18/duckdb:parquet 46976852 / 47067653 / -0.2% 54890464 / 54420881 / +0.9% 0.86 / 0.86 / -1.0%
tpcds_q19/duckdb:parquet 18539017 / 18826044 / -1.5% 25387705 / 25395950 / -0.0% 0.73 / 0.74 / -1.5%
tpcds_q20/duckdb:parquet 14793744 / 14992312 / -1.3% 19688347 / 19452440 / +1.2% 0.75 / 0.77 / -2.5%
tpcds_q21/duckdb:parquet 10646118 / 10488534 / +1.5% 16867906 / 16785640 / +0.5% 0.63 / 0.62 / +1.0%
tpcds_q22/duckdb:parquet 20546316 / 20528438 / +0.1% 26594030 / 26721731 / -0.5% 0.77 / 0.77 / +0.6%
tpcds_q23/duckdb:parquet 44085216 / 45906198 / -4.0% 48651336 / 49310133 / -1.3% 0.91 / 0.93 / -2.7%
tpcds_q24/duckdb:parquet 30322997 / 30089530 / +0.8% 35929589 / 36421937 / -1.4% 0.84 / 0.83 / +2.2%
tpcds_q25/duckdb:parquet 30322016 / 30576670 / -0.8% 36785726 / 36952824 / -0.5% 0.82 / 0.83 / -0.4%
tpcds_q26/duckdb:parquet 28718102 / 28994722 / -1.0% 35549691 / 34486635 / +3.1% 0.81 / 0.84 / -3.9%
tpcds_q27/duckdb:parquet 34245392 / 34599478 / -1.0% 41716213 / 41248130 / +1.1% 0.82 / 0.84 / -2.1%
tpcds_q28/duckdb:parquet 25566022 / 26361912 / -3.0% 31620785 / 34707796 / -8.9% 0.81 / 0.76 / +6.4%
tpcds_q29/duckdb:parquet 33382932 / 34151211 / -2.2% 39581623 / 38815884 / +2.0% 0.84 / 0.88 / -4.1%
tpcds_q30/duckdb:parquet 35637366 / 35221424 / +1.2% 44206618 / 43808364 / +0.9% 0.81 / 0.80 / +0.3%
tpcds_q31/duckdb:parquet 35333578 / 35743245 / -1.1% 43585281 / 42088762 / +3.6% 0.81 / 0.85 / -4.5%
tpcds_q32/duckdb:parquet 14125714 / 14184810 / -0.4% 20746460 / 20754710 / -0.0% 0.68 / 0.68 / -0.4%
tpcds_q33/duckdb:parquet 23869360 / 25542524 / -6.6% 28868551 / 29582146 / -2.4% 0.83 / 0.86 / -4.2%
tpcds_q34/duckdb:parquet 17010790 / 16945063 / +0.4% 24209269 / 24226404 / -0.1% 0.70 / 0.70 / +0.5%
tpcds_q35/duckdb:parquet 35040113 / 35074861 / -0.1% 43643726 / 43710593 / -0.2% 0.80 / 0.80 / +0.1%
tpcds_q36/duckdb:parquet 41171343 / 42611464 / -3.4% 47275728 / 46945992 / +0.7% 0.87 / 0.91 / -4.1%
tpcds_q37/duckdb:parquet 12659076 / 12554788 / +0.8% 20125594 / 19307602 / +4.2% 0.63 / 0.65 / -3.3%
tpcds_q38/duckdb:parquet 29446823 / 29699789 / -0.9% 33401578 / 33572875 / -0.5% 0.88 / 0.88 / -0.3%
tpcds_q39/duckdb:parquet 23232830 / 23140028 / +0.4% 29443916 / 29553803 / -0.4% 0.79 / 0.78 / +0.8%
tpcds_q40/duckdb:parquet 15756696 / 15938410 / -1.1% 21151828 / 21206601 / -0.3% 0.74 / 0.75 / -0.9%
tpcds_q41/duckdb:parquet 11883922 / 12013214 / -1.1% 18106656 / 18098432 / +0.0% 0.66 / 0.66 / -1.1%
tpcds_q42/duckdb:parquet 9680008 / 9542676 / +1.4% 15132286 / 15340537 / -1.4% 0.64 / 0.62 / +2.8%
tpcds_q43/duckdb:parquet 11957134 / 12008534 / -0.4% 18058214 / 17950867 / +0.6% 0.66 / 0.67 / -1.0%
tpcds_q44/duckdb:parquet 21533197 / 21083644 / +2.1% 27368175 / 27663694 / -1.1% 0.79 / 0.76 / +3.2%
tpcds_q45/duckdb:parquet 20792366 / 20743050 / +0.2% 27869519 / 27834699 / +0.1% 0.75 / 0.75 / +0.1%
tpcds_q46/duckdb:parquet 38958027 / 36853716 / +5.7% 43181343 / 42846967 / +0.8% 0.90 / 0.86 / +4.9%
tpcds_q47/duckdb:parquet 34378874 / 34777798 / -1.1% 41230515 / 41469033 / -0.6% 0.83 / 0.84 / -0.6%
tpcds_q48/duckdb:parquet 28835888 / 28636975 / +0.7% 36921729 / 36120548 / +2.2% 0.78 / 0.79 / -1.5%
tpcds_q49/duckdb:parquet 30914074 / 28693898 / +7.7% 36699566 / 36677538 / +0.1% 0.84 / 0.78 / +7.7%
tpcds_q50/duckdb:parquet 19435300 / 20489558 / -5.1% 25360841 / 25432558 / -0.3% 0.77 / 0.81 / -4.9%
tpcds_q51/duckdb:parquet 52345760 / 52428870 / -0.2% 59001465 / 60188028 / -2.0% 0.89 / 0.87 / +1.8%
tpcds_q52/duckdb:parquet 9592136 / 9681485 / -0.9% 15502132 / 15322073 / +1.2% 0.62 / 0.63 / -2.1%
tpcds_q53/duckdb:parquet 13807595 / 14085912 / -2.0% 20732147 / 20635934 / +0.5% 0.67 / 0.68 / -2.4%
tpcds_q54/duckdb:parquet 24913074 / 25004478 / -0.4% 31469260 / 32022591 / -1.7% 0.79 / 0.78 / +1.4%
tpcds_q55/duckdb:parquet 9472646 / 9443672 / +0.3% 15761866 / 15359023 / +2.6% 0.60 / 0.61 / -2.3%
tpcds_q56/duckdb:parquet 26409254 / 26080919 / +1.3% 30392068 / 30080374 / +1.0% 0.87 / 0.87 / +0.2%
tpcds_q57/duckdb:parquet 30402053 / 30756253 / -1.2% 35881173 / 35552045 / +0.9% 0.85 / 0.87 / -2.1%
tpcds_q58/duckdb:parquet 23749606 / 23793366 / -0.2% 29630552 / 29548898 / +0.3% 0.80 / 0.81 / -0.5%
tpcds_q59/duckdb:parquet 22796387 / 22714948 / +0.4% 28935808 / 28792474 / +0.5% 0.79 / 0.79 / -0.1%
tpcds_q60/duckdb:parquet 26315664 / 27173542 / -3.2% 32068398 / 32281858 / -0.7% 0.82 / 0.84 / -2.5%
tpcds_q61/duckdb:parquet 23866450 / 25119927 / -5.0% 28834304 / 32224142 / -10.5% 🟢 0.83 / 0.78 / +6.2%
tpcds_q62/duckdb:parquet 12810772 / 12765448 / +0.4% 17912068 / 17712393 / +1.1% 0.72 / 0.72 / -0.8%
tpcds_q63/duckdb:parquet 13219446 / 13209176 / +0.1% 19652228 / 19891086 / -1.2% 0.67 / 0.66 / +1.3%
tpcds_q64/duckdb:parquet 69920648 / 70524530 / -0.9% 79985099 / 80884812 / -1.1% 0.87 / 0.87 / +0.3%
tpcds_q65/duckdb:parquet 19771275 / 21318092 / -7.3% 26140385 / 27115153 / -3.6% 0.76 / 0.79 / -3.8%
tpcds_q66/duckdb:parquet 33320564 / 33389874 / -0.2% 38264250 / 38694154 / -1.1% 0.87 / 0.86 / +0.9%
tpcds_q67/duckdb:parquet 60246768 / 60779158 / -0.9% 66950027 / 68363615 / -2.1% 0.90 / 0.89 / +1.2%
tpcds_q68/duckdb:parquet 30771111 / 28091686 / +9.5% 36537154 / 36226284 / +0.9% 0.84 / 0.78 / +8.6%
tpcds_q69/duckdb:parquet 26046870 / 26085722 / -0.1% 34391548 / 34120847 / +0.8% 0.76 / 0.76 / -0.9%
tpcds_q70/duckdb:parquet 20688214 / 19278341 / +7.3% 27142302 / 26731678 / +1.5% 0.76 / 0.72 / +5.7%
tpcds_q71/duckdb:parquet 16856725 / 17108214 / -1.5% 24117004 / 23592079 / +2.2% 0.70 / 0.73 / -3.6%
tpcds_q72/duckdb:parquet 53330674 / 53490028 / -0.3% 59177890 / 59070782 / +0.2% 0.90 / 0.91 / -0.5%
tpcds_q73/duckdb:parquet 15133276 / 15148840 / -0.1% 21477485 / 21451039 / +0.1% 0.70 / 0.71 / -0.2%
tpcds_q74/duckdb:parquet 83634516 / 84201315 / -0.7% 88749105 / 90679548 / -2.1% 0.94 / 0.93 / +1.5%
tpcds_q75/duckdb:parquet 42944539 / 44353187 / -3.2% 49704067 / 49751269 / -0.1% 0.86 / 0.89 / -3.1%
tpcds_q76/duckdb:parquet 19210938 / 17574542 / +9.3% 23179078 / 23205817 / -0.1% 0.83 / 0.76 / +9.4%
tpcds_q77/duckdb:parquet 25095750 / 26371702 / -4.8% 31587989 / 30807578 / +2.5% 0.79 / 0.86 / -7.2%
tpcds_q78/duckdb:parquet 77516645 / 78409708 / -1.1% 85162602 / 85907730 / -0.9% 0.91 / 0.91 / -0.3%
tpcds_q79/duckdb:parquet 23643492 / 22825446 / +3.6% 28676740 / 28522952 / +0.5% 0.82 / 0.80 / +3.0%
tpcds_q80/duckdb:parquet 35941457 / 35649556 / +0.8% 43901656 / 43387662 / +1.2% 0.82 / 0.82 / -0.4%
tpcds_q81/duckdb:parquet 36037891 / 36395680 / -1.0% 44259499 / 44341610 / -0.2% 0.81 / 0.82 / -0.8%
tpcds_q82/duckdb:parquet 13429676 / 13411410 / +0.1% 20255141 / 20063857 / +1.0% 0.66 / 0.67 / -0.8%
tpcds_q83/duckdb:parquet 20234748 / 20235612 / -0.0% 25026578 / 24957031 / +0.3% 0.81 / 0.81 / -0.3%
tpcds_q84/duckdb:parquet 23092992 / 22816583 / +1.2% 28928721 / 28481166 / +1.6% 0.80 / 0.80 / -0.4%
tpcds_q85/duckdb:parquet 31820860 / 32646986 / -2.5% 39648797 / 39501423 / +0.4% 0.80 / 0.83 / -2.9%
tpcds_q86/duckdb:parquet 11697032 / 11892854 / -1.6% 16919407 / 16944979 / -0.2% 0.69 / 0.70 / -1.5%
tpcds_q87/duckdb:parquet 31141130 / 31112244 / +0.1% 35997566 / 35232366 / +2.2% 0.87 / 0.88 / -2.0%
tpcds_q88/duckdb:parquet 38402399 / 38850230 / -1.2% 42156293 / 45207636 / -6.7% 0.91 / 0.86 / +6.0%
tpcds_q89/duckdb:parquet 14211508 / 14584683 / -2.6% 21271265 / 21236618 / +0.2% 0.67 / 0.69 / -2.7%
tpcds_q90/duckdb:parquet 10072540 / 9960684 / +1.1% 15109865 / 15604486 / -3.2% 0.67 / 0.64 / +4.4%
tpcds_q91/duckdb:parquet 20992630 / 21229354 / -1.1% 28401263 / 28315248 / +0.3% 0.74 / 0.75 / -1.4%
tpcds_q92/duckdb:parquet 15490582 / 15580498 / -0.6% 22567327 / 22217641 / +1.6% 0.69 / 0.70 / -2.1%
tpcds_q93/duckdb:parquet 14027252 / 14062698 / -0.3% 19830620 / 20299944 / -2.3% 0.71 / 0.69 / +2.1%
tpcds_q94/duckdb:parquet 25393464 / 25270460 / +0.5% 32522430 / 32933164 / -1.2% 0.78 / 0.77 / +1.8%
tpcds_q95/duckdb:parquet 43994815 / 44086006 / -0.2% 49333643 / 49672312 / -0.7% 0.89 / 0.89 / +0.5%
tpcds_q96/duckdb:parquet 8181922 / 8457292 / -3.3% 13934311 / 14272824 / -2.4% 0.59 / 0.59 / -0.9%
tpcds_q97/duckdb:parquet 27325404 / 27710206 / -1.4% 33994395 / 34283003 / -0.8% 0.80 / 0.81 / -0.6%
tpcds_q98/duckdb:parquet 16290654 / 16396122 / -0.6% 23237285 / 22739699 / +2.2% 0.70 / 0.72 / -2.8%
tpcds_q99/duckdb:parquet 18834661 / 18823192 / +0.1% 24547363 / 24485127 / +0.3% 0.77 / 0.77 / -0.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 43742ab2 vs base d7aa24e8
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.7%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.993x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.016x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92252080 / 91056133 / +1.3% 139710013 / 151462396 / -7.8% 0.66 / 0.60 / +9.8%
tpch_q02/datafusion:vortex-file-compressed 64431108 / 64425349 / +0.0% 96668558 / 92922752 / +4.0% 0.67 / 0.69 / -3.9%
tpch_q03/datafusion:vortex-file-compressed 62172979 / 63069592 / -1.4% 122611478 / 136453468 / -10.1% 🟢 0.51 / 0.46 / +9.7%
tpch_q04/datafusion:vortex-file-compressed 34137666 / 34377462 / -0.7% 72689448 / 69308842 / +4.9% 0.47 / 0.50 / -5.3%
tpch_q05/datafusion:vortex-file-compressed 120600095 / 118545885 / +1.7% 175050224 / 183735948 / -4.7% 0.69 / 0.65 / +6.8%
tpch_q06/datafusion:vortex-file-compressed 9832639 / 9043201 / +8.7% 58034528 / 56079076 / +3.5% 0.17 / 0.16 / +5.1%
tpch_q07/datafusion:vortex-file-compressed 96761079 / 96716335 / +0.0% 155909389 / 165178245 / -5.6% 0.62 / 0.59 / +6.0%
tpch_q08/datafusion:vortex-file-compressed 142599927 / 142555394 / +0.0% 211424490 / 200562310 / +5.4% 0.67 / 0.71 / -5.1%
tpch_q09/datafusion:vortex-file-compressed 185009479 / 182756628 / +1.2% 271638341 / 262515657 / +3.5% 0.68 / 0.70 / -2.2%
tpch_q10/datafusion:vortex-file-compressed 69952746 / 69704921 / +0.4% 141733258 / 136870806 / +3.6% 0.49 / 0.51 / -3.1%
tpch_q11/datafusion:vortex-file-compressed 45520175 / 45938038 / -0.9% 73182925 / 68509638 / +6.8% 0.62 / 0.67 / -7.2%
tpch_q12/datafusion:vortex-file-compressed 35399677 / 35237010 / +0.5% 84590208 / 82671696 / +2.3% 0.42 / 0.43 / -1.8%
tpch_q13/datafusion:vortex-file-compressed 48924144 / 47931593 / +2.1% 84005458 / 79298856 / +5.9% 0.58 / 0.60 / -3.6%
tpch_q14/datafusion:vortex-file-compressed 20398582 / 20202946 / +1.0% 86644213 / 91348008 / -5.1% 0.24 / 0.22 / +6.4%
tpch_q15/datafusion:vortex-file-compressed 33110436 / 32569588 / +1.7% 91803130 / 93442830 / -1.8% 0.36 / 0.35 / +3.5%
tpch_q16/datafusion:vortex-file-compressed 37133577 / 37060568 / +0.2% 67045695 / 67359593 / -0.5% 0.55 / 0.55 / +0.7%
tpch_q17/datafusion:vortex-file-compressed 176529102 / 177475147 / -0.5% 229533598 / 221514924 / +3.6% 0.77 / 0.80 / -4.0%
tpch_q18/datafusion:vortex-file-compressed 207774613 / 206258875 / +0.7% 271853293 / 263821619 / +3.0% 0.76 / 0.78 / -2.2%
tpch_q19/datafusion:vortex-file-compressed 28034465 / 27922447 / +0.4% 82278667 / 85639472 / -3.9% 0.34 / 0.33 / +4.5%
tpch_q20/datafusion:vortex-file-compressed 60418989 / 60837814 / -0.7% 108409865 / 111483590 / -2.8% 0.56 / 0.55 / +2.1%
tpch_q21/datafusion:vortex-file-compressed 182133421 / 180617211 / +0.8% 231340479 / 238088550 / -2.8% 0.79 / 0.76 / +3.8%
tpch_q22/datafusion:vortex-file-compressed 25519461 / 25587895 / -0.3% 52513764 / 52950814 / -0.8% 0.49 / 0.48 / +0.6%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87365288 / 87594391 / -0.3% 129284005 / 121723004 / +6.2% 0.68 / 0.72 / -6.1%
tpch_q02/datafusion:parquet 174568174 / 173709251 / +0.5% 199906485 / 200177323 / -0.1% 0.87 / 0.87 / +0.6%
tpch_q03/datafusion:parquet 135377210 / 135219310 / +0.1% 182845222 / 176955580 / +3.3% 0.74 / 0.76 / -3.1%
tpch_q04/datafusion:parquet 57388557 / 56328969 / +1.9% 96965975 / 88621610 / +9.4% 0.59 / 0.64 / -6.9%
tpch_q05/datafusion:parquet 167425649 / 168195509 / -0.5% 224333688 / 215362651 / +4.2% 0.75 / 0.78 / -4.4%
tpch_q06/datafusion:parquet 36714605 / 36996469 / -0.8% 77924501 / 72532899 / +7.4% 0.47 / 0.51 / -7.6%
tpch_q07/datafusion:parquet 215798265 / 216488187 / -0.3% 279280890 / 266257367 / +4.9% 0.77 / 0.81 / -5.0%
tpch_q08/datafusion:parquet 218135527 / 219945005 / -0.8% 287117940 / 280354233 / +2.4% 0.76 / 0.78 / -3.2%
tpch_q09/datafusion:parquet 307904160 / 308910726 / -0.3% 368494919 / 369229261 / -0.2% 0.84 / 0.84 / -0.1%
tpch_q10/datafusion:parquet 312007511 / 311989153 / +0.0% 368604369 / 359384935 / +2.6% 0.85 / 0.87 / -2.5%
tpch_q11/datafusion:parquet 127787329 / 127505168 / +0.2% 149764711 / 148989339 / +0.5% 0.85 / 0.86 / -0.3%
tpch_q12/datafusion:parquet 82991889 / 82443941 / +0.7% 119216977 / 117516854 / +1.4% 0.70 / 0.70 / -0.8%
tpch_q13/datafusion:parquet 210407881 / 210323610 / +0.0% 239617943 / 237641427 / +0.8% 0.88 / 0.89 / -0.8%
tpch_q14/datafusion:parquet 85669803 / 86066809 / -0.5% 187163824 / 196114627 / -4.6% 0.46 / 0.44 / +4.3%
tpch_q15/datafusion:parquet 105943509 / 107679035 / -1.6% 157153073 / 152476298 / +3.1% 0.67 / 0.71 / -4.5%
tpch_q16/datafusion:parquet 96807486 / 94916528 / +2.0% 121812350 / 119269813 / +2.1% 0.79 / 0.80 / -0.1%
tpch_q17/datafusion:parquet 213473749 / 214165133 / -0.3% 264084288 / 262074519 / +0.8% 0.81 / 0.82 / -1.1%
tpch_q18/datafusion:parquet 268001230 / 270566830 / -0.9% 311777416 / 316309535 / -1.4% 0.86 / 0.86 / +0.5%
tpch_q19/datafusion:parquet 109578081 / 109016125 / +0.5% 169168590 / 162301906 / +4.2% 0.65 / 0.67 / -3.6%
tpch_q20/datafusion:parquet 186875816 / 186025503 / +0.5% 242178057 / 239969368 / +0.9% 0.77 / 0.78 / -0.5%
tpch_q21/datafusion:parquet 243618859 / 244233875 / -0.3% 310722473 / 307111328 / +1.2% 0.78 / 0.80 / -1.4%
tpch_q22/datafusion:parquet 150111257 / 149654133 / +0.3% 173610068 / 170522180 / +1.8% 0.86 / 0.88 / -1.5%
duckdb / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32009151 / 32785622 / -2.4% 63994499 / 65579722 / -2.4% 0.50 / 0.50 / +0.1%
tpch_q02/duckdb:vortex-file-compressed 28808856 / 28911652 / -0.4% 43475204 / 42891581 / +1.4% 0.66 / 0.67 / -1.7%
tpch_q03/duckdb:vortex-file-compressed 51432054 / 51480887 / -0.1% 96558756 / 96032223 / +0.5% 0.53 / 0.54 / -0.6%
tpch_q04/duckdb:vortex-file-compressed 51271239 / 52161506 / -1.7% 83644076 / 83949828 / -0.4% 0.61 / 0.62 / -1.3%
tpch_q05/duckdb:vortex-file-compressed 69071322 / 68463966 / +0.9% 103659225 / 107293640 / -3.4% 0.67 / 0.64 / +4.4%
tpch_q06/duckdb:vortex-file-compressed 14845565 / 14853468 / -0.1% 46581802 / 46050911 / +1.2% 0.32 / 0.32 / -1.2%
tpch_q07/duckdb:vortex-file-compressed 54343111 / 54628110 / -0.5% 104374259 / 105277116 / -0.9% 0.52 / 0.52 / +0.3%
tpch_q08/duckdb:vortex-file-compressed 84709267 / 84754339 / -0.1% 123696592 / 123702773 / -0.0% 0.68 / 0.69 / -0.0%
tpch_q09/duckdb:vortex-file-compressed 102191878 / 101336706 / +0.8% 148637910 / 151641538 / -2.0% 0.69 / 0.67 / +2.9%
tpch_q10/duckdb:vortex-file-compressed 96549503 / 96498210 / +0.1% 145389342 / 141979810 / +2.4% 0.66 / 0.68 / -2.3%
tpch_q11/duckdb:vortex-file-compressed 13811239 / 13584085 / +1.7% 28939621 / 29217922 / -1.0% 0.48 / 0.46 / +2.6%
tpch_q12/duckdb:vortex-file-compressed 44977725 / 45075165 / -0.2% 76000690 / 77162095 / -1.5% 0.59 / 0.58 / +1.3%
tpch_q13/duckdb:vortex-file-compressed 71731927 / 71464027 / +0.4% 94589468 / 96445039 / -1.9% 0.76 / 0.74 / +2.3%
tpch_q14/duckdb:vortex-file-compressed 27375475 / 27521238 / -0.5% 68435472 / 71275844 / -4.0% 0.40 / 0.39 / +3.6%
tpch_q15/duckdb:vortex-file-compressed 23835108 / 24071272 / -1.0% 59671120 / 61322748 / -2.7% 0.40 / 0.39 / +1.8%
tpch_q16/duckdb:vortex-file-compressed 49122759 / 48901686 / +0.5% 58551180 / 59218778 / -1.1% 0.84 / 0.83 / +1.6%
tpch_q17/duckdb:vortex-file-compressed 34989501 / 35334478 / -1.0% 63797902 / 65974406 / -3.3% 0.55 / 0.54 / +2.4%
tpch_q18/duckdb:vortex-file-compressed 101607476 / 106257427 / -4.4% 115423029 / 120554529 / -4.3% 0.88 / 0.88 / -0.1%
tpch_q19/duckdb:vortex-file-compressed 26745312 / 26969035 / -0.8% 70997118 / 71504006 / -0.7% 0.38 / 0.38 / -0.1%
tpch_q20/duckdb:vortex-file-compressed 41039936 / 41157729 / -0.3% 86334022 / 86962952 / -0.7% 0.48 / 0.47 / +0.4%
tpch_q21/duckdb:vortex-file-compressed 92402516 / 94781184 / -2.5% 138627298 / 142138819 / -2.5% 0.67 / 0.67 / -0.0%
tpch_q22/duckdb:vortex-file-compressed 32581425 / 32858811 / -0.8% 47927488 / 48066863 / -0.3% 0.68 / 0.68 / -0.6%
duckdb / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 67768617 / 67634423 / +0.2% 88835277 / 86771065 / +2.4% 0.76 / 0.78 / -2.1%
tpch_q02/duckdb:parquet 86532596 / 87223705 / -0.8% 96281480 / 97225752 / -1.0% 0.90 / 0.90 / +0.2%
tpch_q03/duckdb:parquet 109541400 / 109876389 / -0.3% 142827573 / 140199580 / +1.9% 0.77 / 0.78 / -2.1%
tpch_q04/duckdb:parquet 76435234 / 76368150 / +0.1% 97236684 / 94431657 / +3.0% 0.79 / 0.81 / -2.8%
tpch_q05/duckdb:parquet 124303713 / 121949504 / +1.9% 158045707 / 155282417 / +1.8% 0.79 / 0.79 / +0.1%
tpch_q06/duckdb:parquet 35600292 / 35845077 / -0.7% 58985451 / 56920666 / +3.6% 0.60 / 0.63 / -4.2%
tpch_q07/duckdb:parquet 118457906 / 118129409 / +0.3% 156091258 / 154096815 / +1.3% 0.76 / 0.77 / -1.0%
tpch_q08/duckdb:parquet 147883090 / 147207034 / +0.5% 190645531 / 188446120 / +1.2% 0.78 / 0.78 / -0.7%
tpch_q09/duckdb:parquet 238799230 / 236434383 / +1.0% 279928504 / 274368885 / +2.0% 0.85 / 0.86 / -1.0%
tpch_q10/duckdb:parquet 312835892 / 313591987 / -0.2% 338647448 / 333964906 / +1.4% 0.92 / 0.94 / -1.6%
tpch_q11/duckdb:parquet 43435956 / 43630347 / -0.4% 50370176 / 50699304 / -0.6% 0.86 / 0.86 / +0.2%
tpch_q12/duckdb:parquet 70096691 / 70547471 / -0.6% 88892727 / 88240971 / +0.7% 0.79 / 0.80 / -1.4%
tpch_q13/duckdb:parquet 291440706 / 291574529 / -0.0% 307797332 / 305939978 / +0.6% 0.95 / 0.95 / -0.6%
tpch_q14/duckdb:parquet 99446828 / 104908165 / -5.2% 137066960 / 132640904 / +3.3% 0.73 / 0.79 / -8.3%
tpch_q15/duckdb:parquet 57829891 / 57481609 / +0.6% 87703622 / 86004284 / +2.0% 0.66 / 0.67 / -1.3%
tpch_q16/duckdb:parquet 99486036 / 99571759 / -0.1% 105863369 / 106081557 / -0.2% 0.94 / 0.94 / +0.1%
tpch_q17/duckdb:parquet 83119535 / 82247454 / +1.1% 112632102 / 125481547 / -10.2% 🟢 0.74 / 0.66 / +12.6%
tpch_q18/duckdb:parquet 157563845 / 155501075 / +1.3% 171098060 / 167645546 / +2.1% 0.92 / 0.93 / -0.7%
tpch_q19/duckdb:parquet 97279726 / 96266513 / +1.1% 134358620 / 127151579 / +5.7% 0.72 / 0.76 / -4.4%
tpch_q20/duckdb:parquet 147489430 / 147264252 / +0.2% 183151762 / 179381070 / +2.1% 0.81 / 0.82 / -1.9%
tpch_q21/duckdb:parquet 254443002 / 251434904 / +1.2% 274982086 / 274126610 / +0.3% 0.93 / 0.92 / +0.9%
tpch_q22/duckdb:parquet 168041667 / 168190587 / -0.1% 178815216 / 179113696 / -0.2% 0.94 / 0.94 / +0.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 43742ab2 vs base d7aa24e8
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.9%, environment too noisy confidence) · DuckDB No clear signal (-0.3%, environment too noisy confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.985x ➖
Parquet (geomean): hot 0.989x ➖ · cold 0.958x ➖
Shifts: Parquet (control) -1.1% · Median polish -2.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 210212447 / 210809009 / -0.3% 565611655 / 641200862 / -11.8% 0.37 / 0.33 / +13.0%
tpch_q02/datafusion:vortex-file-compressed 312988526 / 335917362 / -6.8% 563183791 / 748497563 / -24.8% 0.56 / 0.45 / +23.8%
tpch_q03/datafusion:vortex-file-compressed 308599785 / 332713344 / -7.2% 684218356 / 918933122 / -25.5% 0.45 / 0.36 / +24.6%
tpch_q04/datafusion:vortex-file-compressed 170274886 / 170762202 / -0.3% 344954908 / 404229450 / -14.7% 0.49 / 0.42 / +16.8%
tpch_q05/datafusion:vortex-file-compressed 363208037 / 353383936 / +2.8% 492190188 / 485394469 / +1.4% 0.74 / 0.73 / +1.4%
tpch_q06/datafusion:vortex-file-compressed 121893607 / 135096460 / -9.8% 286630965 / 363751259 / -21.2% 0.43 / 0.37 / +14.5%
tpch_q07/datafusion:vortex-file-compressed 405267983 / 454711002 / -10.9% 643339630 / 701388576 / -8.3% 0.63 / 0.65 / -2.8%
tpch_q08/datafusion:vortex-file-compressed 444146704 / 403044894 / +10.2% 696976153 / 609057600 / +14.4% 0.64 / 0.66 / -3.7%
tpch_q09/datafusion:vortex-file-compressed 285355400 / 296799152 / -3.9% 517487332 / 505137341 / +2.4% 0.55 / 0.59 / -6.2%
tpch_q10/datafusion:vortex-file-compressed 378953067 / 368660368 / +2.8% 544535571 / 587319829 / -7.3% 0.70 / 0.63 / +10.9%
tpch_q11/datafusion:vortex-file-compressed 274598164 / 287051501 / -4.3% 451678832 / 491331261 / -8.1% 0.61 / 0.58 / +4.1%
tpch_q12/datafusion:vortex-file-compressed 263437891 / 232214886 / +13.4% 372859255 / 425155771 / -12.3% 0.71 / 0.55 / +29.4%
tpch_q13/datafusion:vortex-file-compressed 101759542 / 103292221 / -1.5% 314638753 / 296218224 / +6.2% 0.32 / 0.35 / -7.3%
tpch_q14/datafusion:vortex-file-compressed 178986087 / 183291728 / -2.3% 356833461 / 388832467 / -8.2% 0.50 / 0.47 / +6.4%
tpch_q15/datafusion:vortex-file-compressed 288497096 / 296399172 / -2.7% 506403148 / 508302149 / -0.4% 0.57 / 0.58 / -2.3%
tpch_q16/datafusion:vortex-file-compressed 145381602 / 135282951 / +7.5% 329422839 / 257261008 / +28.1% 0.44 / 0.53 / -16.1%
tpch_q17/datafusion:vortex-file-compressed 242410071 / 318182655 / -23.8% 412222528 / 458590454 / -10.1% 0.59 / 0.69 / -15.2%
tpch_q18/datafusion:vortex-file-compressed 425441844 / 254386116 / +67.2% 🔴 898131909 / 437747726 / +105.2% 🔴 0.47 / 0.58 / -18.5%
tpch_q19/datafusion:vortex-file-compressed 216010492 / 229417666 / -5.8% 406948519 / 314740073 / +29.3% 0.53 / 0.73 / -27.2%
tpch_q20/datafusion:vortex-file-compressed 244272327 / 243026738 / +0.5% 443560090 / 691194187 / -35.8% 🟢 0.55 / 0.35 / +56.6%
tpch_q21/datafusion:vortex-file-compressed 501656471 / 425177182 / +18.0% 681729433 / 644510994 / +5.8% 0.74 / 0.66 / +11.5%
tpch_q22/datafusion:vortex-file-compressed 140477024 / 150680138 / -6.8% 376527500 / 438977352 / -14.2% 0.37 / 0.34 / +8.7%
datafusion / parquet / ns (0.997x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 143671581 / 144884306 / -0.8% 393945663 / 522367041 / -24.6% 0.36 / 0.28 / +31.5%
tpch_q02/datafusion:parquet 275205914 / 284815469 / -3.4% 445206440 / 531007970 / -16.2% 0.62 / 0.54 / +15.2%
tpch_q03/datafusion:parquet 329643254 / 235894180 / +39.7% 🔴 545322647 / 635297523 / -14.2% 0.60 / 0.37 / +62.8%
tpch_q04/datafusion:parquet 127011600 / 129470325 / -1.9% 319065068 / 295004343 / +8.2% 0.40 / 0.44 / -9.3%
tpch_q05/datafusion:parquet 331105804 / 322036688 / +2.8% 447734876 / 422505672 / +6.0% 0.74 / 0.76 / -3.0%
tpch_q06/datafusion:parquet 109075262 / 110397843 / -1.2% 232343536 / 254080032 / -8.6% 0.47 / 0.43 / +8.0%
tpch_q07/datafusion:parquet 320834612 / 331824992 / -3.3% 461521805 / 502132490 / -8.1% 0.70 / 0.66 / +5.2%
tpch_q08/datafusion:parquet 386220155 / 393794409 / -1.9% 510008440 / 510326368 / -0.1% 0.76 / 0.77 / -1.9%
tpch_q09/datafusion:parquet 368819249 / 376381492 / -2.0% 501987115 / 537734531 / -6.6% 0.73 / 0.70 / +5.0%
tpch_q10/datafusion:parquet 296667224 / 328440456 / -9.7% 430862918 / 418081274 / +3.1% 0.69 / 0.79 / -12.4%
tpch_q11/datafusion:parquet 243214281 / 251971726 / -3.5% 364704748 / 366605906 / -0.5% 0.67 / 0.69 / -3.0%
tpch_q12/datafusion:parquet 151700915 / 157326980 / -3.6% 295524939 / 300758148 / -1.7% 0.51 / 0.52 / -1.9%
tpch_q13/datafusion:parquet 271641338 / 272953925 / -0.5% 396240849 / 455533366 / -13.0% 0.69 / 0.60 / +14.4%
tpch_q14/datafusion:parquet 157700121 / 148840394 / +6.0% 274370187 / 277651370 / -1.2% 0.57 / 0.54 / +7.2%
tpch_q15/datafusion:parquet 297537690 / 300021487 / -0.8% 453101935 / 454766598 / -0.4% 0.66 / 0.66 / -0.5%
tpch_q16/datafusion:parquet 97543545 / 100184885 / -2.6% 201885807 / 190622674 / +5.9% 0.48 / 0.53 / -8.1%
tpch_q17/datafusion:parquet 258845069 / 277152458 / -6.6% 428855167 / 380095139 / +12.8% 0.60 / 0.73 / -17.2%
tpch_q18/datafusion:parquet 297781779 / 317173434 / -6.1% 451110986 / 443241952 / +1.8% 0.66 / 0.72 / -7.8%
tpch_q19/datafusion:parquet 185881025 / 182313868 / +2.0% 296489570 / 562827345 / -47.3% 🟢 0.63 / 0.32 / +93.5%
tpch_q20/datafusion:parquet 229982085 / 240512035 / -4.4% 426146302 / 387857435 / +9.9% 0.54 / 0.62 / -13.0%
tpch_q21/datafusion:parquet 286438677 / 303236012 / -5.5% 483555139 / 425445716 / +13.7% 0.59 / 0.71 / -16.9%
tpch_q22/datafusion:parquet 158546460 / 146744110 / +8.0% 316604916 / 328836939 / -3.7% 0.50 / 0.45 / +12.2%
duckdb / vortex-file-compressed / ns (0.979x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 238001710 / 241672655 / -1.5% 248796482 / 278186653 / -10.6% 0.96 / 0.87 / +10.1%
tpch_q02/duckdb:vortex-file-compressed 380769406 / 391629671 / -2.8% 426684714 / 445761390 / -4.3% 0.89 / 0.88 / +1.6%
tpch_q03/duckdb:vortex-file-compressed 397286069 / 382529559 / +3.9% 468048690 / 606757630 / -22.9% 0.85 / 0.63 / +34.6%
tpch_q04/duckdb:vortex-file-compressed 252870053 / 456768107 / -44.6% 🟢 301930624 / 411691730 / -26.7% 0.84 / 1.11 / -24.5%
tpch_q05/duckdb:vortex-file-compressed 496156707 / 629290681 / -21.2% 584843888 / 562130214 / +4.0% 0.85 / 1.12 / -24.2%
tpch_q06/duckdb:vortex-file-compressed 150613437 / 154928440 / -2.8% 189818051 / 191889797 / -1.1% 0.79 / 0.81 / -1.7%
tpch_q07/duckdb:vortex-file-compressed 376653792 / 384562204 / -2.1% 456241604 / 459533597 / -0.7% 0.83 / 0.84 / -1.3%
tpch_q08/duckdb:vortex-file-compressed 567007926 / 559825410 / +1.3% 621768436 / 679127221 / -8.4% 0.91 / 0.82 / +10.6%
tpch_q09/duckdb:vortex-file-compressed 356666180 / 375335296 / -5.0% 448410077 / 447184783 / +0.3% 0.80 / 0.84 / -5.2%
tpch_q10/duckdb:vortex-file-compressed 849855947 / 521909084 / +62.8% 🔴 1250400540 / 632337307 / +97.7% 🔴 0.68 / 0.83 / -17.7%
tpch_q11/duckdb:vortex-file-compressed 262586859 / 278177169 / -5.6% 284332585 / 266651221 / +6.6% 0.92 / 1.04 / -11.5%
tpch_q12/duckdb:vortex-file-compressed 269003064 / 255367264 / +5.3% 308811906 / 314742309 / -1.9% 0.87 / 0.81 / +7.4%
tpch_q13/duckdb:vortex-file-compressed 215674810 / 243069968 / -11.3% 223798371 / 315127107 / -29.0% 0.96 / 0.77 / +24.9%
tpch_q14/duckdb:vortex-file-compressed 211767181 / 213855437 / -1.0% 267350625 / 255420778 / +4.7% 0.79 / 0.84 / -5.4%
tpch_q15/duckdb:vortex-file-compressed 236569264 / 226396871 / +4.5% 297308977 / 262371296 / +13.3% 0.80 / 0.86 / -7.8%
tpch_q16/duckdb:vortex-file-compressed 191816355 / 199667857 / -3.9% 271649311 / 281183697 / -3.4% 0.71 / 0.71 / -0.6%
tpch_q17/duckdb:vortex-file-compressed 286873351 / 283324987 / +1.3% 343314783 / 381057721 / -9.9% 0.84 / 0.74 / +12.4%
tpch_q18/duckdb:vortex-file-compressed 352243120 / 363356750 / -3.1% 374152098 / 333028853 / +12.3% 0.94 / 1.09 / -13.7%
tpch_q19/duckdb:vortex-file-compressed 291757120 / 267708784 / +9.0% 328319462 / 336135702 / -2.3% 0.89 / 0.80 / +11.6%
tpch_q20/duckdb:vortex-file-compressed 323610769 / 319904434 / +1.2% 395529792 / 387533878 / +2.1% 0.82 / 0.83 / -0.9%
tpch_q21/duckdb:vortex-file-compressed 518908064 / 588509145 / -11.8% 649708114 / 569192592 / +14.1% 0.80 / 1.03 / -22.8%
tpch_q22/duckdb:vortex-file-compressed 257285735 / 224846865 / +14.4% 331652815 / 267806116 / +23.8% 0.78 / 0.84 / -7.6%
duckdb / parquet / ns (0.981x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 163664782 / 170568842 / -4.0% 197879658 / 232984768 / -15.1% 0.83 / 0.73 / +13.0%
tpch_q02/duckdb:parquet 422468868 / 417522265 / +1.2% 456522907 / 434066329 / +5.2% 0.93 / 0.96 / -3.8%
tpch_q03/duckdb:parquet 347174655 / 353811207 / -1.9% 431992844 / 409193347 / +5.6% 0.80 / 0.86 / -7.1%
tpch_q04/duckdb:parquet 280953473 / 222697411 / +26.2% 301265500 / 279528863 / +7.8% 0.93 / 0.80 / +17.1%
tpch_q05/duckdb:parquet 491678133 / 541968934 / -9.3% 526746669 / 632272164 / -16.7% 0.93 / 0.86 / +8.9%
tpch_q06/duckdb:parquet 128194840 / 135613320 / -5.5% 164830756 / 207484806 / -20.6% 0.78 / 0.65 / +19.0%
tpch_q07/duckdb:parquet 407152141 / 430554133 / -5.4% 432685882 / 455809195 / -5.1% 0.94 / 0.94 / -0.4%
tpch_q08/duckdb:parquet 594526228 / 554886732 / +7.1% 610968166 / 603891742 / +1.2% 0.97 / 0.92 / +5.9%
tpch_q09/duckdb:parquet 500030532 / 503892412 / -0.8% 552250547 / 555371340 / -0.6% 0.91 / 0.91 / -0.2%
tpch_q10/duckdb:parquet 556158837 / 511124641 / +8.8% 583932377 / 642137736 / -9.1% 0.95 / 0.80 / +19.7%
tpch_q11/duckdb:parquet 296129661 / 286456662 / +3.4% 308800845 / 296441306 / +4.2% 0.96 / 0.97 / -0.8%
tpch_q12/duckdb:parquet 217801574 / 250116592 / -12.9% 275285522 / 278967912 / -1.3% 0.79 / 0.90 / -11.8%
tpch_q13/duckdb:parquet 347099603 / 404792400 / -14.3% 441918312 / 456848721 / -3.3% 0.79 / 0.89 / -11.4%
tpch_q14/duckdb:parquet 250237795 / 242846645 / +3.0% 310557273 / 347577667 / -10.7% 0.81 / 0.70 / +15.3%
tpch_q15/duckdb:parquet 197206342 / 190318952 / +3.6% 227923129 / 232831649 / -2.1% 0.87 / 0.82 / +5.9%
tpch_q16/duckdb:parquet 258325658 / 278574268 / -7.3% 281197578 / 271794206 / +3.5% 0.92 / 1.02 / -10.4%
tpch_q17/duckdb:parquet 266880624 / 283453918 / -5.8% 329119395 / 353165512 / -6.8% 0.81 / 0.80 / +1.0%
tpch_q18/duckdb:parquet 323470972 / 342141569 / -5.5% 333701905 / 338024700 / -1.3% 0.97 / 1.01 / -4.2%
tpch_q19/duckdb:parquet 258818098 / 264964673 / -2.3% 313372477 / 280090457 / +11.9% 0.83 / 0.95 / -12.7%
tpch_q20/duckdb:parquet 452066705 / 467933874 / -3.4% 556603592 / 529015029 / +5.2% 0.81 / 0.88 / -8.2%
tpch_q21/duckdb:parquet 401774685 / 433560307 / -7.3% 515490856 / 535038016 / -3.7% 0.78 / 0.81 / -3.8%
tpch_q22/duckdb:parquet 283656579 / 289592112 / -2.0% 288836410 / 337595962 / -14.4% 0.98 / 0.86 / +14.5%

@github-actions

github-actions Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 43742ab2 vs base d7aa24e8
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Engines: random-access No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.013x ➖ · cold 1.013x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.986x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/arrow-ipc-cached 3213535 / 2050959 / +56.7% 🔴 3354248 / 2003402 / +67.4% 🔴 0.96 / 1.02 / -6.4%
random-access/feature-vectors/correlated/arrow-ipc-reopen 3385822 / 3841997 / -11.9% 🟢 11820322 / 13464445 / -12.2% 🟢 0.29 / 0.29 / +0.4%
random-access/feature-vectors/uniform/arrow-ipc-cached 53474808 / 55730672 / -4.0% 52247126 / 56673301 / -7.8% 1.02 / 0.98 / +4.1%
random-access/feature-vectors/uniform/arrow-ipc-reopen 57121768 / 56481371 / +1.1% 196747055 / 216168574 / -9.0% 0.29 / 0.26 / +11.1%
random-access/nested-lists/correlated/arrow-ipc-cached 63185 / 66247 / -4.6% 63679 / 71144 / -10.5% 🟢 0.99 / 0.93 / +6.6%
random-access/nested-lists/correlated/arrow-ipc-reopen 103600.5 / 107637 / -3.8% 3542654 / 3299156 / +7.4% 0.03 / 0.03 / -10.4%
random-access/nested-lists/uniform/arrow-ipc-cached 1212372 / 1244926 / -2.6% 1216154 / 1250833 / -2.8% 1.00 / 1.00 / +0.2%
random-access/nested-lists/uniform/arrow-ipc-reopen 1253920 / 1293812 / -3.1% 25019149 / 24125467 / +3.7% 0.05 / 0.05 / -6.5%
random-access/nested-structs/correlated/arrow-ipc-cached 51211 / 53076 / -3.5% 50008 / 52209 / -4.2% 1.02 / 1.02 / +0.7%
random-access/nested-structs/correlated/arrow-ipc-reopen 92503 / 98791 / -6.4% 2927808 / 3358217 / -12.8% 🟢 0.03 / 0.03 / +7.4%
random-access/nested-structs/uniform/arrow-ipc-cached 867313.5 / 879431.5 / -1.4% 876836 / 905668 / -3.2% 0.99 / 0.97 / +1.9%
random-access/nested-structs/uniform/arrow-ipc-reopen 936069 / 961672 / -2.7% 18420151 / 19051502 / -3.3% 0.05 / 0.05 / +0.7%
random-access/taxi/arrow-ipc-cached 68686 / 72473 / -5.2% 69645 / 77665 / -10.3% 🟢 0.99 / 0.93 / +5.7%
random-access/taxi/arrow-ipc-reopen 164386 / 171464 / -4.1% 3084866 / 2788886 / +10.6% 🔴 0.05 / 0.06 / -13.3%
random-access/taxi/correlated/arrow-ipc-cached 114415 / 122835 / -6.9% 115099 / 123329 / -6.7% 0.99 / 1.00 / -0.2%
random-access/taxi/correlated/arrow-ipc-reopen 217265 / 229610.5 / -5.4% 1634974 / 1597297 / +2.4% 0.13 / 0.14 / -7.6%
random-access/taxi/uniform/arrow-ipc-cached 2844182 / 2949938 / -3.6% 2842917 / 2957691 / -3.9% 1.00 / 1.00 / +0.3%
random-access/taxi/uniform/arrow-ipc-reopen 3017159 / 3019908 / -0.1% 35087905 / 35433222 / -1.0% 0.09 / 0.09 / +0.9%
random-access / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-cached 110907 / 108265 / +2.4% 110264 / 108445 / +1.7% 1.01 / 1.00 / +0.8%
random-access/feature-vectors/correlated/vortex-reopen 1903501 / 1911182 / -0.4% 4328226 / 4092026 / +5.8% 0.44 / 0.47 / -5.8%
random-access/feature-vectors/uniform/vortex-cached 1004366 / 983505.5 / +2.1% 1025866 / 993305 / +3.3% 0.98 / 0.99 / -1.1%
random-access/feature-vectors/uniform/vortex-reopen 3014443 / 2945180 / +2.4% 12567143 / 12508424 / +0.5% 0.24 / 0.24 / +1.9%
random-access/nested-lists/correlated/vortex-cached 95832 / 93970.5 / +2.0% 92616 / 99761 / -7.2% 1.03 / 0.94 / +9.8%
random-access/nested-lists/correlated/vortex-reopen 368776.5 / 368129 / +0.2% 2841857 / 2542752 / +11.8% 🔴 0.13 / 0.14 / -10.4%
random-access/nested-lists/uniform/vortex-cached 455306 / 437872.5 / +4.0% 490799 / 416158 / +17.9% 🔴 0.93 / 1.05 / -11.8%
random-access/nested-lists/uniform/vortex-reopen 985012 / 966787 / +1.9% 8461190 / 8153016 / +3.8% 0.12 / 0.12 / -1.8%
random-access/nested-structs/correlated/vortex-cached 123028 / 120247 / +2.3% 122348 / 123064 / -0.6% 1.01 / 0.98 / +2.9%
random-access/nested-structs/correlated/vortex-reopen 446220 / 444371 / +0.4% 3405487 / 4686633 / -27.3% 🟢 0.13 / 0.09 / +38.2%
random-access/nested-structs/uniform/vortex-cached 252268 / 244236 / +3.3% 253009 / 239151 / +5.8% 1.00 / 1.02 / -2.4%
random-access/nested-structs/uniform/vortex-reopen 641034 / 654771 / -2.1% 5190861 / 5249992 / -1.1% 0.12 / 0.12 / -1.0%
random-access/taxi/correlated/vortex-cached 291193 / 289924 / +0.4% 290547 / 286032 / +1.6% 1.00 / 1.01 / -1.1%
random-access/taxi/correlated/vortex-reopen 1248976 / 1216920 / +2.6% 2554678 / 2666145 / -4.2% 0.49 / 0.46 / +7.1%
random-access/taxi/uniform/vortex-cached 883321 / 872372 / +1.3% 881345 / 897005 / -1.7% 1.00 / 0.97 / +3.1%
random-access/taxi/uniform/vortex-reopen 3059421 / 3057112 / +0.1% 5867519 / 5844488 / +0.4% 0.52 / 0.52 / -0.3%
random-access/taxi/vortex-cached 244586.5 / 241820 / +1.1% 244840 / 236927 / +3.3% 1.00 / 1.02 / -2.1%
random-access/taxi/vortex-reopen 1024234 / 1030061 / -0.6% 3755353 / 3174217 / +18.3% 🔴 0.27 / 0.32 / -16.0%
random-access / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-cached 10234809 / 10200780 / +0.3% 10231471 / 10186434 / +0.4% 1.00 / 1.00 / -0.1%
random-access/feature-vectors/correlated/parquet-reopen 10436855 / 10512811 / -0.7% 18001914 / 18111157 / -0.6% 0.58 / 0.58 / -0.1%
random-access/feature-vectors/uniform/parquet-cached 135585636 / 132290418 / +2.5% 135282168 / 132237249 / +2.3% 1.00 / 1.00 / +0.2%
random-access/feature-vectors/uniform/parquet-reopen 136741689 / 132677464 / +3.1% 194340706 / 201585709 / -3.6% 0.70 / 0.66 / +6.9%
random-access/nested-lists/correlated/parquet-cached 4659972 / 4608386 / +1.1% 4659985 / 4611348 / +1.1% 1.00 / 1.00 / +0.1%
random-access/nested-lists/correlated/parquet-reopen 4713667 / 4703431 / +0.2% 11357482 / 11581253 / -1.9% 0.42 / 0.41 / +2.2%
random-access/nested-lists/uniform/parquet-cached 39114714 / 40778862 / -4.1% 39043638 / 41041239 / -4.9% 1.00 / 0.99 / +0.8%
random-access/nested-lists/uniform/parquet-reopen 40404797 / 40687906 / -0.7% 60578435 / 61731775 / -1.9% 0.67 / 0.66 / +1.2%
random-access/nested-structs/correlated/parquet-cached 9181788 / 9108724 / +0.8% 9168598 / 9130494 / +0.4% 1.00 / 1.00 / +0.4%
random-access/nested-structs/correlated/parquet-reopen 9265139 / 9296532 / -0.3% 22014630 / 21956609 / +0.3% 0.42 / 0.42 / -0.6%
random-access/nested-structs/uniform/parquet-cached 36907013 / 36877255 / +0.1% 37007724 / 37011339 / -0.0% 1.00 / 1.00 / +0.1%
random-access/nested-structs/uniform/parquet-reopen 36785453 / 36893150 / -0.3% 46666825 / 45446656 / +2.7% 0.79 / 0.81 / -2.9%
random-access/taxi/correlated/parquet-cached 23846285 / 23563383 / +1.2% 23956556 / 23655590 / +1.3% 1.00 / 1.00 / -0.1%
random-access/taxi/correlated/parquet-reopen 23724428 / 23801073 / -0.3% 27521072 / 27187819 / +1.2% 0.86 / 0.88 / -1.5%
random-access/taxi/parquet-cached 16952997 / 16479404 / +2.9% 16917943 / 16441519 / +2.9% 1.00 / 1.00 / -0.0%
random-access/taxi/parquet-reopen 16760243 / 16746238 / +0.1% 23524470 / 21931722 / +7.3% 0.71 / 0.76 / -6.7%
random-access/taxi/uniform/parquet-cached 37414904 / 37404963 / +0.0% 37643691 / 37540138 / +0.3% 0.99 / 1.00 / -0.2%
random-access/taxi/uniform/parquet-reopen 37918964 / 37741508 / +0.5% 41210703 / 41616972 / -1.0% 0.92 / 0.91 / +1.5%
random-access / lance / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/lance-cached 154901 / 154863 / +0.0% 155511 / 165222 / -5.9% 1.00 / 0.94 / +6.3%
random-access/feature-vectors/correlated/lance-reopen 985031 / 941866.5 / +4.6% 6686110 / 7045092 / -5.1% 0.15 / 0.13 / +10.2%
random-access/feature-vectors/uniform/lance-cached 1020452 / 1008030 / +1.2% 1010295 / 987281 / +2.3% 1.01 / 1.02 / -1.1%
random-access/feature-vectors/uniform/lance-reopen 1824031 / 1819259 / +0.3% 9263210 / 9331825 / -0.7% 0.20 / 0.19 / +1.0%
random-access/nested-lists/correlated/lance-cached 119272 / 114667 / +4.0% 111495 / 128426 / -13.2% 🟢 1.07 / 0.89 / +19.8%
random-access/nested-lists/correlated/lance-reopen 437127 / 439419.5 / -0.5% 5854609 / 6305363 / -7.1% 0.07 / 0.07 / +7.1%
random-access/nested-lists/uniform/lance-cached 844765 / 820077 / +3.0% 843318 / 851061 / -0.9% 1.00 / 0.96 / +4.0%
random-access/nested-lists/uniform/lance-reopen 1357289 / 1342286 / +1.1% 8878770 / 9389325 / -5.4% 0.15 / 0.14 / +6.9%
random-access/nested-structs/correlated/lance-cached 216220.5 / 210770 / +2.6% 211619 / 202773 / +4.4% 1.02 / 1.04 / -1.7%
random-access/nested-structs/correlated/lance-reopen 494601 / 486986 / +1.6% 5613236 / 6166144 / -9.0% 0.09 / 0.08 / +11.6%
random-access/nested-structs/uniform/lance-cached 2212290 / 2236689 / -1.1% 2246477 / 2250969 / -0.2% 0.98 / 0.99 / -0.9%
random-access/nested-structs/uniform/lance-reopen 2633668 / 2417946 / +8.9% 14460625 / 14460681 / -0.0% 0.18 / 0.17 / +8.9%
random-access/taxi/correlated/lance-cached 637398 / 635142.5 / +0.4% 623271 / 626316 / -0.5% 1.02 / 1.01 / +0.8%
random-access/taxi/correlated/lance-reopen 1633570 / 1645693 / -0.7% 2760603 / 2785448 / -0.9% 0.59 / 0.59 / +0.2%
random-access/taxi/lance-cached 437244 / 430177 / +1.6% 420258 / 421282 / -0.2% 1.04 / 1.02 / +1.9%
random-access/taxi/lance-reopen 1253892 / 1269028 / -1.2% 7216153 / 7597718 / -5.0% 0.17 / 0.17 / +4.0%
random-access/taxi/uniform/lance-cached 6845487 / 6644801 / +3.0% 6845107 / 6626675 / +3.3% 1.00 / 1.00 / -0.3%
random-access/taxi/uniform/lance-reopen 7958246 / 8041735 / -1.0% 25427896 / 25364852 / +0.2% 0.31 / 0.32 / -1.3%
random-access / litdata / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors/correlated/litdata-cached 734621 / 733552 / +0.1% 731135 / 732609 / -0.2% 1.00 / 1.00 / +0.3%
random-access/feature-vectors/correlated/litdata-reopen 3055149 / 3039462 / +0.5% 3786235 / 3746486 / +1.1% 0.81 / 0.81 / -0.5%
random-access/feature-vectors/uniform/litdata-cached 1113821 / 1065772 / +4.5% 1128014 / 1100876 / +2.5% 0.99 / 0.97 / +2.0%
random-access/feature-vectors/uniform/litdata-reopen 16139183 / 16072918 / +0.4% 31733231 / 34263369 / -7.4% 0.51 / 0.47 / +8.4%
random-access/nested-lists/correlated/litdata-cached 568854.5 / 580097 / -1.9% 568721 / 579196 / -1.8% 1.00 / 1.00 / -0.1%
random-access/nested-lists/correlated/litdata-reopen 17395622 / 17070412 / +1.9% 24174958 / 23829202 / +1.5% 0.72 / 0.72 / +0.4%
random-access/nested-lists/uniform/litdata-cached 601322 / 602759 / -0.2% 597549 / 604027 / -1.1% 1.01 / 1.00 / +0.8%
random-access/nested-lists/uniform/litdata-reopen 17032907 / 17182011 / -0.9% 24310568 / 24171160 / +0.6% 0.70 / 0.71 / -1.4%
random-access/nested-structs/correlated/litdata-cached 661154 / 667199 / -0.9% 669565 / 668659 / +0.1% 0.99 / 1.00 / -1.0%
random-access/nested-structs/correlated/litdata-reopen 18329200 / 18188112 / +0.8% 22078885 / 22150218 / -0.3% 0.83 / 0.82 / +1.1%
random-access/nested-structs/uniform/litdata-cached 719765 / 716329 / +0.5% 717350 / 715621 / +0.2% 1.00 / 1.00 / +0.2%
random-access/nested-structs/uniform/litdata-reopen 16072455 / 16134640 / -0.4% 25324424 / 25029360 / +1.2% 0.63 / 0.64 / -1.5%
random-access/taxi/correlated/litdata-cached 1194327 / 1155828 / +3.3% 1193896 / 1156250 / +3.3% 1.00 / 1.00 / +0.1%
random-access/taxi/correlated/litdata-reopen 20408167 / 20100802 / +1.5% 29855426 / 29291031 / +1.9% 0.68 / 0.69 / -0.4%
random-access/taxi/litdata-cached 81049 / 79883 / +1.5% 82857 / 84423 / -1.9% 0.98 / 0.95 / +3.4%
random-access/taxi/litdata-reopen 11447380 / 11160020 / +2.6% 14747675 / 14535183 / +1.5% 0.78 / 0.77 / +1.1%
random-access/taxi/uniform/litdata-cached 1300597 / 1293622 / +0.5% 1306151 / 1289420 / +1.3% 1.00 / 1.00 / -0.7%
random-access/taxi/uniform/litdata-reopen 67563635 / 68036174 / -0.7% 82763701 / 82642632 / +0.1% 0.82 / 0.82 / -0.8%

@joseph-isaacs joseph-isaacs added the action/bench-random-access Run only the random-access benchmark on this PR label Oct 12, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-random-access Run only the random-access benchmark on this PR label Oct 12, 2026
@joseph-isaacs joseph-isaacs added the action/bench-random-access Run only the random-access benchmark on this PR label Oct 13, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-random-access Run only the random-access benchmark on this PR label Oct 13, 2026
Comment thread vortex-array/src/patches.rs Resolved
Comment thread vortex-array/src/patches.rs Resolved

@robert3005 robert3005 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This does slightly regress scalar_at compared to the new api. Wonder if we should be more aggressive about moving people off it

A one-off read through `probe_patched` read compressed patch indices with a
fresh probe per comparison, which regressed `scalar_at` against the old
`get_patched` path, where one probe serves the whole search. One-off reads
now take `get_patched`; only repeated probes use the slot probes.

Slicing the primitive indices now returns an error for an out-of-range
patch range instead of panicking, as `Array::slice` did before.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Jck72aD351kMboqN5g8Ccs
…5sw7y

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Jck72aD351kMboqN5g8Ccs

Copy link
Copy Markdown
Contributor Author

CodSpeed Performance Analysis is red on 14779f5 with 2 regressions. Neither looks like this PR:

  • decode_primitives[i64, (1000, 32)] (Simulation, −33.8%): this decodes a dict-encoded primitive array, which goes through the primitive take kernel. That kernel never touches patches, RunEnd or the search code this PR changes, and the other 29 decode_primitives type/size cases are unchanged. I counted instructions locally with valgrind --tool=cachegrind for the whole decode_primitives group (all 30 cases, 50×50 iterations), two runs each:
    • develop 2664573: 794.09M / 794.07M instructions
    • this branch 14779f5: 796.42M / 796.41M instructions
    • That's +0.29% for the group, roughly 3–5× less than a 34% slowdown in one case would add, so I'm treating CodSpeed's figure as an artifact.
  • bitpack_blocked_compress_avx2 (WallTime, −10%): this encodes a primitive array and doesn't reach the changed code. Its avx512 variant improved 19% in the same run.

The earlier report on 47f468a also flagged the NEON bitpacking take/filter benchmarks. Those cleared once develop was merged in, because the branch had been compared against a newer develop it didn't yet contain.

Nothing to port here. The regressions need acknowledging in CodSpeed.


Generated by Claude Code

@robert3005 robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 13, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 13, 2026
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

This PR has been marked as stale because it has been open for 14 days with no activity. Please comment or remove the stale label if you wish to keep it active, otherwise it will be closed in 7 days

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 7080a70c vs base 31283ee1


vortex / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/strings/amazon/book_reviews/fsst 553956463 / 553616592 / +0.1% 553797043 / 553219862 / +0.1% 1.00 / 1.00 / -0.0%
compress time/strings/amazon/book_reviews/onpair-12 986044599 / 983883737 / +0.2% 986023917 / 984519274 / +0.2% 1.00 / 1.00 / +0.1%
compress time/strings/amazon/book_reviews/onpair-16 999073453 / 997178335 / +0.2% 998210306 / 997298810 / +0.1% 1.00 / 1.00 / +0.1%
compress time/strings/amazon/book_titles/fsst 57754738 / 57931543 / -0.3% 57810374 / 57930481 / -0.2% 1.00 / 1.00 / -0.1%
compress time/strings/amazon/book_titles/onpair-12 89587667 / 89556066 / +0.0% 89599588 / 89648805 / -0.1% 1.00 / 1.00 / +0.1%
compress time/strings/amazon/book_titles/onpair-16 92436487 / 92312963 / +0.1% 92480707 / 92293217 / +0.2% 1.00 / 1.00 / -0.1%
compress time/strings/clickbench/url/shard-0/fsst 427387770 / 426620014 / +0.2% 427379196 / 426923648 / +0.1% 1.00 / 1.00 / +0.1%
compress time/strings/clickbench/url/shard-0/onpair-12 603587358 / 603580851 / +0.0% 603825199 / 603421136 / +0.1% 1.00 / 1.00 / -0.1%
compress time/strings/clickbench/url/shard-0/onpair-16 609596237 / 611308917 / -0.3% 609546909 / 611292639 / -0.3% 1.00 / 1.00 / +0.0%
compress time/strings/fineweb/text/fsst 213211656 / 212982145 / +0.1% 213272465 / 212989653 / +0.1% 1.00 / 1.00 / -0.0%
compress time/strings/fineweb/text/onpair-12 512635927 / 511529929 / +0.2% 512885955 / 511708301 / +0.2% 1.00 / 1.00 / -0.0%
compress time/strings/fineweb/text/onpair-16 527092324 / 522996806 / +0.8% 527185091 / 522572151 / +0.9% 1.00 / 1.00 / -0.1%
compress time/strings/news/headlines/fsst 333278873 / 333764906 / -0.1% 333177612 / 333940452 / -0.2% 1.00 / 1.00 / +0.1%
compress time/strings/news/headlines/onpair-12 470667594 / 470205822 / +0.1% 470569498 / 470118486 / +0.1% 1.00 / 1.00 / +0.0%
compress time/strings/news/headlines/onpair-16 481876689 / 481775240 / +0.0% 482051038 / 481630437 / +0.1% 1.00 / 1.00 / -0.1%
compress time/strings/tpch/l_comment/fsst 1061204013 / 1066150407 / -0.5% 1061254420 / 1066594597 / -0.5% 1.00 / 1.00 / +0.0%
compress time/strings/tpch/l_comment/onpair-12 1039771932 / 1037906193 / +0.2% 1040285368 / 1037940051 / +0.2% 1.00 / 1.00 / -0.0%
compress time/strings/tpch/l_comment/onpair-16 1052259456 / 1050729524 / +0.1% 1052352336 / 1050913994 / +0.1% 1.00 / 1.00 / +0.0%
compress time/strings/twitter/sentiment140/fsst 555012793 / 556391011 / -0.2% 554877627 / 556373199 / -0.3% 1.00 / 1.00 / +0.0%
compress time/strings/twitter/sentiment140/onpair-12 953933641 / 951748359 / +0.2% 953756391 / 952643401 / +0.1% 1.00 / 1.00 / +0.1%
compress time/strings/twitter/sentiment140/onpair-16 1040540394 / 1039533457 / +0.1% 1040828129 / 1039385668 / +0.1% 1.00 / 1.00 / -0.0%
decompress time/strings/amazon/book_reviews/fsst 41500972 / 41514904 / -0.0% 41471833 / 41514746 / -0.1% 1.00 / 1.00 / +0.1%
decompress time/strings/amazon/book_reviews/onpair-12 30482944 / 30543424 / -0.2% 30519183 / 30596290 / -0.3% 1.00 / 1.00 / +0.1%
decompress time/strings/amazon/book_reviews/onpair-16 34028262 / 34020875 / +0.0% 34023352 / 34010977 / +0.0% 1.00 / 1.00 / -0.0%
decompress time/strings/amazon/book_titles/fsst 3433242 / 3436059 / -0.1% 3440504 / 3462011 / -0.6% 1.00 / 0.99 / +0.5%
decompress time/strings/amazon/book_titles/onpair-12 3126229 / 3133617 / -0.2% 3145064 / 3119946 / +0.8% 0.99 / 1.00 / -1.0%
decompress time/strings/amazon/book_titles/onpair-16 3027114 / 3019941 / +0.2% 2992123 / 3014728 / -0.7% 1.01 / 1.00 / +1.0%
decompress time/strings/clickbench/url/shard-0/fsst 31832508 / 31846475 / -0.0% 31835443 / 31798020 / +0.1% 1.00 / 1.00 / -0.2%
decompress time/strings/clickbench/url/shard-0/onpair-12 18827081 / 18864909 / -0.2% 18844677 / 18897845 / -0.3% 1.00 / 1.00 / +0.1%
decompress time/strings/clickbench/url/shard-0/onpair-16 18167825 / 18055624 / +0.6% 18173150 / 18026093 / +0.8% 1.00 / 1.00 / -0.2%
decompress time/strings/fineweb/text/fsst 10366542 / 10356516 / +0.1% 10350449 / 10360006 / -0.1% 1.00 / 1.00 / +0.2%
decompress time/strings/fineweb/text/onpair-12 9604733 / 9614037 / -0.1% 9508212 / 9570729 / -0.7% 1.01 / 1.00 / +0.6%
decompress time/strings/fineweb/text/onpair-16 8491954 / 8476757 / +0.2% 8503637 / 8499196 / +0.1% 1.00 / 1.00 / +0.1%
decompress time/strings/news/headlines/fsst 17763218 / 17755913 / +0.0% 17738405 / 17708965 / +0.2% 1.00 / 1.00 / -0.1%
decompress time/strings/news/headlines/onpair-12 16993047 / 17019619 / -0.2% 16997616 / 17052473 / -0.3% 1.00 / 1.00 / +0.2%
decompress time/strings/news/headlines/onpair-16 15990519 / 16025615 / -0.2% 15980809 / 16014572 / -0.2% 1.00 / 1.00 / -0.0%
decompress time/strings/tpch/l_comment/fsst 50977287 / 50792974 / +0.4% 50887919 / 50761531 / +0.2% 1.00 / 1.00 / +0.1%
decompress time/strings/tpch/l_comment/onpair-12 42687232 / 42594279 / +0.2% 42577366 / 42625984 / -0.1% 1.00 / 1.00 / +0.3%
decompress time/strings/tpch/l_comment/onpair-16 42437625 / 42386171 / +0.1% 42462741 / 42283634 / +0.4% 1.00 / 1.00 / -0.3%
decompress time/strings/twitter/sentiment140/fsst 36896656 / 37029476 / -0.4% 36959905 / 37043043 / -0.2% 1.00 / 1.00 / -0.1%
decompress time/strings/twitter/sentiment140/onpair-12 33891138 / 33790904 / +0.3% 33961984 / 33868625 / +0.3% 1.00 / 1.00 / +0.0%
decompress time/strings/twitter/sentiment140/onpair-16 33766620 / 33812148 / -0.1% 33740357 / 34062941 / -0.9% 1.00 / 0.99 / +0.8%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/strings/amazon/book_reviews/fsst 66249788 / 66249788 / +0.0%
vortex-file-compressed size/strings/amazon/book_reviews/onpair-12 48618844 / 48618844 / +0.0%
vortex-file-compressed size/strings/amazon/book_reviews/onpair-16 48243532 / 48243532 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/fsst 5434916 / 5434916 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/onpair-12 4765620 / 4765620 / +0.0%
vortex-file-compressed size/strings/amazon/book_titles/onpair-16 4892932 / 4892932 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/fsst 49403932 / 49403932 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/onpair-12 29634060 / 29634060 / +0.0%
vortex-file-compressed size/strings/clickbench/url/shard-0/onpair-16 30002068 / 30002068 / +0.0%
vortex-file-compressed size/strings/fineweb/text/fsst 17098836 / 17098836 / +0.0%
vortex-file-compressed size/strings/fineweb/text/onpair-12 13554932 / 13554932 / +0.0%
vortex-file-compressed size/strings/fineweb/text/onpair-16 12265644 / 12265644 / +0.0%
vortex-file-compressed size/strings/news/headlines/fsst 30686308 / 30686308 / +0.0%
vortex-file-compressed size/strings/news/headlines/onpair-12 26439252 / 26439252 / +0.0%
vortex-file-compressed size/strings/news/headlines/onpair-16 26916196 / 26916196 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/fsst 75050292 / 75050292 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/onpair-12 57417388 / 57417388 / +0.0%
vortex-file-compressed size/strings/tpch/l_comment/onpair-16 57453556 / 57453556 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/fsst 63507044 / 63507044 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/onpair-12 54111996 / 54111996 / +0.0%
vortex-file-compressed size/strings/twitter/sentiment140/onpair-16 56477060 / 56477060 / +0.0%

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-DS SF=10 on NVME (pr-all) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-DS SF=1 on NVME (pr-all) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark JOB on NVME (pr-all) failed! Check the workflow run for details.

…5sw7y

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Jck72aD351kMboqN5g8Ccs
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 7080a70c vs base 31283ee1
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.3%
Engines: DataFusion No clear signal (+2.9%, environment too noisy confidence) · DuckDB No clear signal (+1.6%, environment too noisy confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.984x ➖
Parquet (geomean): hot 0.980x ➖ · cold 0.972x ➖
Shifts: Parquet (control) -2.0% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 211572028 / 221699008 / -4.6% 840734174 / 783789004 / +7.3% 0.25 / 0.28 / -11.0%
tpch_q02/datafusion:vortex-file-compressed 306114873 / 322839870 / -5.2% 663347156 / 743028319 / -10.7% 0.46 / 0.43 / +6.2%
tpch_q03/datafusion:vortex-file-compressed 339994763 / 329934190 / +3.0% 957730526 / 785057561 / +22.0% 0.36 / 0.42 / -15.5%
tpch_q04/datafusion:vortex-file-compressed 185961363 / 200427149 / -7.2% 399920142 / 411691781 / -2.9% 0.46 / 0.49 / -4.5%
tpch_q05/datafusion:vortex-file-compressed 342556762 / 356308799 / -3.9% 533572950 / 661671905 / -19.4% 0.64 / 0.54 / +19.2%
tpch_q06/datafusion:vortex-file-compressed 147284548 / 135907834 / +8.4% 307409268 / 295553255 / +4.0% 0.48 / 0.46 / +4.2%
tpch_q07/datafusion:vortex-file-compressed 428719417 / 495366960 / -13.5% 622208794 / 619315846 / +0.5% 0.69 / 0.80 / -13.9%
tpch_q08/datafusion:vortex-file-compressed 415467049 / 419832013 / -1.0% 603467058 / 894037968 / -32.5% 🟢 0.69 / 0.47 / +46.6%
tpch_q09/datafusion:vortex-file-compressed 335022754 / 316670412 / +5.8% 480206962 / 486103749 / -1.2% 0.70 / 0.65 / +7.1%
tpch_q10/datafusion:vortex-file-compressed 386263291 / 442254565 / -12.7% 532420846 / 521901475 / +2.0% 0.73 / 0.85 / -14.4%
tpch_q11/datafusion:vortex-file-compressed 278338263 / 278669624 / -0.1% 417362770 / 512351072 / -18.5% 0.67 / 0.54 / +22.6%
tpch_q12/datafusion:vortex-file-compressed 202786170 / 198809452 / +2.0% 478768193 / 450115453 / +6.4% 0.42 / 0.44 / -4.1%
tpch_q13/datafusion:vortex-file-compressed 111773869 / 131323390 / -14.9% 333272722 / 511421758 / -34.8% 🟢 0.34 / 0.26 / +30.6%
tpch_q14/datafusion:vortex-file-compressed 189046331 / 185606969 / +1.9% 332192920 / 608363569 / -45.4% 🟢 0.57 / 0.31 / +86.5%
tpch_q15/datafusion:vortex-file-compressed 306910001 / 320540525 / -4.3% 482911171 / 568115278 / -15.0% 0.64 / 0.56 / +12.6%
tpch_q16/datafusion:vortex-file-compressed 135544353 / 144288698 / -6.1% 274954078 / 296242329 / -7.2% 0.49 / 0.49 / +1.2%
tpch_q17/datafusion:vortex-file-compressed 275518155 / 262215980 / +5.1% 431467475 / 430454804 / +0.2% 0.64 / 0.61 / +4.8%
tpch_q18/datafusion:vortex-file-compressed 236739045 / 258851570 / -8.5% 405565213 / 492027733 / -17.6% 0.58 / 0.53 / +11.0%
tpch_q19/datafusion:vortex-file-compressed 395051947 / 259997099 / +51.9% 🔴 514459697 / 447742845 / +14.9% 0.77 / 0.58 / +32.2%
tpch_q20/datafusion:vortex-file-compressed 273112041 / 283442290 / -3.6% 436866242 / 518820798 / -15.8% 0.63 / 0.55 / +14.4%
tpch_q21/datafusion:vortex-file-compressed 422967037 / 405515462 / +4.3% 646531040 / 666817638 / -3.0% 0.65 / 0.61 / +7.6%
tpch_q22/datafusion:vortex-file-compressed 155709811 / 141580019 / +10.0% 373396788 / 361525535 / +3.3% 0.42 / 0.39 / +6.5%
datafusion / vortex-compact / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 226007692 / 233937918 / -3.4% 649354412 / 710719999 / -8.6% 0.35 / 0.33 / +5.7%
tpch_q02/datafusion:vortex-compact 323100557 / 312600155 / +3.4% 660952881 / 620389505 / +6.5% 0.49 / 0.50 / -3.0%
tpch_q03/datafusion:vortex-compact 293561835 / 310802839 / -5.5% 683522006 / 659474532 / +3.6% 0.43 / 0.47 / -8.9%
tpch_q04/datafusion:vortex-compact 163678826 / 214554084 / -23.7% 473567576 / 380488983 / +24.5% 0.35 / 0.56 / -38.7%
tpch_q05/datafusion:vortex-compact 350576599 / 377136963 / -7.0% 488782858 / 696381450 / -29.8% 0.72 / 0.54 / +32.4%
tpch_q06/datafusion:vortex-compact 142699208 / 131817603 / +8.3% 261380925 / 279295967 / -6.4% 0.55 / 0.47 / +15.7%
tpch_q07/datafusion:vortex-compact 387725376 / 404734278 / -4.2% 558777286 / 570698807 / -2.1% 0.69 / 0.71 / -2.2%
tpch_q08/datafusion:vortex-compact 403771440 / 404355656 / -0.1% 889673939 / 715961750 / +24.3% 0.45 / 0.56 / -19.6%
tpch_q09/datafusion:vortex-compact 322324116 / 329581246 / -2.2% 521796896 / 512881051 / +1.7% 0.62 / 0.64 / -3.9%
tpch_q10/datafusion:vortex-compact 334678561 / 326869143 / +2.4% 478825097 / 519857287 / -7.9% 0.70 / 0.63 / +11.2%
tpch_q11/datafusion:vortex-compact 316746021 / 269050275 / +17.7% 512938861 / 423893071 / +21.0% 0.62 / 0.63 / -2.7%
tpch_q12/datafusion:vortex-compact 177031062 / 156704596 / +13.0% 353868062 / 337243602 / +4.9% 0.50 / 0.46 / +7.7%
tpch_q13/datafusion:vortex-compact 111951574 / 117080563 / -4.4% 283689895 / 493141435 / -42.5% 🟢 0.39 / 0.24 / +66.2%
tpch_q14/datafusion:vortex-compact 185081631 / 190727189 / -3.0% 339609294 / 352882038 / -3.8% 0.54 / 0.54 / +0.8%
tpch_q15/datafusion:vortex-compact 302079773 / 305683027 / -1.2% 787583095 / 700528682 / +12.4% 0.38 / 0.44 / -12.1%
tpch_q16/datafusion:vortex-compact 128069577 / 120215002 / +6.5% 289966458 / 279056824 / +3.9% 0.44 / 0.43 / +2.5%
tpch_q17/datafusion:vortex-compact 289600156 / 275777398 / +5.0% 461492489 / 451451716 / +2.2% 0.63 / 0.61 / +2.7%
tpch_q18/datafusion:vortex-compact 268240661 / 258469738 / +3.8% 624639238 / 538739029 / +15.9% 0.43 / 0.48 / -10.5%
tpch_q19/datafusion:vortex-compact 273881903 / 245833808 / +11.4% 642460065 / 366491796 / +75.3% 🔴 0.43 / 0.67 / -36.4%
tpch_q20/datafusion:vortex-compact 315880741 / 243079958 / +29.9% 839862439 / 435506901 / +92.8% 🔴 0.38 / 0.56 / -32.6%
tpch_q21/datafusion:vortex-compact 405297840 / 398718582 / +1.7% 608037536 / 627032073 / -3.0% 0.67 / 0.64 / +4.8%
tpch_q22/datafusion:vortex-compact 161516526 / 174532037 / -7.5% 339072921 / 360084096 / -5.8% 0.48 / 0.48 / -1.7%
datafusion / parquet / ns (0.976x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 142839566 / 160624476 / -11.1% 419537840 / 568643988 / -26.2% 0.34 / 0.28 / +20.5%
tpch_q02/datafusion:parquet 282731586 / 287240381 / -1.6% 475658980 / 524886142 / -9.4% 0.59 / 0.55 / +8.6%
tpch_q03/datafusion:parquet 228044978 / 235138367 / -3.0% 660488815 / 607145344 / +8.8% 0.35 / 0.39 / -10.8%
tpch_q04/datafusion:parquet 135983321 / 134131477 / +1.4% 363175447 / 312553284 / +16.2% 0.37 / 0.43 / -12.8%
tpch_q05/datafusion:parquet 317303054 / 354947862 / -10.6% 456672987 / 516555729 / -11.6% 0.69 / 0.69 / +1.1%
tpch_q06/datafusion:parquet 153942841 / 120999587 / +27.2% 449790071 / 461448131 / -2.5% 0.34 / 0.26 / +30.5%
tpch_q07/datafusion:parquet 373468579 / 327967008 / +13.9% 541049879 / 554730284 / -2.5% 0.69 / 0.59 / +16.8%
tpch_q08/datafusion:parquet 423823231 / 418703031 / +1.2% 583237895 / 560340334 / +4.1% 0.73 / 0.75 / -2.8%
tpch_q09/datafusion:parquet 384826431 / 407556099 / -5.6% 499798836 / 545349847 / -8.4% 0.77 / 0.75 / +3.0%
tpch_q10/datafusion:parquet 313880462 / 316423196 / -0.8% 435492534 / 487346706 / -10.6% 0.72 / 0.65 / +11.0%
tpch_q11/datafusion:parquet 251997105 / 254169199 / -0.9% 380362357 / 371492173 / +2.4% 0.66 / 0.68 / -3.2%
tpch_q12/datafusion:parquet 168600580 / 172806521 / -2.4% 320282884 / 308649724 / +3.8% 0.53 / 0.56 / -6.0%
tpch_q13/datafusion:parquet 273594745 / 272837433 / +0.3% 446548184 / 406285476 / +9.9% 0.61 / 0.67 / -8.8%
tpch_q14/datafusion:parquet 146085993 / 150798525 / -3.1% 301633004 / 281226040 / +7.3% 0.48 / 0.54 / -9.7%
tpch_q15/datafusion:parquet 303220472 / 357385135 / -15.2% 447024086 / 477437218 / -6.4% 0.68 / 0.75 / -9.4%
tpch_q16/datafusion:parquet 100438405 / 99671014 / +0.8% 202230257 / 213154682 / -5.1% 0.50 / 0.47 / +6.2%
tpch_q17/datafusion:parquet 263019698 / 289149064 / -9.0% 416962199 / 460533351 / -9.5% 0.63 / 0.63 / +0.5%
tpch_q18/datafusion:parquet 308267736 / 347263592 / -11.2% 451462507 / 515173330 / -12.4% 0.68 / 0.67 / +1.3%
tpch_q19/datafusion:parquet 160413539 / 174172419 / -7.9% 289316735 / 289178120 / +0.0% 0.55 / 0.60 / -7.9%
tpch_q20/datafusion:parquet 227588452 / 235001041 / -3.2% 421249290 / 372531726 / +13.1% 0.54 / 0.63 / -14.4%
tpch_q21/datafusion:parquet 282786065 / 313681404 / -9.8% 535883860 / 519237581 / +3.2% 0.53 / 0.60 / -12.6%
tpch_q22/datafusion:parquet 155769190 / 146107455 / +6.6% 357846506 / 311935741 / +14.7% 0.44 / 0.47 / -7.1%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 250353203 / 284647992 / -12.0% 310417048 / 340790301 / -8.9% 0.81 / 0.84 / -3.4%
tpch_q02/duckdb:vortex-file-compressed 391875789 / 392794406 / -0.2% 484390791 / 519279474 / -6.7% 0.81 / 0.76 / +7.0%
tpch_q03/duckdb:vortex-file-compressed 409513997 / 403284319 / +1.5% 428861689 / 467091172 / -8.2% 0.95 / 0.86 / +10.6%
tpch_q04/duckdb:vortex-file-compressed 346199015 / 269192887 / +28.6% 397443674 / 309522033 / +28.4% 0.87 / 0.87 / +0.2%
tpch_q05/duckdb:vortex-file-compressed 512962514 / 525745053 / -2.4% 577243711 / 616748554 / -6.4% 0.89 / 0.85 / +4.2%
tpch_q06/duckdb:vortex-file-compressed 167031166 / 164259398 / +1.7% 253989479 / 221081881 / +14.9% 0.66 / 0.74 / -11.5%
tpch_q07/duckdb:vortex-file-compressed 395428929 / 419135601 / -5.7% 500019193 / 481952739 / +3.7% 0.79 / 0.87 / -9.1%
tpch_q08/duckdb:vortex-file-compressed 566204869 / 605998456 / -6.6% 608077315 / 871694159 / -30.2% 🟢 0.93 / 0.70 / +33.9%
tpch_q09/duckdb:vortex-file-compressed 404164289 / 399963462 / +1.1% 459550138 / 450088673 / +2.1% 0.88 / 0.89 / -1.0%
tpch_q10/duckdb:vortex-file-compressed 518457829 / 534495965 / -3.0% 553291842 / 588639144 / -6.0% 0.94 / 0.91 / +3.2%
tpch_q11/duckdb:vortex-file-compressed 271009726 / 271931264 / -0.3% 274858354 / 342652577 / -19.8% 0.99 / 0.79 / +24.2%
tpch_q12/duckdb:vortex-file-compressed 232659400 / 231036133 / +0.7% 359399136 / 310796568 / +15.6% 0.65 / 0.74 / -12.9%
tpch_q13/duckdb:vortex-file-compressed 213384343 / 202448760 / +5.4% 258946223 / 331991168 / -22.0% 0.82 / 0.61 / +35.1%
tpch_q14/duckdb:vortex-file-compressed 227032207 / 222201455 / +2.2% 285680951 / 307261804 / -7.0% 0.79 / 0.72 / +9.9%
tpch_q15/duckdb:vortex-file-compressed 235566268 / 240762122 / -2.2% 296710811 / 288413084 / +2.9% 0.79 / 0.83 / -4.9%
tpch_q16/duckdb:vortex-file-compressed 198923030 / 202838482 / -1.9% 307639267 / 260086354 / +18.3% 0.65 / 0.78 / -17.1%
tpch_q17/duckdb:vortex-file-compressed 324952105 / 293631639 / +10.7% 605087930 / 313420481 / +93.1% 🔴 0.54 / 0.94 / -42.7%
tpch_q18/duckdb:vortex-file-compressed 350752002 / 363186705 / -3.4% 330214251 / 358837804 / -8.0% 1.06 / 1.01 / +4.9%
tpch_q19/duckdb:vortex-file-compressed 271472383 / 309707186 / -12.3% 377433445 / 358796133 / +5.2% 0.72 / 0.86 / -16.7%
tpch_q20/duckdb:vortex-file-compressed 391390065 / 340835824 / +14.8% 389627005 / 423421038 / -8.0% 1.00 / 0.80 / +24.8%
tpch_q21/duckdb:vortex-file-compressed 563797942 / 552185565 / +2.1% 548740528 / 637864303 / -14.0% 1.03 / 0.87 / +18.7%
tpch_q22/duckdb:vortex-file-compressed 247108001 / 251343298 / -1.7% 268648113 / 280170514 / -4.1% 0.92 / 0.90 / +2.5%
duckdb / vortex-compact / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 257546948 / 246679306 / +4.4% 207545703 / 278784203 / -25.6% 1.24 / 0.88 / +40.2%
tpch_q02/duckdb:vortex-compact 409375741 / 399227982 / +2.5% 498797970 / 484475165 / +3.0% 0.82 / 0.82 / -0.4%
tpch_q03/duckdb:vortex-compact 365005277 / 376282513 / -3.0% 414764630 / 391435833 / +6.0% 0.88 / 0.96 / -8.5%
tpch_q04/duckdb:vortex-compact 242903391 / 210264090 / +15.5% 251689951 / 280658472 / -10.3% 0.97 / 0.75 / +28.8%
tpch_q05/duckdb:vortex-compact 477664881 / 489130647 / -2.3% 570953100 / 598237106 / -4.6% 0.84 / 0.82 / +2.3%
tpch_q06/duckdb:vortex-compact 175358826 / 146517630 / +19.7% 216838010 / 169254320 / +28.1% 0.81 / 0.87 / -6.6%
tpch_q07/duckdb:vortex-compact 379036341 / 381331305 / -0.6% 469796388 / 534761047 / -12.1% 0.81 / 0.71 / +13.1%
tpch_q08/duckdb:vortex-compact 509117299 / 577924336 / -11.9% 693511993 / 610750674 / +13.6% 0.73 / 0.95 / -22.4%
tpch_q09/duckdb:vortex-compact 394619855 / 407780317 / -3.2% 476632040 / 459808979 / +3.7% 0.83 / 0.89 / -6.6%
tpch_q10/duckdb:vortex-compact 474512557 / 478815514 / -0.9% 594264591 / 564418150 / +5.3% 0.80 / 0.85 / -5.9%
tpch_q11/duckdb:vortex-compact 267459542 / 296783967 / -9.9% 293468522 / 303615988 / -3.3% 0.91 / 0.98 / -6.8%
tpch_q12/duckdb:vortex-compact 190187270 / 197989986 / -3.9% 255825953 / 238072081 / +7.5% 0.74 / 0.83 / -10.6%
tpch_q13/duckdb:vortex-compact 194993010 / 203257489 / -4.1% 264054459 / 214753132 / +23.0% 0.74 / 0.95 / -22.0%
tpch_q14/duckdb:vortex-compact 214422218 / 228696525 / -6.2% 286248549 / 321689405 / -11.0% 0.75 / 0.71 / +5.4%
tpch_q15/duckdb:vortex-compact 250458441 / 233011236 / +7.5% 283034551 / 302499907 / -6.4% 0.88 / 0.77 / +14.9%
tpch_q16/duckdb:vortex-compact 193721767 / 179371826 / +8.0% 258821487 / 274902440 / -5.8% 0.75 / 0.65 / +14.7%
tpch_q17/duckdb:vortex-compact 285617170 / 317065093 / -9.9% 318657409 / 370422834 / -14.0% 0.90 / 0.86 / +4.7%
tpch_q18/duckdb:vortex-compact 323414057 / 306220377 / +5.6% 370075558 / 395629064 / -6.5% 0.87 / 0.77 / +12.9%
tpch_q19/duckdb:vortex-compact 302201114 / 292810632 / +3.2% 333994503 / 341801410 / -2.3% 0.90 / 0.86 / +5.6%
tpch_q20/duckdb:vortex-compact 307617830 / 334679591 / -8.1% 444055406 / 399804453 / +11.1% 0.69 / 0.84 / -17.2%
tpch_q21/duckdb:vortex-compact 486685148 / 487569441 / -0.2% 580797750 / 576278855 / +0.8% 0.84 / 0.85 / -1.0%
tpch_q22/duckdb:vortex-compact 233030231 / 243059237 / -4.1% 276618652 / 299655089 / -7.7% 0.84 / 0.81 / +3.9%
duckdb / parquet / ns (0.984x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 159276144 / 164663710 / -3.3% 212672011 / 211348899 / +0.6% 0.75 / 0.78 / -3.9%
tpch_q02/duckdb:parquet 400778830 / 413981967 / -3.2% 411023899 / 534615565 / -23.1% 0.98 / 0.77 / +25.9%
tpch_q03/duckdb:parquet 467557111 / 336224589 / +39.1% 🔴 394955716 / 431252060 / -8.4% 1.18 / 0.78 / +51.8%
tpch_q04/duckdb:parquet 246096772 / 268671575 / -8.4% 292818312 / 362780464 / -19.3% 0.84 / 0.74 / +13.5%
tpch_q05/duckdb:parquet 508154140 / 504370411 / +0.8% 556090151 / 542978343 / +2.4% 0.91 / 0.93 / -1.6%
tpch_q06/duckdb:parquet 126509448 / 148042337 / -14.5% 163859227 / 179818617 / -8.9% 0.77 / 0.82 / -6.2%
tpch_q07/duckdb:parquet 437608874 / 413753381 / +5.8% 492113100 / 458459366 / +7.3% 0.89 / 0.90 / -1.5%
tpch_q08/duckdb:parquet 533896947 / 632082467 / -15.5% 597614845 / 656460448 / -9.0% 0.89 / 0.96 / -7.2%
tpch_q09/duckdb:parquet 529539756 / 502565154 / +5.4% 570640424 / 554912884 / +2.8% 0.93 / 0.91 / +2.5%
tpch_q10/duckdb:parquet 584307950 / 594785918 / -1.8% 580519953 / 649139222 / -10.6% 1.01 / 0.92 / +9.9%
tpch_q11/duckdb:parquet 299602976 / 305129510 / -1.8% 329491756 / 308925439 / +6.7% 0.91 / 0.99 / -7.9%
tpch_q12/duckdb:parquet 233363912 / 229076237 / +1.9% 283492084 / 305455361 / -7.2% 0.82 / 0.75 / +9.8%
tpch_q13/duckdb:parquet 378422256 / 352532243 / +7.3% 461072980 / 432744560 / +6.5% 0.82 / 0.81 / +0.7%
tpch_q14/duckdb:parquet 238574186 / 304402498 / -21.6% 329504061 / 377797217 / -12.8% 0.72 / 0.81 / -10.1%
tpch_q15/duckdb:parquet 217977271 / 232722554 / -6.3% 242667672 / 286740928 / -15.4% 0.90 / 0.81 / +10.7%
tpch_q16/duckdb:parquet 313756528 / 243960891 / +28.6% 322761201 / 258977232 / +24.6% 0.97 / 0.94 / +3.2%
tpch_q17/duckdb:parquet 288399405 / 301814145 / -4.4% 356770120 / 322724620 / +10.5% 0.81 / 0.94 / -13.6%
tpch_q18/duckdb:parquet 301866017 / 373329888 / -19.1% 351421691 / 365305977 / -3.8% 0.86 / 1.02 / -15.9%
tpch_q19/duckdb:parquet 230075563 / 257101424 / -10.5% 310458378 / 325756778 / -4.7% 0.74 / 0.79 / -6.1%
tpch_q20/duckdb:parquet 441340657 / 417866255 / +5.6% 447534262 / 426472394 / +4.9% 0.99 / 0.98 / +0.6%
tpch_q21/duckdb:parquet 432314953 / 415000211 / +4.2% 403573116 / 466512641 / -13.5% 1.07 / 0.89 / +20.4%
tpch_q22/duckdb:parquet 281808718 / 293387717 / -3.9% 273639263 / 292515709 / -6.5% 1.03 / 1.00 / +2.7%

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark FineWeb NVMe (pr-all) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Nested TPC-H SF=1 on NVME (pr-all) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Vortex queries (pr-all) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Clickbench on NVME (pr-all) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark Appian on NVME (pr-all) failed! Check the workflow run for details.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access (S3) 📖

Commits: PR 7080a70c vs base 31283ee1
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.8%
Engines: random-access No clear signal (-1.8%, environment too noisy confidence)
Vortex (geomean): hot 1.024x ➖ · cold 1.058x ➖
Parquet (geomean): hot 1.042x ➖ · cold 1.029x ➖
Shifts: Parquet (control) +4.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors-s3/correlated/vortex-cached 104237 / 109162 / -4.5% 100978 / 108303 / -6.8% 1.03 / 1.01 / +2.4%
random-access/feature-vectors-s3/correlated/vortex-reopen 125895578 / 128817700 / -2.3% 347309587 / 322515216 / +7.7% 0.36 / 0.40 / -9.2%
random-access/feature-vectors-s3/uniform/vortex-cached 43276510 / 47787985 / -9.4% 61674775 / 46437506 / +32.8% 🔴 0.70 / 1.03 / -31.8%
random-access/feature-vectors-s3/uniform/vortex-reopen 306212257 / 175661501 / +74.3% 🔴 388686493 / 314139022 / +23.7% 0.79 / 0.56 / +40.9%
random-access/nested-lists-s3/correlated/vortex-cached 95332 / 97229 / -2.0% 98708 / 96209 / +2.6% 0.97 / 1.01 / -4.4%
random-access/nested-lists-s3/correlated/vortex-reopen 76336698 / 78520351 / -2.8% 182687676 / 180091574 / +1.4% 0.42 / 0.44 / -4.2%
random-access/nested-lists-s3/uniform/vortex-cached 40310118 / 36835895 / +9.4% 69064824 / 41395021 / +66.8% 🔴 0.58 / 0.89 / -34.4%
random-access/nested-lists-s3/uniform/vortex-reopen 110332830 / 128741940 / -14.3% 161458887 / 154227131 / +4.7% 0.68 / 0.83 / -18.1%
random-access/nested-structs-s3/correlated/vortex-cached 120954 / 122244.5 / -1.1% 120125 / 115915 / +3.6% 1.01 / 1.05 / -4.5%
random-access/nested-structs-s3/correlated/vortex-reopen 88076714 / 87513920 / +0.6% 143171097 / 136063433 / +5.2% 0.62 / 0.64 / -4.4%
random-access/nested-structs-s3/uniform/vortex-cached 248272.5 / 252011 / -1.5% 261770 / 260542 / +0.5% 0.95 / 0.97 / -1.9%
random-access/nested-structs-s3/uniform/vortex-reopen 95444803 / 91300012 / +4.5% 113279437 / 146594762 / -22.7% 0.84 / 0.62 / +35.3%
random-access/taxi-s3/correlated/vortex-cached 282059 / 285516 / -1.2% 279044 / 287937 / -3.1% 1.01 / 0.99 / +1.9%
random-access/taxi-s3/correlated/vortex-reopen 121150649 / 123681184 / -2.0% 137074754 / 143423270 / -4.4% 0.88 / 0.86 / +2.5%
random-access/taxi-s3/uniform/vortex-cached 881806.5 / 882869 / -0.1% 874346 / 924092 / -5.4% 1.01 / 0.96 / +5.6%
random-access/taxi-s3/uniform/vortex-reopen 151161793 / 132822222 / +13.8% 223607826 / 177837479 / +25.7% 0.68 / 0.75 / -9.5%
random-access/taxi-s3/vortex-cached 245244.5 / 243817 / +0.6% 241520 / 233380 / +3.5% 1.02 / 1.04 / -2.8%
random-access/taxi-s3/vortex-reopen 113818085 / 111838858 / +1.8% 148063755 / 156621096 / -5.5% 0.77 / 0.71 / +7.7%
random-access / parquet / ns (1.042x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors-s3/correlated/parquet-cached 48623974 / 50971928 / -4.6% 44643942 / 44086766 / +1.3% 1.09 / 1.16 / -5.8%
random-access/feature-vectors-s3/correlated/parquet-reopen 121398391 / 146034844 / -16.9% 160132527 / 161585861 / -0.9% 0.76 / 0.90 / -16.1%
random-access/feature-vectors-s3/uniform/parquet-cached 720789454 / 516097057 / +39.7% 🔴 1007331843 / 794104324 / +26.9% 0.72 / 0.65 / +10.1%
random-access/feature-vectors-s3/uniform/parquet-reopen 605611641 / 588465802 / +2.9% 705563987 / 654023194 / +7.9% 0.86 / 0.90 / -4.6%
random-access/nested-lists-s3/correlated/parquet-cached 42082018 / 45140282 / -6.8% 38321816 / 116828912 / -67.2% 🟢 1.10 / 0.39 / +184.2%
random-access/nested-lists-s3/correlated/parquet-reopen 113695326 / 120337686 / -5.5% 212212735 / 163919811 / +29.5% 0.54 / 0.73 / -27.0%
random-access/nested-lists-s3/uniform/parquet-cached 174657348 / 176349633 / -1.0% 202560555 / 173579483 / +16.7% 0.86 / 1.02 / -15.1%
random-access/nested-lists-s3/uniform/parquet-reopen 251750309 / 254147006 / -0.9% 273476755 / 266438303 / +2.6% 0.92 / 0.95 / -3.5%
random-access/nested-structs-s3/correlated/parquet-cached 52550199 / 55312118 / -5.0% 51745535 / 51080145 / +1.3% 1.02 / 1.08 / -6.2%
random-access/nested-structs-s3/correlated/parquet-reopen 198651815 / 131109836 / +51.5% 🔴 368967107 / 174525466 / +111.4% 🔴 0.54 / 0.75 / -28.3%
random-access/nested-structs-s3/uniform/parquet-cached 443168348 / 445178033 / -0.5% 443044577 / 446138586 / -0.7% 1.00 / 1.00 / +0.2%
random-access/nested-structs-s3/uniform/parquet-reopen 534634746 / 511266161 / +4.6% 644768528 / 536728595 / +20.1% 0.83 / 0.95 / -13.0%
random-access/taxi-s3/correlated/parquet-cached 200308750 / 204907420 / -2.2% 209651944 / 200475649 / +4.6% 0.96 / 1.02 / -6.5%
random-access/taxi-s3/correlated/parquet-reopen 258348236 / 249940635 / +3.4% 266561730 / 292796732 / -9.0% 0.97 / 0.85 / +13.5%
random-access/taxi-s3/parquet-cached 284259834 / 193393823 / +47.0% 🔴 209126167 / 200336322 / +4.4% 1.36 / 0.97 / +40.8%
random-access/taxi-s3/parquet-reopen 239235606 / 243599631 / -1.8% 245763137 / 244228299 / +0.6% 0.97 / 1.00 / -2.4%
random-access/taxi-s3/uniform/parquet-cached 215315716 / 216691998 / -0.6% 218185305 / 222945097 / -2.1% 0.99 / 0.97 / +1.5%
random-access/taxi-s3/uniform/parquet-reopen 264983576 / 268350223 / -1.3% 253664793 / 263116050 / -3.6% 1.04 / 1.02 / +2.4%
random-access / lance / ns (1.032x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
random-access/feature-vectors-s3/correlated/lance-cached 33607456 / 36829131 / -8.7% 31999472 / 30668024 / +4.3% 1.05 / 1.20 / -12.5%
random-access/feature-vectors-s3/correlated/lance-reopen 195779847 / 192515993 / +1.7% 190045892 / 200508231 / -5.2% 1.03 / 0.96 / +7.3%
random-access/feature-vectors-s3/uniform/lance-cached 69992789 / 75786589 / -7.6% 78251785 / 60279304 / +29.8% 0.89 / 1.26 / -28.9%
random-access/feature-vectors-s3/uniform/lance-reopen 224581590 / 238060475 / -5.7% 251052730 / 295726165 / -15.1% 0.89 / 0.81 / +11.1%
random-access/nested-lists-s3/correlated/lance-cached 30833723 / 32148420 / -4.1% 42031509 / 37280453 / +12.7% 0.73 / 0.86 / -14.9%
random-access/nested-lists-s3/correlated/lance-reopen 219354732 / 229556955 / -4.4% 284958759 / 356157972 / -20.0% 0.77 / 0.64 / +19.4%
random-access/nested-lists-s3/uniform/lance-cached 85582224 / 63594901 / +34.6% 🔴 170853677 / 55573024 / +207.4% 🔴 0.50 / 1.14 / -56.2%
random-access/nested-lists-s3/uniform/lance-reopen 256620678 / 267903352 / -4.2% 281798173 / 334537096 / -15.8% 0.91 / 0.80 / +13.7%
random-access/nested-structs-s3/correlated/lance-cached 35218297 / 37925264 / -7.1% 39984535 / 32464066 / +23.2% 0.88 / 1.17 / -24.6%
random-access/nested-structs-s3/correlated/lance-reopen 236363774 / 231935266 / +1.9% 245156134 / 238097309 / +3.0% 0.96 / 0.97 / -1.0%
random-access/nested-structs-s3/uniform/lance-cached 153072880 / 97831964 / +56.5% 🔴 180572888 / 91086772 / +98.2% 🔴 0.85 / 1.07 / -21.1%
random-access/nested-structs-s3/uniform/lance-reopen 302132960 / 271724452 / +11.2% 309411086 / 338341291 / -8.6% 0.98 / 0.80 / +21.6%
random-access/taxi-s3/correlated/lance-cached 55918062 / 56929747 / -1.8% 60251126 / 54404996 / +10.7% 0.93 / 1.05 / -11.3%
random-access/taxi-s3/correlated/lance-reopen 267508551 / 244769063 / +9.3% 270821364 / 261779454 / +3.5% 0.99 / 0.94 / +5.6%
random-access/taxi-s3/lance-cached 44773398 / 42535850 / +5.3% 61634759 / 35068052 / +75.8% 🔴 0.73 / 1.21 / -40.1%
random-access/taxi-s3/lance-reopen 236406974 / 246485846 / -4.1% 233302714 / 266126777 / -12.3% 1.01 / 0.93 / +9.4%
random-access/taxi-s3/uniform/lance-cached 215878922 / 211952316 / +1.9% 323512333 / 255196625 / +26.8% 0.67 / 0.83 / -19.7%
random-access/taxi-s3/uniform/lance-reopen 418751685 / 414389021 / +1.1% 445800488 / 399312618 / +11.6% 0.94 / 1.04 / -9.5%

Split the decode-once caching out into a follow-up PR. This PR now only
changes how sorted searches are called:

- SearchSortedPrimitiveArray::with_probe searches through a probe the
  caller already holds, such as a ProbeState child slot.
- RunEnd's probe lookup searches its ends slot through that API instead
  of a hand-rolled binary search, so a one-off read shares one probe
  across the search and a repeated read keeps its ends probe.
- Patches::probe_patched searches the indices slot and reads the values
  slot through the probe, for repeated reads of Sparse, BitPacked, ALP
  and ALP-RD. One-off reads keep get_patched.
- Encoding probe states go back to (); nothing is decoded ahead.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Jck72aD351kMboqN5g8Ccs
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 7080a70c vs base 31283ee1
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +4.0%
Engines: DataFusion No clear signal (+5.4%, environment too noisy confidence) · DuckDB No clear signal (+2.7%, environment too noisy confidence)
Vortex (geomean): hot 1.005x ➖ · cold 0.959x ➖
Parquet (geomean): hot 0.966x ➖ · cold 0.954x ➖
Shifts: Parquet (control) -3.4% · Median polish -3.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.044x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 335623866 / 361365622 / -7.1% 878649562 / 1261416373 / -30.3% 🟢 0.38 / 0.29 / +33.3%
tpch_q02/datafusion:vortex-file-compressed 518385709 / 561020971 / -7.6% 995240644 / 1212669999 / -17.9% 0.52 / 0.46 / +12.6%
tpch_q03/datafusion:vortex-file-compressed 522611448 / 575899774 / -9.3% 1306811478 / 1256115646 / +4.0% 0.40 / 0.46 / -12.8%
tpch_q04/datafusion:vortex-file-compressed 446434422 / 467097535 / -4.4% 519225486 / 659230259 / -21.2% 0.86 / 0.71 / +21.3%
tpch_q05/datafusion:vortex-file-compressed 1286127308 / 662580615 / +94.1% 🔴 1019168449 / 888667717 / +14.7% 1.26 / 0.75 / +69.3%
tpch_q06/datafusion:vortex-file-compressed 304706958 / 268489082 / +13.5% 616699722 / 446331512 / +38.2% 🔴 0.49 / 0.60 / -17.9%
tpch_q07/datafusion:vortex-file-compressed 1166562024 / 691459423 / +68.7% 🔴 1006452402 / 982065350 / +2.5% 1.16 / 0.70 / +64.6%
tpch_q08/datafusion:vortex-file-compressed 808659473 / 845986795 / -4.4% 1056098946 / 1114945912 / -5.3% 0.77 / 0.76 / +0.9%
tpch_q09/datafusion:vortex-file-compressed 654911058 / 674792723 / -2.9% 959719167 / 1048051980 / -8.4% 0.68 / 0.64 / +6.0%
tpch_q10/datafusion:vortex-file-compressed 610280669 / 678202826 / -10.0% 1008098788 / 1005905248 / +0.2% 0.61 / 0.67 / -10.2%
tpch_q11/datafusion:vortex-file-compressed 400807059 / 445968452 / -10.1% 599781763 / 643324468 / -6.8% 0.67 / 0.69 / -3.6%
tpch_q12/datafusion:vortex-file-compressed 394929058 / 453363966 / -12.9% 503349160 / 632453740 / -20.4% 0.78 / 0.72 / +9.5%
tpch_q13/datafusion:vortex-file-compressed 250675933 / 276387159 / -9.3% 551724081 / 649540610 / -15.1% 0.45 / 0.43 / +6.8%
tpch_q14/datafusion:vortex-file-compressed 470597189 / 408931238 / +15.1% 698966825 / 1026679979 / -31.9% 🟢 0.67 / 0.40 / +69.0%
tpch_q15/datafusion:vortex-file-compressed 609339014 / 576576310 / +5.7% 767207693 / 790865616 / -3.0% 0.79 / 0.73 / +8.9%
tpch_q16/datafusion:vortex-file-compressed 227792832 / 253764521 / -10.2% 408846150 / 438886602 / -6.8% 0.56 / 0.58 / -3.6%
tpch_q17/datafusion:vortex-file-compressed 709331796 / 748595472 / -5.2% 799674799 / 1008573682 / -20.7% 0.89 / 0.74 / +19.5%
tpch_q18/datafusion:vortex-file-compressed 767139277 / 689785764 / +11.2% 1259020648 / 784788287 / +60.4% 🔴 0.61 / 0.88 / -30.7%
tpch_q19/datafusion:vortex-file-compressed 504843041 / 466265159 / +8.3% 632284504 / 641109708 / -1.4% 0.80 / 0.73 / +9.8%
tpch_q20/datafusion:vortex-file-compressed 644164311 / 621726392 / +3.6% 855434488 / 836663663 / +2.2% 0.75 / 0.74 / +1.3%
tpch_q21/datafusion:vortex-file-compressed 1118353551 / 954229830 / +17.2% 1251433658 / 1235554753 / +1.3% 0.89 / 0.77 / +15.7%
tpch_q22/datafusion:vortex-file-compressed 298667967 / 289915211 / +3.0% 815990446 / 875866490 / -6.8% 0.37 / 0.33 / +10.6%
datafusion / vortex-compact / ns (0.976x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 304996085 / 316164509 / -3.5% 896264097 / 873425173 / +2.6% 0.34 / 0.36 / -6.0%
tpch_q02/datafusion:vortex-compact 496062693 / 508839447 / -2.5% 1076564535 / 1252626458 / -14.1% 0.46 / 0.41 / +13.4%
tpch_q03/datafusion:vortex-compact 469686487 / 467505363 / +0.5% 1030852738 / 1132410912 / -9.0% 0.46 / 0.41 / +10.4%
tpch_q04/datafusion:vortex-compact 407842159 / 399373858 / +2.1% 551918193 / 570098805 / -3.2% 0.74 / 0.70 / +5.5%
tpch_q05/datafusion:vortex-compact 610336910 / 618343886 / -1.3% 916127256 / 968398787 / -5.4% 0.67 / 0.64 / +4.3%
tpch_q06/datafusion:vortex-compact 211982057 / 331165943 / -36.0% 🟢 419703050 / 389071167 / +7.9% 0.51 / 0.85 / -40.7%
tpch_q07/datafusion:vortex-compact 614723127 / 670597307 / -8.3% 741532126 / 833203170 / -11.0% 0.83 / 0.80 / +3.0%
tpch_q08/datafusion:vortex-compact 825521791 / 739079327 / +11.7% 999268618 / 1059105207 / -5.6% 0.83 / 0.70 / +18.4%
tpch_q09/datafusion:vortex-compact 632627427 / 674723513 / -6.2% 899352522 / 978948156 / -8.1% 0.70 / 0.69 / +2.1%
tpch_q10/datafusion:vortex-compact 624416490 / 772740268 / -19.2% 1021140558 / 1019110695 / +0.2% 0.61 / 0.76 / -19.4%
tpch_q11/datafusion:vortex-compact 429356257 / 400880272 / +7.1% 980271406 / 770143578 / +27.3% 0.44 / 0.52 / -15.9%
tpch_q12/datafusion:vortex-compact 394321342 / 490775646 / -19.7% 672649746 / 960430543 / -30.0% 0.59 / 0.51 / +14.7%
tpch_q13/datafusion:vortex-compact 269455212 / 270903078 / -0.5% 530036792 / 508136248 / +4.3% 0.51 / 0.53 / -4.6%
tpch_q14/datafusion:vortex-compact 348020941 / 386651849 / -10.0% 531912075 / 595097481 / -10.6% 0.65 / 0.65 / +0.7%
tpch_q15/datafusion:vortex-compact 624616993 / 549099920 / +13.8% 722101038 / 719923356 / +0.3% 0.86 / 0.76 / +13.4%
tpch_q16/datafusion:vortex-compact 229157262 / 220965180 / +3.7% 398282064 / 398450151 / -0.0% 0.58 / 0.55 / +3.8%
tpch_q17/datafusion:vortex-compact 631226694 / 650294049 / -2.9% 697945198 / 871681821 / -19.9% 0.90 / 0.75 / +21.2%
tpch_q18/datafusion:vortex-compact 792740878 / 638843306 / +24.1% 732271154 / 824264780 / -11.2% 1.08 / 0.78 / +39.7%
tpch_q19/datafusion:vortex-compact 452574635 / 491878590 / -8.0% 608606442 / 606474935 / +0.4% 0.74 / 0.81 / -8.3%
tpch_q20/datafusion:vortex-compact 615134193 / 629817975 / -2.3% 950935192 / 957675158 / -0.7% 0.65 / 0.66 / -1.6%
tpch_q21/datafusion:vortex-compact 1224101463 / 972472850 / +25.9% 1466352083 / 979913362 / +49.6% 🔴 0.83 / 0.99 / -15.9%
tpch_q22/datafusion:vortex-compact 288916556 / 291343235 / -0.8% 728647593 / 746797713 / -2.4% 0.40 / 0.39 / +1.6%
datafusion / parquet / ns (0.958x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 213848667 / 222179670 / -3.7% 621794151 / 587291284 / +5.9% 0.34 / 0.38 / -9.1%
tpch_q02/datafusion:parquet 430937214 / 424451681 / +1.5% 856152716 / 1067934733 / -19.8% 0.50 / 0.40 / +26.6%
tpch_q03/datafusion:parquet 478271759 / 473374213 / +1.0% 928684083 / 1019312574 / -8.9% 0.51 / 0.46 / +10.9%
tpch_q04/datafusion:parquet 229597572 / 259246328 / -11.4% 449519776 / 528867814 / -15.0% 0.51 / 0.49 / +4.2%
tpch_q05/datafusion:parquet 664987043 / 923641976 / -28.0% 743608945 / 1511818754 / -50.8% 🟢 0.89 / 0.61 / +46.4%
tpch_q06/datafusion:parquet 250936302 / 206543225 / +21.5% 469834886 / 407990519 / +15.2% 0.53 / 0.51 / +5.5%
tpch_q07/datafusion:parquet 602770530 / 674041599 / -10.6% 832532353 / 844597668 / -1.4% 0.72 / 0.80 / -9.3%
tpch_q08/datafusion:parquet 636387783 / 676267160 / -5.9% 1028978369 / 1005231122 / +2.4% 0.62 / 0.67 / -8.1%
tpch_q09/datafusion:parquet 800449153 / 842519682 / -5.0% 1206397612 / 1037762087 / +16.2% 0.66 / 0.81 / -18.3%
tpch_q10/datafusion:parquet 1048576470 / 1217978947 / -13.9% 1127228473 / 1483121332 / -24.0% 0.93 / 0.82 / +13.3%
tpch_q11/datafusion:parquet 371579947 / 401056963 / -7.3% 568725557 / 670892874 / -15.2% 0.65 / 0.60 / +9.3%
tpch_q12/datafusion:parquet 376210874 / 377695331 / -0.4% 500869281 / 608624288 / -17.7% 0.75 / 0.62 / +21.0%
tpch_q13/datafusion:parquet 386417366 / 406088492 / -4.8% 637602753 / 659717642 / -3.4% 0.61 / 0.62 / -1.5%
tpch_q14/datafusion:parquet 397356231 / 407231556 / -2.4% 614341268 / 580571731 / +5.8% 0.65 / 0.70 / -7.8%
tpch_q15/datafusion:parquet 664602834 / 760033138 / -12.6% 909682133 / 705712725 / +28.9% 0.73 / 1.08 / -32.2%
tpch_q16/datafusion:parquet 208250903 / 214048416 / -2.7% 422839344 / 441902197 / -4.3% 0.49 / 0.48 / +1.7%
tpch_q17/datafusion:parquet 720031692 / 597029108 / +20.6% 760136697 / 862483927 / -11.9% 0.95 / 0.69 / +36.8%
tpch_q18/datafusion:parquet 483489230 / 511450469 / -5.5% 665236621 / 757961358 / -12.2% 0.73 / 0.67 / +7.7%
tpch_q19/datafusion:parquet 430401287 / 566844127 / -24.1% 573612111 / 579552657 / -1.0% 0.75 / 0.98 / -23.3%
tpch_q20/datafusion:parquet 666606461 / 674026224 / -1.1% 966752411 / 960642519 / +0.6% 0.69 / 0.70 / -1.7%
tpch_q21/datafusion:parquet 1116424790 / 891885433 / +25.2% 1644015774 / 948454138 / +73.3% 🔴 0.68 / 0.94 / -27.8%
tpch_q22/datafusion:parquet 388214982 / 413110641 / -6.0% 637241757 / 692719545 / -8.0% 0.61 / 0.60 / +2.2%
duckdb / vortex-file-compressed / ns (1.039x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 924321818 / 1004304900 / -8.0% 1182213926 / 1242468902 / -4.8% 0.78 / 0.81 / -3.3%
tpch_q02/duckdb:vortex-file-compressed 508787569 / 503546724 / +1.0% 612068412 / 709513158 / -13.7% 0.83 / 0.71 / +17.1%
tpch_q03/duckdb:vortex-file-compressed 1180623914 / 1189052383 / -0.7% 1389672005 / 1567492093 / -11.3% 0.85 / 0.76 / +12.0%
tpch_q04/duckdb:vortex-file-compressed 935911048 / 986535456 / -5.1% 1155918733 / 1236608187 / -6.5% 0.81 / 0.80 / +1.5%
tpch_q05/duckdb:vortex-file-compressed 1187421302 / 1052344330 / +12.8% 1687240370 / 1290341889 / +30.8% 🔴 0.70 / 0.82 / -13.7%
tpch_q06/duckdb:vortex-file-compressed 728299710 / 899688086 / -19.0% 881857941 / 918499879 / -4.0% 0.83 / 0.98 / -15.7%
tpch_q07/duckdb:vortex-file-compressed 1152007372 / 1141477105 / +0.9% 1369292936 / 1365523364 / +0.3% 0.84 / 0.84 / +0.6%
tpch_q08/duckdb:vortex-file-compressed 1339799665 / 1188327983 / +12.7% 1441270177 / 1441977764 / -0.0% 0.93 / 0.82 / +12.8%
tpch_q09/duckdb:vortex-file-compressed 1270596276 / 1328352808 / -4.3% 1406194909 / 1493776505 / -5.9% 0.90 / 0.89 / +1.6%
tpch_q10/duckdb:vortex-file-compressed 1365566863 / 1334397279 / +2.3% 1590400862 / 1626972521 / -2.2% 0.86 / 0.82 / +4.7%
tpch_q11/duckdb:vortex-file-compressed 341593784 / 344509683 / -0.8% 433236850 / 495106720 / -12.5% 0.79 / 0.70 / +13.3%
tpch_q12/duckdb:vortex-file-compressed 913054835 / 884361254 / +3.2% 1174301196 / 1066131941 / +10.1% 0.78 / 0.83 / -6.3%
tpch_q13/duckdb:vortex-file-compressed 729751235 / 798432502 / -8.6% 1136895071 / 1161155684 / -2.1% 0.64 / 0.69 / -6.7%
tpch_q14/duckdb:vortex-file-compressed 828819198 / 889177813 / -6.8% 1032928096 / 1025580286 / +0.7% 0.80 / 0.87 / -7.5%
tpch_q15/duckdb:vortex-file-compressed 773172184 / 783944972 / -1.4% 899658098 / 915639659 / -1.7% 0.86 / 0.86 / +0.4%
tpch_q16/duckdb:vortex-file-compressed 880292992 / 286001552 / +207.8% 🔴 481190549 / 436832021 / +10.2% 1.83 / 0.65 / +179.4%
tpch_q17/duckdb:vortex-file-compressed 948115754 / 962687861 / -1.5% 1108198892 / 1036442923 / +6.9% 0.86 / 0.93 / -7.9%
tpch_q18/duckdb:vortex-file-compressed 1168016672 / 1016061505 / +15.0% 1240394083 / 1190078026 / +4.2% 0.94 / 0.85 / +10.3%
tpch_q19/duckdb:vortex-file-compressed 1016260789 / 995785590 / +2.1% 1138987964 / 1081105541 / +5.4% 0.89 / 0.92 / -3.1%
tpch_q20/duckdb:vortex-file-compressed 963127014 / 1017461936 / -5.3% 1178961456 / 1224767582 / -3.7% 0.82 / 0.83 / -1.7%
tpch_q21/duckdb:vortex-file-compressed 2398318074 / 2398810120 / -0.0% 2370312359 / 2493457552 / -4.9% 1.01 / 0.96 / +5.2%
tpch_q22/duckdb:vortex-file-compressed 390105599 / 433797040 / -10.1% 536465716 / 572055255 / -6.2% 0.73 / 0.76 / -4.1%
duckdb / vortex-compact / ns (0.965x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 888910458 / 915603402 / -2.9% 1087299026 / 1295397806 / -16.1% 0.82 / 0.71 / +15.7%
tpch_q02/duckdb:vortex-compact 477440677 / 499241731 / -4.4% 588915631 / 651586956 / -9.6% 0.81 / 0.77 / +5.8%
tpch_q03/duckdb:vortex-compact 1116991848 / 1283600291 / -13.0% 1442086433 / 1612688071 / -10.6% 0.77 / 0.80 / -2.7%
tpch_q04/duckdb:vortex-compact 814418724 / 837018615 / -2.7% 1004138067 / 1078617562 / -6.9% 0.81 / 0.78 / +4.5%
tpch_q05/duckdb:vortex-compact 926558237 / 1090458043 / -15.0% 1271899648 / 1398010788 / -9.0% 0.73 / 0.78 / -6.6%
tpch_q06/duckdb:vortex-compact 727186440 / 728079946 / -0.1% 867854813 / 946312429 / -8.3% 0.84 / 0.77 / +8.9%
tpch_q07/duckdb:vortex-compact 1062922530 / 1120974413 / -5.2% 1615970572 / 1372523356 / +17.7% 0.66 / 0.82 / -19.5%
tpch_q08/duckdb:vortex-compact 1031791320 / 1278815220 / -19.3% 1280533798 / 1552083651 / -17.5% 0.81 / 0.82 / -2.2%
tpch_q09/duckdb:vortex-compact 1278786227 / 1327814635 / -3.7% 1393659117 / 1829342907 / -23.8% 0.92 / 0.73 / +26.4%
tpch_q10/duckdb:vortex-compact 1252846034 / 1243092217 / +0.8% 1548170157 / 1846228251 / -16.1% 0.81 / 0.67 / +20.2%
tpch_q11/duckdb:vortex-compact 398028455 / 363717593 / +9.4% 432248212 / 525658339 / -17.8% 0.92 / 0.69 / +33.1%
tpch_q12/duckdb:vortex-compact 795081029 / 857236618 / -7.3% 1035585523 / 1027250146 / +0.8% 0.77 / 0.83 / -8.0%
tpch_q13/duckdb:vortex-compact 715613929 / 683076573 / +4.8% 940350130 / 951238815 / -1.1% 0.76 / 0.72 / +6.0%
tpch_q14/duckdb:vortex-compact 975960346 / 930105025 / +4.9% 1058292041 / 1083121670 / -2.3% 0.92 / 0.86 / +7.4%
tpch_q15/duckdb:vortex-compact 781878867 / 838378030 / -6.7% 950632772 / 985431151 / -3.5% 0.82 / 0.85 / -3.3%
tpch_q16/duckdb:vortex-compact 266734701 / 294406284 / -9.4% 428183775 / 383185921 / +11.7% 0.62 / 0.77 / -18.9%
tpch_q17/duckdb:vortex-compact 902305939 / 1021542771 / -11.7% 1048055984 / 1193184423 / -12.2% 0.86 / 0.86 / +0.6%
tpch_q18/duckdb:vortex-compact 1339551272 / 970778390 / +38.0% 🔴 1420215942 / 1350359683 / +5.2% 0.94 / 0.72 / +31.2%
tpch_q19/duckdb:vortex-compact 1000149376 / 998585540 / +0.2% 1082610444 / 1219236775 / -11.2% 0.92 / 0.82 / +12.8%
tpch_q20/duckdb:vortex-compact 958236190 / 1005826304 / -4.7% 1193351365 / 1206992016 / -1.1% 0.80 / 0.83 / -3.6%
tpch_q21/duckdb:vortex-compact 2379395227 / 2096940535 / +13.5% 2608702237 / 2281543016 / +14.3% 0.91 / 0.92 / -0.8%
tpch_q22/duckdb:vortex-compact 419091986 / 566940115 / -26.1% 536465776 / 739799397 / -27.5% 0.78 / 0.77 / +1.9%
duckdb / parquet / ns (0.975x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 294247253 / 331515890 / -11.2% 328153965 / 411147596 / -20.2% 0.90 / 0.81 / +11.2%
tpch_q02/duckdb:parquet 556292435 / 551004835 / +1.0% 761297404 / 715850600 / +6.3% 0.73 / 0.77 / -5.1%
tpch_q03/duckdb:parquet 508211048 / 525109255 / -3.2% 732641345 / 732589386 / +0.0% 0.69 / 0.72 / -3.2%
tpch_q04/duckdb:parquet 428832405 / 404440438 / +6.0% 901950792 / 619884607 / +45.5% 🔴 0.48 / 0.65 / -27.1%
tpch_q05/duckdb:parquet 670860500 / 697218013 / -3.8% 985043860 / 787766924 / +25.0% 0.68 / 0.89 / -23.1%
tpch_q06/duckdb:parquet 385098524 / 443427887 / -13.2% 461517450 / 595057696 / -22.4% 0.83 / 0.75 / +12.0%
tpch_q07/duckdb:parquet 841308696 / 800155659 / +5.1% 690714220 / 852876998 / -19.0% 1.22 / 0.94 / +29.8%
tpch_q08/duckdb:parquet 968454141 / 958982435 / +1.0% 914378306 / 1444739689 / -36.7% 🟢 1.06 / 0.66 / +59.6%
tpch_q09/duckdb:parquet 966733817 / 969642121 / -0.3% 1102521795 / 1354677526 / -18.6% 0.88 / 0.72 / +22.5%
tpch_q10/duckdb:parquet 758825194 / 763799832 / -0.7% 884137021 / 894161067 / -1.1% 0.86 / 0.85 / +0.5%
tpch_q11/duckdb:parquet 322986429 / 343921556 / -6.1% 327953130 / 396654539 / -17.3% 0.98 / 0.87 / +13.6%
tpch_q12/duckdb:parquet 362790919 / 392885618 / -7.7% 462630309 / 468907101 / -1.3% 0.78 / 0.84 / -6.4%
tpch_q13/duckdb:parquet 754182090 / 563099023 / +33.9% 🔴 878653283 / 654210587 / +34.3% 🔴 0.86 / 0.86 / -0.3%
tpch_q14/duckdb:parquet 564451147 / 580936596 / -2.8% 524655520 / 663961922 / -21.0% 1.08 / 0.87 / +23.0%
tpch_q15/duckdb:parquet 468697274 / 477472567 / -1.8% 519957047 / 503930168 / +3.2% 0.90 / 0.95 / -4.9%
tpch_q16/duckdb:parquet 361179312 / 376135632 / -4.0% 336987042 / 419659668 / -19.7% 1.07 / 0.90 / +19.6%
tpch_q17/duckdb:parquet 370639073 / 626836821 / -40.9% 🟢 648833690 / 717335029 / -9.5% 0.57 / 0.87 / -34.6%
tpch_q18/duckdb:parquet 458311086 / 484237803 / -5.4% 477882004 / 543316811 / -12.0% 0.96 / 0.89 / +7.6%
tpch_q19/duckdb:parquet 532552841 / 565900121 / -5.9% 401198072 / 625041673 / -35.8% 🟢 1.33 / 0.91 / +46.6%
tpch_q20/duckdb:parquet 847956695 / 772085780 / +9.8% 1208741664 / 794369300 / +52.2% 🔴 0.70 / 0.97 / -27.8%
tpch_q21/duckdb:parquet 807988198 / 727663861 / +11.0% 839728123 / 734948266 / +14.3% 0.96 / 0.99 / -2.8%
tpch_q22/duckdb:parquet 462154849 / 449753718 / +2.8% 513342742 / 466167056 / +10.1% 0.90 / 0.96 / -6.7%

@joseph-isaacs joseph-isaacs changed the title perf: decode sorted children once per repeated probe and share searchers perf: search sorted children through one shared probe Nov 13, 2026

Copy link
Copy Markdown
Contributor Author

I've split this PR in two. This one now only changes the call sites so that sorted searches go through one shared probe. Decoding the sorted child once per repeated probe moved to #11473, which is stacked on this one.

Results

These are the patched_search benchmarks, measured as instructions per iteration with cachegrind. Each figure is the 20×20 run minus the 1×1 run, divided by 399.

Benchmark develop #10452 #11473 (on #10452)
run_end_read_once 12.16M 5.60M (0.46x) 4.28M (0.35x)
run_end_read_repeated 12.24M 5.46M (0.45x) 0.21M (0.017x)
run_end_slice 7.05M 3.24M (0.46x) 2.56M (0.36x)
patches_slice 2.02M 1.99M (0.99x) 1.99M (0.99x)
sparse_read_once 3.41M 3.44M (1.01x) 3.47M (1.02x)
sparse_read_repeated 3.42M 3.49M (1.02x) 0.23M (0.066x)

Wall-clock medians agree:

Benchmark develop #10452 #11473
run_end_read_repeated 1.47 ms 645 µs 18.9 µs
sparse_read_repeated 369 µs 357 µs 39 µs
run_end_slice 868 µs 395 µs 352 µs

Two things I don't fully understand yet:

  • Sparse repeated reads: this PR makes sparse_read_repeated about 2% worse. A repeated read now binary searches the whole BitPacked indices child through the probe, whereas get_patched first narrows the search with the chunk offsets.
  • RunEnd one-off reads and slices: perf: decode sorted children once per repeated probe #11473 still lowers run_end_read_once and run_end_slice relative to this PR. Its one-off and slice paths are meant to match this PR's. I haven't traced where that difference comes from.

CodSpeed

The 4 regressions CodSpeed reports are dict_compare varbin and sliced-dict, and bitpack_compare_sweep compare[1] for u32. None of them go through sorted search or patches. bitpack_compare_sweep uses arrays without patches, and its source notes that its results depend on "allocator state, which shifts with any change to the bench binary". On an earlier run of this PR, three of these four came out as improvements. I'm treating them as layout noise, so they need acknowledging on CodSpeed.


Generated by Claude Code

Under CodSpeed, do 16 reads and 8 slices per iteration instead of 256
and 64. The simulated cost of the earlier counts was 2.1ms to 5.7ms.
Also wrap the module doc comment and add blank lines between the
blocks of Patches::probe_patched.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@joseph-isaacs joseph-isaacs added action/bench-random-access Run only the random-access benchmark on this PR action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Nov 15, 2026 — with Claude
@github-actions github-actions Bot removed action/bench-sql Run SQL benchmarks without Vortex Compact on this PR action/bench-random-access Run only the random-access benchmark on this PR labels Nov 15, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=10 on NVME 📖

Commits: PR 43742ab2 vs base d7aa24e8
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.0%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.980x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.990x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 34997115 / 35940640 / -2.6% 61658068 / 62481362 / -1.3% 0.57 / 0.58 / -1.3%
tpcds_q02/datafusion:vortex-file-compressed 49391886 / 49102199 / +0.6% 75347578 / 77198723 / -2.4% 0.66 / 0.64 / +3.1%
tpcds_q03/datafusion:vortex-file-compressed 20839544 / 19926326 / +4.6% 42728569 / 45582330 / -6.3% 0.49 / 0.44 / +11.6%
tpcds_q04/datafusion:vortex-file-compressed 292520856 / 291680240 / +0.3% 350209009 / 354803483 / -1.3% 0.84 / 0.82 / +1.6%
tpcds_q05/datafusion:vortex-file-compressed 73473900 / 71983272 / +2.1% 111873128 / 105336823 / +6.2% 0.66 / 0.68 / -3.9%
tpcds_q06/datafusion:vortex-file-compressed 42257362 / 42728164 / -1.1% 71323484 / 68905801 / +3.5% 0.59 / 0.62 / -4.5%
tpcds_q07/datafusion:vortex-file-compressed 42507570 / 42867822 / -0.8% 79903012 / 78588731 / +1.7% 0.53 / 0.55 / -2.5%
tpcds_q08/datafusion:vortex-file-compressed 27715945 / 28574425 / -3.0% 53574760 / 55007453 / -2.6% 0.52 / 0.52 / -0.4%
tpcds_q09/datafusion:vortex-file-compressed 44627264 / 43397209 / +2.8% 75298267 / 79664804 / -5.5% 0.59 / 0.54 / +8.8%
tpcds_q10/datafusion:vortex-file-compressed 36345785 / 37720602 / -3.6% 64273233 / 69041051 / -6.9% 0.57 / 0.55 / +3.5%
tpcds_q11/datafusion:vortex-file-compressed 177191152 / 174283282 / +1.7% 210247506 / 218739664 / -3.9% 0.84 / 0.80 / +5.8%
tpcds_q12/datafusion:vortex-file-compressed 17804057 / 17794516 / +0.1% 36700643 / 38267185 / -4.1% 0.49 / 0.47 / +4.3%
tpcds_q13/datafusion:vortex-file-compressed 38136028 / 38582756 / -1.2% 80714219 / 82146011 / -1.7% 0.47 / 0.47 / +0.6%
tpcds_q14/datafusion:vortex-file-compressed 233353286 / 231327658 / +0.9% 272108865 / 267658993 / +1.7% 0.86 / 0.86 / -0.8%
tpcds_q15/datafusion:vortex-file-compressed 38471642 / 40876592 / -5.9% 62632557 / 61993106 / +1.0% 0.61 / 0.66 / -6.8%
tpcds_q16/datafusion:vortex-file-compressed 23643880 / 24289335 / -2.7% 43472952 / 44605340 / -2.5% 0.54 / 0.54 / -0.1%
tpcds_q17/datafusion:vortex-file-compressed 63873550 / 62315298 / +2.5% 87530215 / 92277677 / -5.1% 0.73 / 0.68 / +8.1%
tpcds_q18/datafusion:vortex-file-compressed 68602044 / 68540210 / +0.1% 94854099 / 101040597 / -6.1% 0.72 / 0.68 / +6.6%
tpcds_q19/datafusion:vortex-file-compressed 22680640 / 22689585 / -0.0% 53551369 / 54064333 / -0.9% 0.42 / 0.42 / +0.9%
tpcds_q20/datafusion:vortex-file-compressed 22997709 / 23342730 / -1.5% 41447817 / 40573766 / +2.2% 0.55 / 0.58 / -3.6%
tpcds_q21/datafusion:vortex-file-compressed 47582716 / 47000864 / +1.2% 69842681 / 64004941 / +9.1% 0.68 / 0.73 / -7.2%
tpcds_q22/datafusion:vortex-file-compressed 440384314 / 436194784 / +1.0% 456815237 / 457899091 / -0.2% 0.96 / 0.95 / +1.2%
tpcds_q23/datafusion:vortex-file-compressed 296878422 / 293250158 / +1.2% 344596378 / 355740227 / -3.1% 0.86 / 0.82 / +4.5%
tpcds_q24/datafusion:vortex-file-compressed 121510676 / 119846956 / +1.4% 166398046 / 153368693 / +8.5% 0.73 / 0.78 / -6.6%
tpcds_q25/datafusion:vortex-file-compressed 62399236 / 63401399 / -1.6% 98492070 / 100874635 / -2.4% 0.63 / 0.63 / +0.8%
tpcds_q26/datafusion:vortex-file-compressed 37626416 / 38100362 / -1.2% 60980412 / 59062042 / +3.2% 0.62 / 0.65 / -4.4%
tpcds_q27/datafusion:vortex-file-compressed 72694926 / 70944636 / +2.5% 105344957 / 106084911 / -0.7% 0.69 / 0.67 / +3.2%
tpcds_q28/datafusion:vortex-file-compressed 43040479 / 42002676 / +2.5% 79685388 / 96919828 / -17.8% 🟢 0.54 / 0.43 / +24.6%
tpcds_q29/datafusion:vortex-file-compressed 66469894 / 66765966 / -0.4% 99802027 / 104292390 / -4.3% 0.67 / 0.64 / +4.0%
tpcds_q30/datafusion:vortex-file-compressed 51172918 / 51760676 / -1.1% 78461106 / 78678334 / -0.3% 0.65 / 0.66 / -0.9%
tpcds_q31/datafusion:vortex-file-compressed 197568009 / 199495337 / -1.0% 229202700 / 235264915 / -2.6% 0.86 / 0.85 / +1.7%
tpcds_q32/datafusion:vortex-file-compressed 14979248 / 15065784 / -0.6% 32366408 / 34220744 / -5.4% 0.46 / 0.44 / +5.1%
tpcds_q33/datafusion:vortex-file-compressed 33749452 / 34123462 / -1.1% 66977706 / 69176075 / -3.2% 0.50 / 0.49 / +2.2%
tpcds_q34/datafusion:vortex-file-compressed 40512194 / 41177030 / -1.6% 68185777 / 68138325 / +0.1% 0.59 / 0.60 / -1.7%
tpcds_q35/datafusion:vortex-file-compressed 91843456 / 91775972 / +0.1% 120499234 / 124041436 / -2.9% 0.76 / 0.74 / +3.0%
tpcds_q36/datafusion:vortex-file-compressed 65148350 / 67864323 / -4.0% 98119788 / 97758510 / +0.4% 0.66 / 0.69 / -4.4%
tpcds_q37/datafusion:vortex-file-compressed 23286466 / 22799458 / +2.1% 58102849 / 41818004 / +38.9% 🔴 0.40 / 0.55 / -26.5%
tpcds_q38/datafusion:vortex-file-compressed 79076986 / 78896950 / +0.2% 108421112 / 109909435 / -1.4% 0.73 / 0.72 / +1.6%
tpcds_q39/datafusion:vortex-file-compressed 888614684 / 888220345 / +0.0% 910107297 / 904306388 / +0.6% 0.98 / 0.98 / -0.6%
tpcds_q40/datafusion:vortex-file-compressed 28671580 / 28409758 / +0.9% 49051248 / 48760493 / +0.6% 0.58 / 0.58 / +0.3%
tpcds_q41/datafusion:vortex-file-compressed 19284470 / 19752587 / -2.4% 32961980 / 31938071 / +3.2% 0.59 / 0.62 / -5.4%
tpcds_q42/datafusion:vortex-file-compressed 13533592 / 13643116 / -0.8% 36517884 / 39405525 / -7.3% 0.37 / 0.35 / +7.0%
tpcds_q43/datafusion:vortex-file-compressed 18214332 / 17490924 / +4.1% 39772914 / 40710123 / -2.3% 0.46 / 0.43 / +6.6%
tpcds_q44/datafusion:vortex-file-compressed 42439706 / 43885679 / -3.3% 74405839 / 72141235 / +3.1% 0.57 / 0.61 / -6.2%
tpcds_q45/datafusion:vortex-file-compressed 43399109 / 43721794 / -0.7% 66948128 / 64844763 / +3.2% 0.65 / 0.67 / -3.9%
tpcds_q46/datafusion:vortex-file-compressed 70465250 / 73282081 / -3.8% 103172357 / 103484330 / -0.3% 0.68 / 0.71 / -3.6%
tpcds_q47/datafusion:vortex-file-compressed 175593923 / 174325894 / +0.7% 223349754 / 224041635 / -0.3% 0.79 / 0.78 / +1.0%
tpcds_q48/datafusion:vortex-file-compressed 35519908 / 36171207 / -1.8% 74216793 / 71743226 / +3.4% 0.48 / 0.50 / -5.1%
tpcds_q49/datafusion:vortex-file-compressed 78794484 / 78423205 / +0.5% 116373467 / 123778145 / -6.0% 0.68 / 0.63 / +6.9%
tpcds_q50/datafusion:vortex-file-compressed 56354884 / 55582755 / +1.4% 86247620 / 87076140 / -1.0% 0.65 / 0.64 / +2.4%
tpcds_q51/datafusion:vortex-file-compressed 244468560 / 248004471 / -1.4% 276203470 / 277110076 / -0.3% 0.89 / 0.89 / -1.1%
tpcds_q52/datafusion:vortex-file-compressed 14826492 / 14627609 / +1.4% 37471775 / 40585782 / -7.7% 0.40 / 0.36 / +9.8%
tpcds_q53/datafusion:vortex-file-compressed 23384085 / 22671370 / +3.1% 51552828 / 49633124 / +3.9% 0.45 / 0.46 / -0.7%
tpcds_q54/datafusion:vortex-file-compressed 56627024 / 58781278 / -3.7% 90133453 / 92111219 / -2.1% 0.63 / 0.64 / -1.6%
tpcds_q55/datafusion:vortex-file-compressed 14660494 / 14377068 / +2.0% 37987669 / 39530654 / -3.9% 0.39 / 0.36 / +6.1%
tpcds_q56/datafusion:vortex-file-compressed 32857924 / 33606156 / -2.2% 64342848 / 63670029 / +1.1% 0.51 / 0.53 / -3.2%
tpcds_q57/datafusion:vortex-file-compressed 130424676 / 129617065 / +0.6% 161729199 / 162522433 / -0.5% 0.81 / 0.80 / +1.1%
tpcds_q58/datafusion:vortex-file-compressed 48319428 / 48685208 / -0.8% 86789756 / 85700559 / +1.3% 0.56 / 0.57 / -2.0%
tpcds_q59/datafusion:vortex-file-compressed 53704346 / 55356360 / -3.0% 83775950 / 80621565 / +3.9% 0.64 / 0.69 / -6.6%
tpcds_q60/datafusion:vortex-file-compressed 33917280 / 34548794 / -1.8% 64782144 / 65046245 / -0.4% 0.52 / 0.53 / -1.4%
tpcds_q61/datafusion:vortex-file-compressed 46727599 / 47753799 / -2.1% 72633847 / 72559222 / +0.1% 0.64 / 0.66 / -2.2%
tpcds_q62/datafusion:vortex-file-compressed 19056682 / 19039611 / +0.1% 41497723 / 41798285 / -0.7% 0.46 / 0.46 / +0.8%
tpcds_q63/datafusion:vortex-file-compressed 22972698 / 23248644 / -1.2% 50749836 / 51666788 / -1.8% 0.45 / 0.45 / +0.6%
tpcds_q64/datafusion:vortex-file-compressed 331767237 / 333355830 / -0.5% 400256648 / 399751036 / +0.1% 0.83 / 0.83 / -0.6%
tpcds_q65/datafusion:vortex-file-compressed 74276502 / 75361683 / -1.4% 111679369 / 113143507 / -1.3% 0.67 / 0.67 / -0.1%
tpcds_q66/datafusion:vortex-file-compressed 53578594 / 52917328 / +1.2% 76318094 / 78432875 / -2.7% 0.70 / 0.67 / +4.1%
tpcds_q67/datafusion:vortex-file-compressed 419442527 / 420115159 / -0.2% 514392148 / 522703222 / -1.6% 0.82 / 0.80 / +1.5%
tpcds_q68/datafusion:vortex-file-compressed 67639142 / 66567108 / +1.6% 99320094 / 101958702 / -2.6% 0.68 / 0.65 / +4.3%
tpcds_q69/datafusion:vortex-file-compressed 35998004 / 35878988 / +0.3% 64311397 / 64038931 / +0.4% 0.56 / 0.56 / -0.1%
tpcds_q70/datafusion:vortex-file-compressed 195612597 / 194497590 / +0.6% 226154158 / 227536313 / -0.6% 0.86 / 0.85 / +1.2%
tpcds_q71/datafusion:vortex-file-compressed 25976283 / 26265618 / -1.1% 56891556 / 57932584 / -1.8% 0.46 / 0.45 / +0.7%
tpcds_q72/datafusion:vortex-file-compressed 1637639916 / 1587292778 / +3.2% 1637078725 / 1645100847 / -0.5% 1.00 / 0.96 / +3.7%
tpcds_q73/datafusion:vortex-file-compressed 38960538 / 38224844 / +1.9% 62460542 / 67290093 / -7.2% 0.62 / 0.57 / +9.8%
tpcds_q74/datafusion:vortex-file-compressed 133390034 / 135453518 / -1.5% 174675014 / 174024850 / +0.4% 0.76 / 0.78 / -1.9%
tpcds_q75/datafusion:vortex-file-compressed 159559844 / 156032014 / +2.3% 199398070 / 203687570 / -2.1% 0.80 / 0.77 / +4.5%
tpcds_q76/datafusion:vortex-file-compressed 33170800 / 34022195 / -2.5% 72373156 / 75255756 / -3.8% 0.46 / 0.45 / +1.4%
tpcds_q77/datafusion:vortex-file-compressed 54576262 / 55058250 / -0.9% 88492317 / 88730869 / -0.3% 0.62 / 0.62 / -0.6%
tpcds_q78/datafusion:vortex-file-compressed 140834166 / 141453058 / -0.4% 190277423 / 193439277 / -1.6% 0.74 / 0.73 / +1.2%
tpcds_q79/datafusion:vortex-file-compressed 54157430 / 54454118 / -0.5% 83358773 / 85000394 / -1.9% 0.65 / 0.64 / +1.4%
tpcds_q80/datafusion:vortex-file-compressed 81258200 / 81384168 / -0.2% 124018267 / 128250296 / -3.3% 0.66 / 0.63 / +3.3%
tpcds_q81/datafusion:vortex-file-compressed 56096255 / 56132076 / -0.1% 83969475 / 82068130 / +2.3% 0.67 / 0.68 / -2.3%
tpcds_q82/datafusion:vortex-file-compressed 34556543 / 30342039 / +13.9% 🔴 46929314 / 48978043 / -4.2% 0.74 / 0.62 / +18.9%
tpcds_q83/datafusion:vortex-file-compressed 42363511 / 42199256 / +0.4% 66603375 / 67218124 / -0.9% 0.64 / 0.63 / +1.3%
tpcds_q84/datafusion:vortex-file-compressed 12907644 / 13235327 / -2.5% 31540594 / 31757325 / -0.7% 0.41 / 0.42 / -1.8%
tpcds_q85/datafusion:vortex-file-compressed 59308946 / 59446832 / -0.2% 88771229 / 91143823 / -2.6% 0.67 / 0.65 / +2.4%
tpcds_q86/datafusion:vortex-file-compressed 18734370 / 18573254 / +0.9% 41106269 / 40915400 / +0.5% 0.46 / 0.45 / +0.4%
tpcds_q87/datafusion:vortex-file-compressed 78018570 / 79115111 / -1.4% 108995348 / 110061136 / -1.0% 0.72 / 0.72 / -0.4%
tpcds_q88/datafusion:vortex-file-compressed 53061934 / 54377045 / -2.4% 92642853 / 92721195 / -0.1% 0.57 / 0.59 / -2.3%
tpcds_q89/datafusion:vortex-file-compressed 27051439 / 26262286 / +3.0% 56522606 / 55196136 / +2.4% 0.48 / 0.48 / +0.6%
tpcds_q90/datafusion:vortex-file-compressed 13062904 / 12729648 / +2.6% 33284525 / 30076886 / +10.7% 🔴 0.39 / 0.42 / -7.3%
tpcds_q91/datafusion:vortex-file-compressed 18741432 / 18708419 / +0.2% 42158435 / 43970797 / -4.1% 0.44 / 0.43 / +4.5%
tpcds_q92/datafusion:vortex-file-compressed 15314380 / 15697904 / -2.4% 36541078 / 38466357 / -5.0% 0.42 / 0.41 / +2.7%
tpcds_q93/datafusion:vortex-file-compressed 55630138 / 56123149 / -0.9% 93641595 / 98967238 / -5.4% 0.59 / 0.57 / +4.8%
tpcds_q94/datafusion:vortex-file-compressed 21342900 / 21516196 / -0.8% 43674068 / 46788367 / -6.7% 0.49 / 0.46 / +6.3%
tpcds_q95/datafusion:vortex-file-compressed 94628152 / 94588629 / +0.0% 121384998 / 119568397 / +1.5% 0.78 / 0.79 / -1.5%
tpcds_q96/datafusion:vortex-file-compressed 11554278 / 11623062 / -0.6% 30422020 / 31506483 / -3.4% 0.38 / 0.37 / +3.0%
tpcds_q97/datafusion:vortex-file-compressed 38934297 / 38044816 / +2.3% 64728554 / 67283194 / -3.8% 0.60 / 0.57 / +6.4%
tpcds_q98/datafusion:vortex-file-compressed 20545246 / 20562469 / -0.1% 46158882 / 49533159 / -6.8% 0.45 / 0.42 / +7.2%
tpcds_q99/datafusion:vortex-file-compressed 29917472 / 29526778 / +1.3% 49879047 / 47763468 / +4.4% 0.60 / 0.62 / -3.0%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 59513306 / 59452667 / +0.1% 80945846 / 78056429 / +3.7% 0.74 / 0.76 / -3.5%
tpcds_q02/datafusion:parquet 68396743 / 69242104 / -1.2% 89903559 / 90119762 / -0.2% 0.76 / 0.77 / -1.0%
tpcds_q03/datafusion:parquet 28528696 / 29070692 / -1.9% 46426770 / 48064032 / -3.4% 0.61 / 0.60 / +1.6%
tpcds_q04/datafusion:parquet 640379046 / 637437674 / +0.5% 702892728 / 704321180 / -0.2% 0.91 / 0.91 / +0.7%
tpcds_q05/datafusion:parquet 81159448 / 79931170 / +1.5% 111916378 / 107014178 / +4.6% 0.73 / 0.75 / -2.9%
tpcds_q06/datafusion:parquet 90079441 / 90803259 / -0.8% 114765947 / 112173878 / +2.3% 0.78 / 0.81 / -3.0%
tpcds_q07/datafusion:parquet 102152735 / 100915104 / +1.2% 134428296 / 134022943 / +0.3% 0.76 / 0.75 / +0.9%
tpcds_q08/datafusion:parquet 48139271 / 49169772 / -2.1% 75811120 / 77439264 / -2.1% 0.63 / 0.63 / +0.0%
tpcds_q09/datafusion:parquet 74770390 / 75200044 / -0.6% 108204132 / 103342051 / +4.7% 0.69 / 0.73 / -5.0%
tpcds_q10/datafusion:parquet 60592902 / 59483386 / +1.9% 80129339 / 78350386 / +2.3% 0.76 / 0.76 / -0.4%
tpcds_q11/datafusion:parquet 411109919 / 412160184 / -0.3% 455201809 / 451548472 / +0.8% 0.90 / 0.91 / -1.1%
tpcds_q12/datafusion:parquet 39941686 / 39854188 / +0.2% 59312414 / 57789349 / +2.6% 0.67 / 0.69 / -2.4%
tpcds_q13/datafusion:parquet 87103908 / 88004352 / -1.0% 131494014 / 130833694 / +0.5% 0.66 / 0.67 / -1.5%
tpcds_q14/datafusion:parquet 380149641 / 368934191 / +3.0% 405507340 / 422247723 / -4.0% 0.94 / 0.87 / +7.3%
tpcds_q15/datafusion:parquet 50945548 / 50947716 / -0.0% 71845125 / 68835182 / +4.4% 0.71 / 0.74 / -4.2%
tpcds_q16/datafusion:parquet 45236078 / 45321905 / -0.2% 61646231 / 62461834 / -1.3% 0.73 / 0.73 / +1.1%
tpcds_q17/datafusion:parquet 137249356 / 135130136 / +1.6% 173325567 / 168894473 / +2.6% 0.79 / 0.80 / -1.0%
tpcds_q18/datafusion:parquet 108978323 / 108655442 / +0.3% 139560371 / 139593534 / -0.0% 0.78 / 0.78 / +0.3%
tpcds_q19/datafusion:parquet 48543861 / 47807952 / +1.5% 73251253 / 75182139 / -2.6% 0.66 / 0.64 / +4.2%
tpcds_q20/datafusion:parquet 41663206 / 41712774 / -0.1% 55043432 / 54615728 / +0.8% 0.76 / 0.76 / -0.9%
tpcds_q21/datafusion:parquet 61107689 / 61061629 / +0.1% 74403733 / 72524347 / +2.6% 0.82 / 0.84 / -2.5%
tpcds_q22/datafusion:parquet 464512258 / 462295574 / +0.5% 475599893 / 475889356 / -0.1% 0.98 / 0.97 / +0.5%
tpcds_q23/datafusion:parquet 358954392 / 362936855 / -1.1% 424129098 / 422601442 / +0.4% 0.85 / 0.86 / -1.5%
tpcds_q24/datafusion:parquet 242067195 / 241571825 / +0.2% 278171239 / 281187973 / -1.1% 0.87 / 0.86 / +1.3%
tpcds_q25/datafusion:parquet 143040383 / 146800318 / -2.6% 180440354 / 180616006 / -0.1% 0.79 / 0.81 / -2.5%
tpcds_q26/datafusion:parquet 55032963 / 54148782 / +1.6% 79270091 / 75848547 / +4.5% 0.69 / 0.71 / -2.8%
tpcds_q27/datafusion:parquet 205041352 / 208336195 / -1.6% 247337765 / 238625229 / +3.7% 0.83 / 0.87 / -5.0%
tpcds_q28/datafusion:parquet 85581542 / 86547458 / -1.1% 119980954 / 120457880 / -0.4% 0.71 / 0.72 / -0.7%
tpcds_q29/datafusion:parquet 142124606 / 143005652 / -0.6% 172034943 / 178231069 / -3.5% 0.83 / 0.80 / +3.0%
tpcds_q30/datafusion:parquet 99785936 / 98229078 / +1.6% 123106303 / 117318912 / +4.9% 0.81 / 0.84 / -3.2%
tpcds_q31/datafusion:parquet 317387746 / 320952070 / -1.1% 341190698 / 345508609 / -1.2% 0.93 / 0.93 / +0.1%
tpcds_q32/datafusion:parquet 28543486 / 29160666 / -2.1% 47043367 / 45158892 / +4.2% 0.61 / 0.65 / -6.0%
tpcds_q33/datafusion:parquet 51551010 / 52002410 / -0.9% 78691011 / 79151092 / -0.6% 0.66 / 0.66 / -0.3%
tpcds_q34/datafusion:parquet 63490816 / 62798475 / +1.1% 89113816 / 85312429 / +4.5% 0.71 / 0.74 / -3.2%
tpcds_q35/datafusion:parquet 125259779 / 125578030 / -0.3% 150221745 / 149348588 / +0.6% 0.83 / 0.84 / -0.8%
tpcds_q36/datafusion:parquet 99112436 / 97046300 / +2.1% 128044013 / 129843327 / -1.4% 0.77 / 0.75 / +3.6%
tpcds_q37/datafusion:parquet 49977818 / 50938078 / -1.9% 63956832 / 66850311 / -4.3% 0.78 / 0.76 / +2.6%
tpcds_q38/datafusion:parquet 121727425 / 124750105 / -2.4% 143564777 / 144886758 / -0.9% 0.85 / 0.86 / -1.5%
tpcds_q39/datafusion:parquet 853030499 / 848310958 / +0.6% 861156772 / 860496418 / +0.1% 0.99 / 0.99 / +0.5%
tpcds_q40/datafusion:parquet 35311324 / 34511162 / +2.3% 55374962 / 54318707 / +1.9% 0.64 / 0.64 / +0.4%
tpcds_q41/datafusion:parquet 32006418 / 32119582 / -0.4% 43384644 / 42001931 / +3.3% 0.74 / 0.76 / -3.5%
tpcds_q42/datafusion:parquet 25860754 / 26142956 / -1.1% 42937673 / 44480433 / -3.5% 0.60 / 0.59 / +2.5%
tpcds_q43/datafusion:parquet 26749553 / 27373340 / -2.3% 50580966 / 47682327 / +6.1% 0.53 / 0.57 / -7.9%
tpcds_q44/datafusion:parquet 64454202 / 63014467 / +2.3% 89287640 / 89936874 / -0.7% 0.72 / 0.70 / +3.0%
tpcds_q45/datafusion:parquet 65964408 / 64781248 / +1.8% 89732258 / 86919199 / +3.2% 0.74 / 0.75 / -1.4%
tpcds_q46/datafusion:parquet 107502965 / 108392884 / -0.8% 141902804 / 148499326 / -4.4% 0.76 / 0.73 / +3.8%
tpcds_q47/datafusion:parquet 235989937 / 236908989 / -0.4% 276186757 / 277078322 / -0.3% 0.85 / 0.86 / -0.1%
tpcds_q48/datafusion:parquet 77891618 / 78487499 / -0.8% 103742567 / 102811010 / +0.9% 0.75 / 0.76 / -1.7%
tpcds_q49/datafusion:parquet 115301969 / 118379296 / -2.6% 166705921 / 164458591 / +1.4% 0.69 / 0.72 / -3.9%
tpcds_q50/datafusion:parquet 87367220 / 89104718 / -1.9% 119683037 / 119986080 / -0.3% 0.73 / 0.74 / -1.7%
tpcds_q51/datafusion:parquet 256678446 / 257579898 / -0.3% 280150399 / 280384537 / -0.1% 0.92 / 0.92 / -0.3%
tpcds_q52/datafusion:parquet 27039876 / 26545714 / +1.9% 43963965 / 47273361 / -7.0% 0.62 / 0.56 / +9.5%
tpcds_q53/datafusion:parquet 36069014 / 36638894 / -1.6% 57938447 / 58956825 / -1.7% 0.62 / 0.62 / +0.2%
tpcds_q54/datafusion:parquet 85241610 / 86750682 / -1.7% 106844006 / 110160104 / -3.0% 0.80 / 0.79 / +1.3%
tpcds_q55/datafusion:parquet 25195538 / 25791099 / -2.3% 45790950 / 45530545 / +0.6% 0.55 / 0.57 / -2.9%
tpcds_q56/datafusion:parquet 53011432 / 54687636 / -3.1% 79416772 / 78233157 / +1.5% 0.67 / 0.70 / -4.5%
tpcds_q57/datafusion:parquet 169981851 / 171244916 / -0.7% 193185556 / 196898468 / -1.9% 0.88 / 0.87 / +1.2%
tpcds_q58/datafusion:parquet 97832754 / 96909425 / +1.0% 116139085 / 123947453 / -6.3% 0.84 / 0.78 / +7.7%
tpcds_q59/datafusion:parquet 104813580 / 105018246 / -0.2% 133420970 / 128199115 / +4.1% 0.79 / 0.82 / -4.1%
tpcds_q60/datafusion:parquet 54694465 / 56465845 / -3.1% 74658286 / 75853298 / -1.6% 0.73 / 0.74 / -1.6%
tpcds_q61/datafusion:parquet 73111908 / 76622612 / -4.6% 107534307 / 103205705 / +4.2% 0.68 / 0.74 / -8.4%
tpcds_q62/datafusion:parquet 28015235 / 27876800 / +0.5% 44775500 / 45702298 / -2.0% 0.63 / 0.61 / +2.6%
tpcds_q63/datafusion:parquet 37210895 / 36510728 / +1.9% 58152836 / 58079669 / +0.1% 0.64 / 0.63 / +1.8%
tpcds_q64/datafusion:parquet 659953772 / 664420437 / -0.7% 735284895 / 737958614 / -0.4% 0.90 / 0.90 / -0.3%
tpcds_q65/datafusion:parquet 102483798 / 101847641 / +0.6% 138321191 / 133915415 / +3.3% 0.74 / 0.76 / -2.6%
tpcds_q66/datafusion:parquet 78183646 / 76803718 / +1.8% 101755660 / 105753543 / -3.8% 0.77 / 0.73 / +5.8%
tpcds_q67/datafusion:parquet 431554142 / 434721568 / -0.7% 495943599 / 501029311 / -1.0% 0.87 / 0.87 / +0.3%
tpcds_q68/datafusion:parquet 110138600 / 110041542 / +0.1% 153491154 / 153226660 / +0.2% 0.72 / 0.72 / -0.1%
tpcds_q69/datafusion:parquet 60781372 / 59064698 / +2.9% 82786578 / 83449212 / -0.8% 0.73 / 0.71 / +3.7%
tpcds_q70/datafusion:parquet 212773026 / 211872569 / +0.4% 245945587 / 238366060 / +3.2% 0.87 / 0.89 / -2.7%
tpcds_q71/datafusion:parquet 38937070 / 41297478 / -5.7% 64017687 / 64481143 / -0.7% 0.61 / 0.64 / -5.0%
tpcds_q72/datafusion:parquet 1875956812 / 1795367720 / +4.5% 1755618149 / 1950759373 / -10.0% 🟢 1.07 / 0.92 / +16.1%
tpcds_q73/datafusion:parquet 63092303 / 62195792 / +1.4% 84922946 / 85097078 / -0.2% 0.74 / 0.73 / +1.6%
tpcds_q74/datafusion:parquet 292060108 / 291027466 / +0.4% 322609896 / 326771219 / -1.3% 0.91 / 0.89 / +1.6%
tpcds_q75/datafusion:parquet 190662076 / 193561364 / -1.5% 233029967 / 234435906 / -0.6% 0.82 / 0.83 / -0.9%
tpcds_q76/datafusion:parquet 49704522 / 51204166 / -2.9% 81960354 / 81362514 / +0.7% 0.61 / 0.63 / -3.6%
tpcds_q77/datafusion:parquet 72682374 / 71755258 / +1.3% 99758279 / 105602204 / -5.5% 0.73 / 0.68 / +7.2%
tpcds_q78/datafusion:parquet 210489604 / 208642228 / +0.9% 260985084 / 272279967 / -4.1% 0.81 / 0.77 / +5.3%
tpcds_q79/datafusion:parquet 76794030 / 77956684 / -1.5% 110995288 / 120708859 / -8.0% 0.69 / 0.65 / +7.1%
tpcds_q80/datafusion:parquet 142070674 / 143005116 / -0.7% 188649534 / 195144465 / -3.3% 0.75 / 0.73 / +2.8%
tpcds_q81/datafusion:parquet 108071628 / 108795594 / -0.7% 128617793 / 128373713 / +0.2% 0.84 / 0.85 / -0.9%
tpcds_q82/datafusion:parquet 54460122 / 55279135 / -1.5% 72241953 / 72677468 / -0.6% 0.75 / 0.76 / -0.9%
tpcds_q83/datafusion:parquet 65842792 / 67817574 / -2.9% 82100181 / 81824833 / +0.3% 0.80 / 0.83 / -3.2%
tpcds_q84/datafusion:parquet 36010769 / 35810379 / +0.6% 49603382 / 50528896 / -1.8% 0.73 / 0.71 / +2.4%
tpcds_q85/datafusion:parquet 106632422 / 107019062 / -0.4% 128370104 / 131166184 / -2.1% 0.83 / 0.82 / +1.8%
tpcds_q86/datafusion:parquet 21981409 / 22103540 / -0.6% 38420183 / 38828962 / -1.1% 0.57 / 0.57 / +0.5%
tpcds_q87/datafusion:parquet 123423053 / 120847894 / +2.1% 146724157 / 148255100 / -1.0% 0.84 / 0.82 / +3.2%
tpcds_q88/datafusion:parquet 87122536 / 86828018 / +0.3% 106662057 / 111599077 / -4.4% 0.82 / 0.78 / +5.0%
tpcds_q89/datafusion:parquet 39303083 / 38257166 / +2.7% 63611616 / 62673124 / +1.5% 0.62 / 0.61 / +1.2%
tpcds_q90/datafusion:parquet 18023576 / 17022038 / +5.9% 34254384 / 33690463 / +1.7% 0.53 / 0.51 / +4.1%
tpcds_q91/datafusion:parquet 43223118 / 42533351 / +1.6% 59380594 / 59734862 / -0.6% 0.73 / 0.71 / +2.2%
tpcds_q92/datafusion:parquet 26056916 / 28594032 / -8.9% 47761960 / 46261013 / +3.2% 0.55 / 0.62 / -11.7%
tpcds_q93/datafusion:parquet 62518599 / 62702664 / -0.3% 93584628 / 90515073 / +3.4% 0.67 / 0.69 / -3.6%
tpcds_q94/datafusion:parquet 38759390 / 38062305 / +1.8% 57876541 / 58446938 / -1.0% 0.67 / 0.65 / +2.8%
tpcds_q95/datafusion:parquet 125341364 / 131329407 / -4.6% 149968560 / 148723693 / +0.8% 0.84 / 0.88 / -5.4%
tpcds_q96/datafusion:parquet 20552283 / 20593587 / -0.2% 36833835 / 37115414 / -0.8% 0.56 / 0.55 / +0.6%
tpcds_q97/datafusion:parquet 54599854 / 55405724 / -1.5% 79402221 / 80097501 / -0.9% 0.69 / 0.69 / -0.6%
tpcds_q98/datafusion:parquet 60705884 / 61040399 / -0.5% 83963186 / 85381718 / -1.7% 0.72 / 0.71 / +1.1%
tpcds_q99/datafusion:parquet 42532863 / 43092346 / -1.3% 58091889 / 57613584 / +0.8% 0.73 / 0.75 / -2.1%
duckdb / vortex-file-compressed / ns (0.997x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 32899089 / 32649161 / +0.8% 44539911 / 44789208 / -0.6% 0.74 / 0.73 / +1.3%
tpcds_q02/duckdb:vortex-file-compressed 30611698 / 30423664 / +0.6% 42592611 / 42520304 / +0.2% 0.72 / 0.72 / +0.4%
tpcds_q03/duckdb:vortex-file-compressed 13907255 / 13590860 / +2.3% 29653555 / 30335530 / -2.2% 0.47 / 0.45 / +4.7%
tpcds_q04/duckdb:vortex-file-compressed 129394748 / 128383050 / +0.8% 147036173 / 157395726 / -6.6% 0.88 / 0.82 / +7.9%
tpcds_q05/duckdb:vortex-file-compressed 54893222 / 55288226 / -0.7% 74908467 / 81568338 / -8.2% 0.73 / 0.68 / +8.1%
tpcds_q06/duckdb:vortex-file-compressed 58754799 / 59001563 / -0.4% 77594899 / 79837810 / -2.8% 0.76 / 0.74 / +2.5%
tpcds_q07/duckdb:vortex-file-compressed 30830385 / 32095806 / -3.9% 50230652 / 51070613 / -1.6% 0.61 / 0.63 / -2.3%
tpcds_q08/duckdb:vortex-file-compressed 31282988 / 31458886 / -0.6% 40354052 / 42099528 / -4.1% 0.78 / 0.75 / +3.7%
tpcds_q09/duckdb:vortex-file-compressed 56855657 / 56009181 / +1.5% 76422424 / 78910775 / -3.2% 0.74 / 0.71 / +4.8%
tpcds_q10/duckdb:vortex-file-compressed 39874154 / 39645874 / +0.6% 58226835 / 60180533 / -3.2% 0.68 / 0.66 / +4.0%
tpcds_q11/duckdb:vortex-file-compressed 95251184 / 95918340 / -0.7% 110003133 / 114279048 / -3.7% 0.87 / 0.84 / +3.2%
tpcds_q12/duckdb:vortex-file-compressed 17763808 / 18182872 / -2.3% 30182696 / 30075089 / +0.4% 0.59 / 0.60 / -2.7%
tpcds_q13/duckdb:vortex-file-compressed 38978208 / 37998502 / +2.6% 70686486 / 72503140 / -2.5% 0.55 / 0.52 / +5.2%
tpcds_q14/duckdb:vortex-file-compressed 119280285 / 118568982 / +0.6% 135568831 / 143268266 / -5.4% 0.88 / 0.83 / +6.3%
tpcds_q15/duckdb:vortex-file-compressed 58502813 / 61361960 / -4.7% 72650592 / 74388125 / -2.3% 0.81 / 0.82 / -2.4%
tpcds_q16/duckdb:vortex-file-compressed 34764998 / 34167260 / +1.7% 52654143 / 54131778 / -2.7% 0.66 / 0.63 / +4.6%
tpcds_q17/duckdb:vortex-file-compressed 57674476 / 57899192 / -0.4% 78151057 / 79208228 / -1.3% 0.74 / 0.73 / +1.0%
tpcds_q18/duckdb:vortex-file-compressed 83417350 / 83598090 / -0.2% 102619480 / 103884736 / -1.2% 0.81 / 0.80 / +1.0%
tpcds_q19/duckdb:vortex-file-compressed 45128136 / 45640434 / -1.1% 62325127 / 63207162 / -1.4% 0.72 / 0.72 / +0.3%
tpcds_q20/duckdb:vortex-file-compressed 21794176 / 22445294 / -2.9% 36931485 / 37336047 / -1.1% 0.59 / 0.60 / -1.8%
tpcds_q21/duckdb:vortex-file-compressed 35512526 / 35765630 / -0.7% 63702056 / 68010899 / -6.3% 0.56 / 0.53 / +6.0%
tpcds_q22/duckdb:vortex-file-compressed 159615175 / 156461336 / +2.0% 172536595 / 181236416 / -4.8% 0.93 / 0.86 / +7.2%
tpcds_q23/duckdb:vortex-file-compressed 183310730 / 178971350 / +2.4% 197016620 / 203438181 / -3.2% 0.93 / 0.88 / +5.8%
tpcds_q24/duckdb:vortex-file-compressed 51975936 / 51890206 / +0.2% 72216664 / 77750871 / -7.1% 0.72 / 0.67 / +7.8%
tpcds_q25/duckdb:vortex-file-compressed 53277903 / 53555556 / -0.5% 74528697 / 75208747 / -0.9% 0.71 / 0.71 / +0.4%
tpcds_q26/duckdb:vortex-file-compressed 26214820 / 26937588 / -2.7% 42776795 / 41914070 / +2.1% 0.61 / 0.64 / -4.6%
tpcds_q27/duckdb:vortex-file-compressed 31407553 / 32081485 / -2.1% 52256642 / 53176343 / -1.7% 0.60 / 0.60 / -0.4%
tpcds_q28/duckdb:vortex-file-compressed 42099842 / 42876312 / -1.8% 64362159 / 64049157 / +0.5% 0.65 / 0.67 / -2.3%
tpcds_q29/duckdb:vortex-file-compressed 51901414 / 51763923 / +0.3% 71843151 / 76049605 / -5.5% 0.72 / 0.68 / +6.1%
tpcds_q30/duckdb:vortex-file-compressed 38113431 / 38058142 / +0.1% 50339700 / 51557352 / -2.4% 0.76 / 0.74 / +2.6%
tpcds_q31/duckdb:vortex-file-compressed 38218139 / 38347752 / -0.3% 52493822 / 53868018 / -2.6% 0.73 / 0.71 / +2.3%
tpcds_q32/duckdb:vortex-file-compressed 13856236 / 14247020 / -2.7% 29342498 / 29492921 / -0.5% 0.47 / 0.48 / -2.2%
tpcds_q33/duckdb:vortex-file-compressed 33888326 / 34548370 / -1.9% 57206585 / 58699932 / -2.5% 0.59 / 0.59 / +0.7%
tpcds_q34/duckdb:vortex-file-compressed 22382762 / 22312663 / +0.3% 38176575 / 39981414 / -4.5% 0.59 / 0.56 / +5.1%
tpcds_q35/duckdb:vortex-file-compressed 67744015 / 67698694 / +0.1% 86389845 / 90031230 / -4.0% 0.78 / 0.75 / +4.3%
tpcds_q36/duckdb:vortex-file-compressed 28395268 / 29064720 / -2.3% 46458880 / 48781034 / -4.8% 0.61 / 0.60 / +2.6%
tpcds_q37/duckdb:vortex-file-compressed 27588816 / 27807032 / -0.8% 63722479 / 74376894 / -14.3% 🟢 0.43 / 0.37 / +15.8%
tpcds_q38/duckdb:vortex-file-compressed 64679099 / 60058084 / +7.7% 75016460 / 76519461 / -2.0% 0.86 / 0.78 / +9.9%
tpcds_q39/duckdb:vortex-file-compressed 58019962 / 56793144 / +2.2% 86983565 / 87731445 / -0.9% 0.67 / 0.65 / +3.0%
tpcds_q40/duckdb:vortex-file-compressed 19107688 / 19122356 / -0.1% 34207247 / 35811362 / -4.5% 0.56 / 0.53 / +4.6%
tpcds_q41/duckdb:vortex-file-compressed 19493279 / 19792131 / -1.5% 26725468 / 26791305 / -0.2% 0.73 / 0.74 / -1.3%
tpcds_q42/duckdb:vortex-file-compressed 14321068 / 15022504 / -4.7% 30118445 / 30888747 / -2.5% 0.48 / 0.49 / -2.2%
tpcds_q43/duckdb:vortex-file-compressed 21024564 / 19006988 / +10.6% 🔴 35470034 / 34209365 / +3.7% 0.59 / 0.56 / +6.7%
tpcds_q44/duckdb:vortex-file-compressed 28069977 / 27941540 / +0.5% 47177069 / 50637183 / -6.8% 0.59 / 0.55 / +7.8%
tpcds_q45/duckdb:vortex-file-compressed 46408524 / 46293438 / +0.2% 60393814 / 59865366 / +0.9% 0.77 / 0.77 / -0.6%
tpcds_q46/duckdb:vortex-file-compressed 50288104 / 50628694 / -0.7% 78257906 / 79687415 / -1.8% 0.64 / 0.64 / +1.1%
tpcds_q47/duckdb:vortex-file-compressed 80344345 / 80287913 / +0.1% 95883711 / 96558662 / -0.7% 0.84 / 0.83 / +0.8%
tpcds_q48/duckdb:vortex-file-compressed 53957932 / 54126136 / -0.3% 77286661 / 80600634 / -4.1% 0.70 / 0.67 / +4.0%
tpcds_q49/duckdb:vortex-file-compressed 37985686 / 38844213 / -2.2% 76454860 / 80287889 / -4.8% 0.50 / 0.48 / +2.7%
tpcds_q50/duckdb:vortex-file-compressed 31225065 / 31215914 / +0.0% 51961989 / 56437439 / -7.9% 0.60 / 0.55 / +8.6%
tpcds_q51/duckdb:vortex-file-compressed 206763922 / 204034184 / +1.3% 216409413 / 222345267 / -2.7% 0.96 / 0.92 / +4.1%
tpcds_q52/duckdb:vortex-file-compressed 15100146 / 15554601 / -2.9% 29984084 / 31648667 / -5.3% 0.50 / 0.49 / +2.5%
tpcds_q53/duckdb:vortex-file-compressed 22552185 / 22637998 / -0.4% 38486994 / 40176770 / -4.2% 0.59 / 0.56 / +4.0%
tpcds_q54/duckdb:vortex-file-compressed 44656231 / 44787478 / -0.3% 64748414 / 65746506 / -1.5% 0.69 / 0.68 / +1.2%
tpcds_q55/duckdb:vortex-file-compressed 14586069 / 14679390 / -0.6% 29871167 / 32210278 / -7.3% 0.49 / 0.46 / +7.1%
tpcds_q56/duckdb:vortex-file-compressed 33931353 / 33555586 / +1.1% 55861262 / 58459218 / -4.4% 0.61 / 0.57 / +5.8%
tpcds_q57/duckdb:vortex-file-compressed 69636418 / 66134880 / +5.3% 77438561 / 78146102 / -0.9% 0.90 / 0.85 / +6.3%
tpcds_q58/duckdb:vortex-file-compressed 37949803 / 38211454 / -0.7% 59652077 / 60719574 / -1.8% 0.64 / 0.63 / +1.1%
tpcds_q59/duckdb:vortex-file-compressed 54898508 / 54204927 / +1.3% 67111354 / 64434108 / +4.2% 0.82 / 0.84 / -2.8%
tpcds_q60/duckdb:vortex-file-compressed 35596962 / 35949088 / -1.0% 57949260 / 58460172 / -0.9% 0.61 / 0.61 / -0.1%
tpcds_q61/duckdb:vortex-file-compressed 34959332 / 34904278 / +0.2% 53558629 / 54283470 / -1.3% 0.65 / 0.64 / +1.5%
tpcds_q62/duckdb:vortex-file-compressed 15193238 / 17092536 / -11.1% 🟢 27502383 / 27275489 / +0.8% 0.55 / 0.63 / -11.8%
tpcds_q63/duckdb:vortex-file-compressed 21176066 / 21686891 / -2.4% 37142924 / 38622401 / -3.8% 0.57 / 0.56 / +1.5%
tpcds_q64/duckdb:vortex-file-compressed 121174415 / 119003492 / +1.8% 153033005 / 150784580 / +1.5% 0.79 / 0.79 / +0.3%
tpcds_q65/duckdb:vortex-file-compressed 52914057 / 52511214 / +0.8% 59141074 / 69823104 / -15.3% 🟢 0.89 / 0.75 / +19.0%
tpcds_q66/duckdb:vortex-file-compressed 42151212 / 43392178 / -2.9% 56875775 / 58339240 / -2.5% 0.74 / 0.74 / -0.4%
tpcds_q67/duckdb:vortex-file-compressed 276709283 / 275117088 / +0.6% 283706478 / 289396757 / -2.0% 0.98 / 0.95 / +2.6%
tpcds_q68/duckdb:vortex-file-compressed 45749934 / 44987350 / +1.7% 69315391 / 72218405 / -4.0% 0.66 / 0.62 / +6.0%
tpcds_q69/duckdb:vortex-file-compressed 38872456 / 39143516 / -0.7% 58739412 / 61638508 / -4.7% 0.66 / 0.64 / +4.2%
tpcds_q70/duckdb:vortex-file-compressed 25142578 / 24865862 / +1.1% 40080740 / 41715867 / -3.9% 0.63 / 0.60 / +5.2%
tpcds_q71/duckdb:vortex-file-compressed 28474074 / 28778109 / -1.1% 51261438 / 55060225 / -6.9% 0.56 / 0.52 / +6.3%
tpcds_q72/duckdb:vortex-file-compressed 138440908 / 139371184 / -0.7% 158920804 / 162097963 / -2.0% 0.87 / 0.86 / +1.3%
tpcds_q73/duckdb:vortex-file-compressed 19905738 / 20027664 / -0.6% 35100241 / 36213267 / -3.1% 0.57 / 0.55 / +2.5%
tpcds_q74/duckdb:vortex-file-compressed 82985492 / 81699642 / +1.6% 100334276 / 103402403 / -3.0% 0.83 / 0.79 / +4.7%
tpcds_q75/duckdb:vortex-file-compressed 112718932 / 113909435 / -1.0% 135415155 / 145800035 / -7.1% 0.83 / 0.78 / +6.5%
tpcds_q76/duckdb:vortex-file-compressed 27899922 / 27781828 / +0.4% 53536395 / 59076374 / -9.4% 0.52 / 0.47 / +10.8%
tpcds_q77/duckdb:vortex-file-compressed 36443958 / 36691324 / -0.7% 58607501 / 62962769 / -6.9% 0.62 / 0.58 / +6.7%
tpcds_q78/duckdb:vortex-file-compressed 135653434 / 135509140 / +0.1% 158098443 / 159165325 / -0.7% 0.86 / 0.85 / +0.8%
tpcds_q79/duckdb:vortex-file-compressed 37834845 / 39005476 / -3.0% 59526275 / 62580379 / -4.9% 0.64 / 0.62 / +2.0%
tpcds_q80/duckdb:vortex-file-compressed 59317362 / 60078884 / -1.3% 89481358 / 97028310 / -7.8% 0.66 / 0.62 / +7.1%
tpcds_q81/duckdb:vortex-file-compressed 57132510 / 58915638 / -3.0% 69641345 / 70948594 / -1.8% 0.82 / 0.83 / -1.2%
tpcds_q82/duckdb:vortex-file-compressed 28783208 / 29293918 / -1.7% 65975020 / 77092383 / -14.4% 🟢 0.44 / 0.38 / +14.8%
tpcds_q83/duckdb:vortex-file-compressed 21755541 / 21519478 / +1.1% 31625780 / 31809013 / -0.6% 0.69 / 0.68 / +1.7%
tpcds_q84/duckdb:vortex-file-compressed 13557234 / 13662070 / -0.8% 24064142 / 24702011 / -2.6% 0.56 / 0.55 / +1.9%
tpcds_q85/duckdb:vortex-file-compressed 37515128 / 37052630 / +1.2% 53413715 / 54903169 / -2.7% 0.70 / 0.67 / +4.1%
tpcds_q86/duckdb:vortex-file-compressed 17300926 / 18009964 / -3.9% 28190779 / 29300697 / -3.8% 0.61 / 0.61 / -0.2%
tpcds_q87/duckdb:vortex-file-compressed 75037160 / 76787146 / -2.3% 91948567 / 93461680 / -1.6% 0.82 / 0.82 / -0.7%
tpcds_q88/duckdb:vortex-file-compressed 38023383 / 37821778 / +0.5% 49189336 / 49758693 / -1.1% 0.77 / 0.76 / +1.7%
tpcds_q89/duckdb:vortex-file-compressed 25489668 / 24543846 / +3.9% 40748751 / 40013884 / +1.8% 0.63 / 0.61 / +2.0%
tpcds_q90/duckdb:vortex-file-compressed 10090166 / 9836758 / +2.6% 21062518 / 21458206 / -1.8% 0.48 / 0.46 / +4.5%
tpcds_q91/duckdb:vortex-file-compressed 19344973 / 19368482 / -0.1% 28899264 / 29486456 / -2.0% 0.67 / 0.66 / +1.9%
tpcds_q92/duckdb:vortex-file-compressed 13513806 / 13547714 / -0.3% 26904017 / 28163469 / -4.5% 0.50 / 0.48 / +4.4%
tpcds_q93/duckdb:vortex-file-compressed 24999146 / 25407275 / -1.6% 48875471 / 52152359 / -6.3% 0.51 / 0.49 / +5.0%
tpcds_q94/duckdb:vortex-file-compressed 32441612 / 32162958 / +0.9% 47039375 / 46966112 / +0.2% 0.69 / 0.68 / +0.7%
tpcds_q95/duckdb:vortex-file-compressed 95362800 / 93802490 / +1.7% 105462470 / 105065267 / +0.4% 0.90 / 0.89 / +1.3%
tpcds_q96/duckdb:vortex-file-compressed 11628784 / 11985622 / -3.0% 23881098 / 24313003 / -1.8% 0.49 / 0.49 / -1.2%
tpcds_q97/duckdb:vortex-file-compressed 61228112 / 61570952 / -0.6% 81812122 / 81989575 / -0.2% 0.75 / 0.75 / -0.3%
tpcds_q98/duckdb:vortex-file-compressed 27102129 / 27435489 / -1.2% 42652790 / 43626941 / -2.2% 0.64 / 0.63 / +1.0%
tpcds_q99/duckdb:vortex-file-compressed 20325526 / 20170245 / +0.8% 39897610 / 35867892 / +11.2% 🔴 0.51 / 0.56 / -9.4%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 42969112 / 43672127 / -1.6% 49974543 / 49946105 / +0.1% 0.86 / 0.87 / -1.7%
tpcds_q02/duckdb:parquet 39148042 / 38543272 / +1.6% 47128966 / 47718948 / -1.2% 0.83 / 0.81 / +2.8%
tpcds_q03/duckdb:parquet 25477181 / 26001292 / -2.0% 36036100 / 35061243 / +2.8% 0.71 / 0.74 / -4.7%
tpcds_q04/duckdb:parquet 205212262 / 203667951 / +0.8% 227036892 / 242679593 / -6.4% 0.90 / 0.84 / +7.7%
tpcds_q05/duckdb:parquet 68402599 / 69674650 / -1.8% 82870017 / 86841319 / -4.6% 0.83 / 0.80 / +2.9%
tpcds_q06/duckdb:parquet 75214365 / 74224672 / +1.3% 86418382 / 91034658 / -5.1% 0.87 / 0.82 / +6.7%
tpcds_q07/duckdb:parquet 59761748 / 62326315 / -4.1% 78258121 / 78292100 / -0.0% 0.76 / 0.80 / -4.1%
tpcds_q08/duckdb:parquet 38303090 / 38454318 / -0.4% 44935563 / 47862047 / -6.1% 0.85 / 0.80 / +6.1%
tpcds_q09/duckdb:parquet 86311652 / 86792638 / -0.6% 100271349 / 101908503 / -1.6% 0.86 / 0.85 / +1.1%
tpcds_q10/duckdb:parquet 53051506 / 52792035 / +0.5% 60019265 / 62028926 / -3.2% 0.88 / 0.85 / +3.9%
tpcds_q11/duckdb:parquet 158666702 / 158519060 / +0.1% 169831189 / 169378939 / +0.3% 0.93 / 0.94 / -0.2%
tpcds_q12/duckdb:parquet 40618387 / 40893861 / -0.7% 47373429 / 48901953 / -3.1% 0.86 / 0.84 / +2.5%
tpcds_q13/duckdb:parquet 71254757 / 69239838 / +2.9% 86495854 / 88434085 / -2.2% 0.82 / 0.78 / +5.2%
tpcds_q14/duckdb:parquet 187967298 / 185251318 / +1.5% 199579556 / 196973220 / +1.3% 0.94 / 0.94 / +0.1%
tpcds_q15/duckdb:parquet 60676488 / 60837063 / -0.3% 68208857 / 69607297 / -2.0% 0.89 / 0.87 / +1.8%
tpcds_q16/duckdb:parquet 37808612 / 37864567 / -0.1% 45926381 / 46602970 / -1.5% 0.82 / 0.81 / +1.3%
tpcds_q17/duckdb:parquet 83458596 / 82892544 / +0.7% 89379925 / 90149000 / -0.9% 0.93 / 0.92 / +1.5%
tpcds_q18/duckdb:parquet 87517771 / 88994379 / -1.7% 95883705 / 96647845 / -0.8% 0.91 / 0.92 / -0.9%
tpcds_q19/duckdb:parquet 48234370 / 48373274 / -0.3% 62817981 / 61796703 / +1.7% 0.77 / 0.78 / -1.9%
tpcds_q20/duckdb:parquet 41172420 / 41678346 / -1.2% 50869633 / 53498621 / -4.9% 0.81 / 0.78 / +3.9%
tpcds_q21/duckdb:parquet 24203692 / 23993618 / +0.9% 28078240 / 30909689 / -9.2% 0.86 / 0.78 / +11.0%
tpcds_q22/duckdb:parquet 164374980 / 162813396 / +1.0% 166836270 / 163131042 / +2.3% 0.99 / 1.00 / -1.3%
tpcds_q23/duckdb:parquet 185207248 / 185224357 / -0.0% 198131383 / 193784951 / +2.2% 0.93 / 0.96 / -2.2%
tpcds_q24/duckdb:parquet 71164492 / 72484654 / -1.8% 84466497 / 86262953 / -2.1% 0.84 / 0.84 / +0.3%
tpcds_q25/duckdb:parquet 50919104 / 51931712 / -1.9% 58725275 / 59857795 / -1.9% 0.87 / 0.87 / -0.1%
tpcds_q26/duckdb:parquet 42222789 / 43130537 / -2.1% 52592001 / 52411306 / +0.3% 0.80 / 0.82 / -2.4%
tpcds_q27/duckdb:parquet 58077852 / 57476989 / +1.0% 74047850 / 71010855 / +4.3% 0.78 / 0.81 / -3.1%
tpcds_q28/duckdb:parquet 97425308 / 93503197 / +4.2% 113181444 / 113244159 / -0.1% 0.86 / 0.83 / +4.3%
tpcds_q29/duckdb:parquet 85260505 / 84930993 / +0.4% 96504751 / 100610580 / -4.1% 0.88 / 0.84 / +4.7%
tpcds_q30/duckdb:parquet 71876508 / 73012000 / -1.6% 79264388 / 81493939 / -2.7% 0.91 / 0.90 / +1.2%
tpcds_q31/duckdb:parquet 98387748 / 99188302 / -0.8% 112651421 / 114163125 / -1.3% 0.87 / 0.87 / +0.5%
tpcds_q32/duckdb:parquet 18144126 / 18208498 / -0.4% 26016106 / 26500900 / -1.8% 0.70 / 0.69 / +1.5%
tpcds_q33/duckdb:parquet 60916472 / 62168494 / -2.0% 73631489 / 77126858 / -4.5% 0.83 / 0.81 / +2.6%
tpcds_q34/duckdb:parquet 33423709 / 33577655 / -0.5% 39951262 / 43107212 / -7.3% 0.84 / 0.78 / +7.4%
tpcds_q35/duckdb:parquet 76487408 / 76299458 / +0.2% 89032065 / 89890415 / -1.0% 0.86 / 0.85 / +1.2%
tpcds_q36/duckdb:parquet 98543346 / 97695308 / +0.9% 112048162 / 114135542 / -1.8% 0.88 / 0.86 / +2.7%
tpcds_q37/duckdb:parquet 40951050 / 40644198 / +0.8% 46411729 / 46072411 / +0.7% 0.88 / 0.88 / +0.0%
tpcds_q38/duckdb:parquet 75247915 / 75258045 / -0.0% 82313611 / 81507326 / +1.0% 0.91 / 0.92 / -1.0%
tpcds_q39/duckdb:parquet 61422860 / 62020654 / -1.0% 66923781 / 67868999 / -1.4% 0.92 / 0.91 / +0.4%
tpcds_q40/duckdb:parquet 28014934 / 27918050 / +0.3% 35674300 / 36039300 / -1.0% 0.79 / 0.77 / +1.4%
tpcds_q41/duckdb:parquet 20416213 / 20485717 / -0.3% 26194732 / 27162895 / -3.6% 0.78 / 0.75 / +3.3%
tpcds_q42/duckdb:parquet 26596790 / 26198044 / +1.5% 37856404 / 38175797 / -0.8% 0.70 / 0.69 / +2.4%
tpcds_q43/duckdb:parquet 26954518 / 26832770 / +0.5% 36120599 / 35154293 / +2.7% 0.75 / 0.76 / -2.2%
tpcds_q44/duckdb:parquet 60453023 / 62346229 / -3.0% 72483008 / 78327327 / -7.5% 0.83 / 0.80 / +4.8%
tpcds_q45/duckdb:parquet 61723531 / 60901849 / +1.3% 68154795 / 68908814 / -1.1% 0.91 / 0.88 / +2.5%
tpcds_q46/duckdb:parquet 72775172 / 74697137 / -2.6% 83010571 / 86490190 / -4.0% 0.88 / 0.86 / +1.5%
tpcds_q47/duckdb:parquet 91526914 / 91782160 / -0.3% 106033782 / 103045705 / +2.9% 0.86 / 0.89 / -3.1%
tpcds_q48/duckdb:parquet 67527021 / 66620952 / +1.4% 75827255 / 79292916 / -4.4% 0.89 / 0.84 / +6.0%
tpcds_q49/duckdb:parquet 71130141 / 68874757 / +3.3% 91424219 / 87845625 / +4.1% 0.78 / 0.78 / -0.8%
tpcds_q50/duckdb:parquet 44006614 / 45098860 / -2.4% 52030209 / 55187015 / -5.7% 0.85 / 0.82 / +3.5%
tpcds_q51/duckdb:parquet 219446308 / 220166087 / -0.3% 226213344 / 226855008 / -0.3% 0.97 / 0.97 / -0.0%
tpcds_q52/duckdb:parquet 26559340 / 27139323 / -2.1% 37888328 / 36420150 / +4.0% 0.70 / 0.75 / -5.9%
tpcds_q53/duckdb:parquet 34343098 / 35177599 / -2.4% 45236009 / 48564852 / -6.9% 0.76 / 0.72 / +4.8%
tpcds_q54/duckdb:parquet 55923512 / 55351108 / +1.0% 62903776 / 64068267 / -1.8% 0.89 / 0.86 / +2.9%
tpcds_q55/duckdb:parquet 27108198 / 26836629 / +1.0% 37266297 / 35903415 / +3.8% 0.73 / 0.75 / -2.7%
tpcds_q56/duckdb:parquet 68008443 / 68392112 / -0.6% 81526469 / 79843816 / +2.1% 0.83 / 0.86 / -2.6%
tpcds_q57/duckdb:parquet 68222739 / 67661526 / +0.8% 74613412 / 75637972 / -1.4% 0.91 / 0.89 / +2.2%
tpcds_q58/duckdb:parquet 55103704 / 54569324 / +1.0% 68244462 / 70703423 / -3.5% 0.81 / 0.77 / +4.6%
tpcds_q59/duckdb:parquet 60731554 / 61545311 / -1.3% 66225464 / 68063050 / -2.7% 0.92 / 0.90 / +1.4%
tpcds_q60/duckdb:parquet 83313380 / 82960530 / +0.4% 92839311 / 96675940 / -4.0% 0.90 / 0.86 / +4.6%
tpcds_q61/duckdb:parquet 81624402 / 80971202 / +0.8% 94620604 / 92492955 / +2.3% 0.86 / 0.88 / -1.5%
tpcds_q62/duckdb:parquet 19824750 / 19172324 / +3.4% 27390567 / 24843714 / +10.3% 🔴 0.72 / 0.77 / -6.2%
tpcds_q63/duckdb:parquet 34848279 / 34811048 / +0.1% 43826609 / 44597298 / -1.7% 0.80 / 0.78 / +1.9%
tpcds_q64/duckdb:parquet 134275083 / 136862687 / -1.9% 154986179 / 156904445 / -1.2% 0.87 / 0.87 / -0.7%
tpcds_q65/duckdb:parquet 91433706 / 97397838 / -6.1% 91832894 / 105764039 / -13.2% 🟢 1.00 / 0.92 / +8.1%
tpcds_q66/duckdb:parquet 47735612 / 46915606 / +1.7% 52366596 / 53303744 / -1.8% 0.91 / 0.88 / +3.6%
tpcds_q67/duckdb:parquet 296320552 / 296366859 / -0.0% 290755869 / 306360543 / -5.1% 1.02 / 0.97 / +5.4%
tpcds_q68/duckdb:parquet 61692207 / 62295342 / -1.0% 82049388 / 83016154 / -1.2% 0.75 / 0.75 / +0.2%
tpcds_q69/duckdb:parquet 66051970 / 65940903 / +0.2% 77613997 / 76148989 / +1.9% 0.85 / 0.87 / -1.7%
tpcds_q70/duckdb:parquet 40600813 / 41911038 / -3.1% 54859233 / 54101569 / +1.4% 0.74 / 0.77 / -4.5%
tpcds_q71/duckdb:parquet 40534200 / 41258068 / -1.8% 52230856 / 57489063 / -9.1% 0.78 / 0.72 / +8.1%
tpcds_q72/duckdb:parquet 174127539 / 173016211 / +0.6% 184741718 / 185138404 / -0.2% 0.94 / 0.93 / +0.9%
tpcds_q73/duckdb:parquet 28377856 / 27690827 / +2.5% 35737506 / 36894171 / -3.1% 0.79 / 0.75 / +5.8%
tpcds_q74/duckdb:parquet 214924690 / 213942386 / +0.5% 221855456 / 226386510 / -2.0% 0.97 / 0.95 / +2.5%
tpcds_q75/duckdb:parquet 132774329 / 133919556 / -0.9% 148879564 / 152250277 / -2.2% 0.89 / 0.88 / +1.4%
tpcds_q76/duckdb:parquet 51698910 / 53069834 / -2.6% 69329121 / 66081981 / +4.9% 0.75 / 0.80 / -7.1%
tpcds_q77/duckdb:parquet 54707568 / 54106475 / +1.1% 74127412 / 74392362 / -0.4% 0.74 / 0.73 / +1.5%
tpcds_q78/duckdb:parquet 144236698 / 152080286 / -5.2% 157153408 / 159261882 / -1.3% 0.92 / 0.95 / -3.9%
tpcds_q79/duckdb:parquet 53554666 / 54311893 / -1.4% 64001381 / 67953490 / -5.8% 0.84 / 0.80 / +4.7%
tpcds_q80/duckdb:parquet 83820606 / 85248048 / -1.7% 98615429 / 104457525 / -5.6% 0.85 / 0.82 / +4.2%
tpcds_q81/duckdb:parquet 97053545 / 99775931 / -2.7% 106070490 / 106720509 / -0.6% 0.91 / 0.93 / -2.1%
tpcds_q82/duckdb:parquet 46216148 / 45557462 / +1.4% 54310142 / 55574538 / -2.3% 0.85 / 0.82 / +3.8%
tpcds_q83/duckdb:parquet 28158416 / 27987126 / +0.6% 33012405 / 32981908 / +0.1% 0.85 / 0.85 / +0.5%
tpcds_q84/duckdb:parquet 22954918 / 22752838 / +0.9% 28569966 / 29485165 / -3.1% 0.80 / 0.77 / +4.1%
tpcds_q85/duckdb:parquet 51792227 / 51746082 / +0.1% 63249608 / 63492383 / -0.4% 0.82 / 0.81 / +0.5%
tpcds_q86/duckdb:parquet 24963080 / 24256036 / +2.9% 30790713 / 33328857 / -7.6% 0.81 / 0.73 / +11.4%
tpcds_q87/duckdb:parquet 88668720 / 88585668 / +0.1% 93880394 / 93609406 / +0.3% 0.94 / 0.95 / -0.2%
tpcds_q88/duckdb:parquet 103400866 / 105099690 / -1.6% 116309229 / 110378728 / +5.4% 0.89 / 0.95 / -6.6%
tpcds_q89/duckdb:parquet 35598726 / 37917604 / -6.1% 44746291 / 53200142 / -15.9% 🟢 0.80 / 0.71 / +11.6%
tpcds_q90/duckdb:parquet 14837694 / 15341714 / -3.3% 20696498 / 20207499 / +2.4% 0.72 / 0.76 / -5.6%
tpcds_q91/duckdb:parquet 25705554 / 25789970 / -0.3% 32355409 / 33623558 / -3.8% 0.79 / 0.77 / +3.6%
tpcds_q92/duckdb:parquet 22086636 / 21975066 / +0.5% 31573151 / 30271423 / +4.3% 0.70 / 0.73 / -3.6%
tpcds_q93/duckdb:parquet 36835594 / 37260601 / -1.1% 49510992 / 48687225 / +1.7% 0.74 / 0.77 / -2.8%
tpcds_q94/duckdb:parquet 38288486 / 38535142 / -0.6% 45946664 / 47069644 / -2.4% 0.83 / 0.82 / +1.8%
tpcds_q95/duckdb:parquet 81777806 / 81908658 / -0.2% 87030591 / 87129027 / -0.1% 0.94 / 0.94 / -0.0%
tpcds_q96/duckdb:parquet 17739700 / 17113918 / +3.7% 24793313 / 24360406 / +1.8% 0.72 / 0.70 / +1.8%
tpcds_q97/duckdb:parquet 71319662 / 72305960 / -1.4% 79805464 / 83264735 / -4.2% 0.89 / 0.87 / +2.9%
tpcds_q98/duckdb:parquet 54571088 / 54675560 / -0.2% 65606598 / 70708001 / -7.2% 0.83 / 0.77 / +7.6%
tpcds_q99/duckdb:parquet 26261840 / 24200074 / +8.5% 31627081 / 32336992 / -2.2% 0.83 / 0.75 / +11.0%

No file size changes detected.

Copy link
Copy Markdown
Contributor Author

End-to-end benchmarks

These are CI runs against develop. The #10452 column is this PR at 43742ab. The #11473 column is that PR at 30e4427: I pointed it at develop for this run, so it carries both PRs' changes. Every suite came back with a no clear signal verdict.

Suite #10452 #11473 (both PRs)
PolarSignals 0.991x 0.993x
FineWeb NVMe −3.4% −1.2%
TPC-H SF=1 NVMe −0.3% −0.2%
TPC-H SF=10 NVMe +0.1% −0.1%
TPC-DS SF=1 NVMe −0.1% +0.0%
TPC-DS SF=10 NVMe +0.1% +0.5%
ClickBench NVMe −0.1% +0.5%
TPC-H SF=1 S3 +0.3% −0.8%
Random Access +0.9% +1.9%

PolarSignals is the hot geomean ratio. The other rows are the benchmark's attributed Vortex impact.

That's expected. Scans and take decode RunEnd and patched arrays in bulk, and outside the search-sorted adapters, no production path calls repeated_probe(). So the patched_search microbenchmark wins only show up for callers that do many point reads or searches against a compressed sorted child. These runs show that neither PR regresses the end-to-end suites.


Generated by Claude Code

@robert3005
robert3005 enabled auto-merge (squash) November 15, 2026 15:24
@robert3005
robert3005 merged commit ac6c3a0 into develop Nov 15, 2026
147 of 149 checks passed
@robert3005
robert3005 deleted the ji/adoring-brown-55sw7y branch November 15, 2026 15:25
joseph-isaacs added a commit that referenced this pull request Nov 15, 2026
…robes

#10452 merged, so this keeps only this PR's own change on
top of develop.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Jck72aD351kMboqN5g8Ccs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants