Skip to content

CI: run each benchmark query in a separate process - #9385

Open
myrrc wants to merge 1 commit into
developfrom
myrrc/bench-process-per-query
Open

CI: run each benchmark query in a separate process#9385
myrrc wants to merge 1 commit into
developfrom
myrrc/bench-process-per-query

CI: run each benchmark query in a separate process

eac735c
Select commit
Loading
Failed to load commit list.
CodSpeed HQ / CodSpeed Performance Analysis failed Aug 12, 2026 in 0s

Performance Regression: -20.38%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

❌ 2 regressed benchmarks
✅ 1980 untouched benchmarks
🆕 12 new benchmarks
⏩ 89 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation decompress[u64, (10000, 4)] 310.1 µs 403.3 µs -23.12%
❌ Simulation cold_misaligned[(64, 256)] 4.4 ms 5.3 ms -17.53%
🆕 WallTime words_gather_dispatch[1024] N/A 7 ns N/A
🆕 WallTime words_gather_dispatch[65536] N/A 1.3 µs N/A
🆕 WallTime words_gather_scalar[1024] N/A 100 ns N/A
🆕 WallTime words_gather_scalar[65536] N/A 6.4 µs N/A
🆕 WallTime words_gather_dispatch[1024] N/A 17 ns N/A
🆕 WallTime words_gather_dispatch[65536] N/A 1.3 µs N/A
🆕 WallTime words_gather_scalar[1024] N/A 147 ns N/A
🆕 WallTime words_gather_scalar[65536] N/A 9.4 µs N/A
🆕 WallTime words_gather_dispatch[1024] N/A 30 ns N/A
🆕 WallTime words_gather_dispatch[65536] N/A 2.1 µs N/A
🆕 WallTime words_gather_scalar[1024] N/A 360 ns N/A
🆕 WallTime words_gather_scalar[65536] N/A 22.5 µs N/A

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing myrrc/bench-process-per-query (eac735c) with develop (7ba790f)2

Open in CodSpeed

Footnotes

  1. 89 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. No successful run was found on develop (204d1d4) during the generation of this report, so 7ba790f was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

View more details on CodSpeed HQ