Skip to content

Exectuion and optimization tracing harness for testing#7814

Draft
AdamGS wants to merge 4 commits intodevelopfrom
adamg/execution-tests
Draft

Exectuion and optimization tracing harness for testing#7814
AdamGS wants to merge 4 commits intodevelopfrom
adamg/execution-tests

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented May 6, 2026

Summary

Closes: #000

Testing

@AdamGS AdamGS added the changelog/feature A new feature label May 6, 2026
@AdamGS AdamGS force-pushed the adamg/execution-tests branch from 1520af8 to 51759b3 Compare May 6, 2026 14:41
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 6, 2026

Merging this PR will improve performance by 31.24%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 24 improved benchmarks
✅ 1184 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation take_search_chunked[(0.005, 0.05)] 193.2 µs 162.3 µs +18.99%
Simulation take_search_chunked[(0.005, 0.1)] 369.2 µs 307.4 µs +20.1%
Simulation take_search_chunked[(0.005, 0.5)] 1.8 ms 1.5 ms +21.04%
Simulation take_search_chunked[(0.005, 1.0)] 3.5 ms 2.9 ms +21.18%
Simulation take_search[(0.005, 0.05)] 168.4 µs 132 µs +27.57%
Simulation take_search[(0.005, 0.1)] 320.4 µs 247.6 µs +29.41%
Simulation take_search[(0.005, 0.5)] 1.5 ms 1.2 ms +31.01%
Simulation take_search[(0.005, 1.0)] 3.1 ms 2.3 ms +31.24%
Simulation take_search[(0.01, 0.05)] 179.5 µs 143.1 µs +25.43%
Simulation take_search[(0.01, 0.1)] 341.3 µs 268.5 µs +27.12%
Simulation take_search[(0.01, 0.5)] 1.6 ms 1.3 ms +28.55%
Simulation take_search[(0.01, 1.0)] 3.3 ms 2.5 ms +28.76%
Simulation take_search[(0.1, 0.05)] 249.2 µs 212.8 µs +17.11%
Simulation take_search[(0.1, 0.1)] 458.7 µs 385.9 µs +18.88%
Simulation take_search[(0.1, 0.5)] 2.2 ms 1.8 ms +20.39%
Simulation take_search[(0.1, 1.0)] 4.3 ms 3.5 ms +20.62%
Simulation take_search_chunked[(0.01, 0.05)] 206.2 µs 175.4 µs +17.56%
Simulation take_search_chunked[(0.01, 0.1)] 393.9 µs 332.2 µs +18.59%
Simulation take_search_chunked[(0.01, 0.5)] 1.9 ms 1.6 ms +19.46%
Simulation take_search_chunked[(0.01, 1.0)] 3.8 ms 3.2 ms +19.59%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing adamg/execution-tests (4f2f3bc) with develop (fb2feb2)

Open in CodSpeed

@AdamGS AdamGS force-pushed the adamg/execution-tests branch 2 times, most recently from 312d17d to 1538135 Compare May 7, 2026 17:38
AdamGS added 4 commits May 8, 2026 16:26
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/execution-tests branch from 1538135 to 4f2f3bc Compare May 8, 2026 15:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant