Skip to content

Chore/bump ethrex rev - #894

Open
jotabulacios wants to merge 8 commits into
mainfrom
chore/bump-ethrex-rev
Open

Chore/bump ethrex rev#894
jotabulacios wants to merge 8 commits into
mainfrom
chore/bump-ethrex-rev

Conversation

@jotabulacios

Copy link
Copy Markdown
Collaborator

No description provided.

The rkyv layout moved with the ethrex rev, so the block's fixture did too, and
the release now carries both: the pre-bump bytes under the original name and the
post-bump ones under a name carrying the rev.

Uploading under a new name rather than replacing the asset keeps `main` working
while this branch is open — its Makefile still pins the pre-bump sha256, and a
replaced asset would fail that checksum on every push, taking the published
benchmark baseline with it.
@jotabulacios

Copy link
Copy Markdown
Collaborator Author

/bench

@github-actions

github-actions Bot commented Aug 3, 2026

Copy link
Copy Markdown

Benchmark — real block (ethrex_mainnet_25368371.bin) (median of 3)

continuations · epoch 2^22 · 10 epochs

Metric main PR Δ
Peak heap 47814 MB 46859 MB -955 MB (-2.0%) ⚪
Prove time 141.796s 129.424s -12.372s (-8.7%) 🟢

-8.7% — beyond what 3 runs resolve. Use /bench-abba for a paired test of the same block (default 12 pairs, ~72 min, resolves ~1%).

Prove-time spread 1.6% (129.561s / 127.522s / 129.424s)

Commit: 55b400c · Baseline: cached · Runner: self-hosted bench

@jotabulacios

Copy link
Copy Markdown
Collaborator Author

/bench-gpu

@github-actions

github-actions Bot commented Aug 4, 2026

Copy link
Copy Markdown

GPU Benchmark (ABBA) — a9ec7ce1ee vs main (14 pairs)

RTX 5090 · AMD Ryzen 9 9950X 16-Core Processor (32 threads) · Vast.ai datacenter @ $0.6275925925925925/hr · prover/cuda · ethrex real block, continuations · drift-free A/B/B/A

=== ABBA paired result  (improvement: - = PR faster) ===
  pairs: 14   mean A (PR): 69.187s   mean B (base): 69.096s

  [parametric] paired-t   mean +0.13%   sd 0.84%   se 0.23%
               95% CI: [-0.35%, +0.62%]   (t df=13 = 2.16)
  [robust]     median +0.26%   Wilcoxon W+=62 W-=43  p(exact)=0.5830  (z=+0.56)

  --- server stability (this run; compare across servers) ---
  run-to-run jitter:    A CV 0.70%   B CV 0.61%        (lower = steadier)
  within-session drift: +0.67% over the run, 1st->2nd half +0.10%
    (jitter -> Tier-1 cached gate floor; drift -> whether the cached baseline can be trusted)

  VERDICT: INCONCLUSIVE - effect not separable from 0 at n=14.
           Point estimate ~+0.26% (median). Need more pairs to resolve.

  raw pairs: /tmp/abba_run/pairs.csv

- = PR faster. Trust the verdict when paired-t and Wilcoxon agree.

The Makefile fetches ethrex_mainnet_25368371_4f658c2b.bin (the suffixed
upload keeps main's pre-bump checksum working while the branch is open),
but the converter README's asset table still listed the un-suffixed name
with the post-bump checksum next to a 'Re-upload pending' note that the
suffixed upload made moot, and executor/tests/README.md named the
un-suffixed asset with the post-bump byte count. Also drop the dangling
ETHREX_BUMP_CYCLE_RESULTS.md reference — the numbers are quoted inline.
@diegokingston
diegokingston marked this pull request as ready for review August 10, 2026 19:29
@diegokingston

Copy link
Copy Markdown
Collaborator

/bench

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants