Skip to content

Add performance evidence lab PoC - #7

Merged
reiase merged 6 commits into
mainfrom
agent/evidence-lab-poc
Aug 9, 2026
Merged

Add performance evidence lab PoC#7
reiase merged 6 commits into
mainfrom
agent/evidence-lab-poc

Conversation

@reiase

@reiase reiase commented Aug 9, 2026

Copy link
Copy Markdown
Contributor

What changed

  • add immutable evidence catalog and GEMM curve-comparison derived views
  • add a read-only Performance Evidence mode to the NiceGUI workbench
  • catalog the pinned Vidur Phi-2/A100 profile and show operation coverage
  • compare exact Vidur GEMM samples with analytical roofline results over identical FLOPs/bytes
  • expose query digests, raw record IDs, sample counts, bottlenecks, and model residuals
  • package only the pinned manifest/license/profile slice in the base wheel
  • render the four workbench modes as a stable 2×2 grid without tab overflow or stray indicators

Boundary

Measured data is shown as exact scatter points and does not claim interpolation. The analytical series is a compute/memory roofline, not an event-level simulation. The PoC compares four GEMM semantics because their selectors can reconstruct exact M/N/K workload facts; attention remains visible in the coverage catalog without a fabricated analytical formula.

Validation

  • full test suite: 150 passed
  • focused evidence/UI suite after layout fix: 16 passed
  • Ruff on active analysis/workbench/tests: passed
  • bilingual documentation check: 31 pairs passed
  • mkdocs build --strict: passed
  • base wheel contract: passed, including only the approved 16 KB Vidur slice
  • git diff --check: passed

Visual QA note

The original four-tab horizontal layout overflowed in the 288 px sidebar. It now uses a 2×2 grid and explicitly disables Quasar scroll arrows and the native moving indicator. Automated NiceGUI component tests cover all four modes; the in-app browser connection was unavailable for an additional screenshot pass.

@reiase
reiase marked this pull request as ready for review August 9, 2026 15:33
@reiase
reiase merged commit 1faeeae into main Aug 9, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant