Commit a9c1f58
committed
test(stable-mir-ui): add external UI test harness with skip management
Add a parametrized pytest harness that runs kmir prove-rs against every
entry in stable-mir-json's passing.tsv, with:
- skip.txt for known-failing cases (2859 entries initially skipped)
- --update-skip mode to shrink skip.txt by re-proving skipped cases
- 300s per-test timeout via pytest-timeout
- proof show output saved to tmp_path on failure for debugging
New files:
kmir/src/tests/external/conftest.py (--update-skip option)
kmir/src/tests/external/test_stable_mir_ui_pass.py
kmir/src/tests/external/data/stable-mir-ui/skip.txt
Modified:
Makefile (test-stable-mir-ui target)
kmir/pyproject.toml (pytest-timeout dependency)
kmir/uv.lock1 parent 871e155 commit a9c1f58
6 files changed
Lines changed: 2989 additions & 2 deletions
File tree
- kmir
- src/tests/external
- data/stable-mir-ui
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
56 | 56 | | |
57 | 57 | | |
58 | 58 | | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
59 | 64 | | |
60 | 65 | | |
61 | 66 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
| 45 | + | |
45 | 46 | | |
46 | 47 | | |
47 | 48 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
0 commit comments