Skip to content

[Klaud Cold] Enact the August 3, 2026 scenario and precision deprecations / 执行 2026 年 8 月 3 日场景与精度下线 #2493

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
functionstackx merged 2 commits into from
Aug 4, 2026
Merged

[Klaud Cold] Enact the August 3, 2026 scenario and precision deprecations / 执行 2026 年 8 月 3 日场景与精度下线 #2493

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
36cdafd
chore: enact the August 3, 2026 scenario and precision deprecations
functionstackx Aug 4, 2026
e607399
docs(MODELS): record the August 3, 2026 scenario/precision deprecations
functionstackx Aug 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion KLAUD_DEBUG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ and waits for the PR checks automatically.

**Fix:** in `benchmarks/single_node/<recipe>.sh`, either:
1. **Lower `--gpu-memory-utilization`** (`0.95 → 0.90`, sometimes 0.85). Matches the H100/H200/B200 NVIDIA pattern. Smallest blast radius.
2. **Disable the profiler entirely** for cases where lowering isn't enough: `export VLLM_MEMORY_PROFILER_ESTIMATE_CUDAGRAPHS=0` before `vllm serve`. Matches `benchmarks/single_node/agentic/kimik2.5_fp4_b200.sh:65`.
2. **Disable the profiler entirely** for cases where lowering isn't enough: `export VLLM_MEMORY_PROFILER_ESTIMATE_CUDAGRAPHS=0` before `vllm serve`. Matches `benchmarks/single_node/agentic/deprecated/kimik2.5_fp4_b200.sh:65`.

Seen on: #1395 (kimik2.5-fp4-b200-vllm — needed env var), #1403 (gptoss-fp4-mi300x-vllm — needed 0.90), #1461 (dsv4-fp8-h200-vllm — needed 0.90).

Expand Down
14 changes: 9 additions & 5 deletions MODELS.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ InferenceX-e2e runs on a fixed, limited pool of GPUs and is maintained by a smal

**Monday, August 3, 2026** is the last day for the scenarios, precisions, and recipe variants listed below; they are deprecated after that date.

**Partially enacted on 2026-08-04** in [#2493](https://github.com/SemiAnalysisAI/InferenceX/pull/2493): the scenario and precision retirements in the first table were carried out — 54 config keys removed from the active master configs and archived under [`configs/deprecated/`](configs/deprecated/), with their benchmark scripts moved to the sibling `deprecated/` directories. The speculative-decoding A/B retirements in the second table are **not yet enacted**; see the note under that table.

Scenario and precision retirements:

| Model | Deprecated | Remains |
Comment on lines 12 to 19

@claude claude Bot Aug 4, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 The self-referential PR link uses a literal PRNUM placeholder instead of 2493 in both MODELS.md (lines 15, 56, 57, 61) and the mirrored lines in MODELS_zh.md, producing 8 broken /pull/PRNUM links (404) in the docs that are this PR's own deliverable. Fix with a simple find-and-replace of PRNUM → 2493 in both files.

Extended reasoning...

This PR's whole purpose is to record the enactment of the August 3, 2026 deprecation notice and link back to the PR that did it. Four places in MODELS.md (lines 15, 56, 57, 61) and the four mirrored lines in MODELS_zh.md write [#PRNUM](https://github.com/SemiAnalysisAI/InferenceX/pull/PRNUM) where the actual PR number, 2493, should be. This is a leftover template placeholder — the author correctly filled in the real numbers for every other PR reference on those lines (e.g. #2268, #1724, #734), but couldn't have known this PR's own number ahead of time and never went back to substitute it once the PR was opened.

I verified this against the actual committed file content, not the PR diff view: grep -n PRNUM MODELS.md MODELS_zh.md on the current working tree returns all 8 occurrences, and git show HEAD:MODELS.md confirms the same text is present in the commit that shipped this change (5b5606e, "docs(MODELS): record the August 3, 2026 deprecations as enacted"). The diff shown during review substitutes the placeholder with #2493 for display purposes, which is why it can look already-fixed there — but the file actually on disk/in HEAD still has the raw placeholder.

Concretely, anyone who clicks the "Enacted on 2026-08-04 in #PRNUM" link at MODELS.md:15, or either of the "no active config as of 2026-08-04 (#PRNUM)" callouts at lines 56-57, or the "Agentic coding (removed 2026-08-04, #PRNUM)" note at line 61, lands on https://github.com/SemiAnalysisAI/InferenceX/pull/PRNUM, which is not a valid PR number and 404s. Same for the four mirrored Chinese-language lines in MODELS_zh.md. Since the whole point of these notes is to let a future reader jump straight to the PR that performed the archival/removal, a dead link defeats that purpose, even though it doesn't break any code, CI, or benchmark behavior.

Fix is mechanical: replace PRNUM with 2493 in both files (8 substitutions total, matching the #2493 display already shown in the PR's own diff view). Since this is a documentation-only defect with no functional or CI impact, I'm marking it a nit rather than a blocking issue — but it should be fixed before merge since it's trivial and the whole point of the change is to leave working self-referential links.

Expand All @@ -30,6 +32,8 @@ Speculative-decoding A/B retirements — in each pair below the spec-decode arm
| GLM-5.2 (`glm5.2`) | Agentic coding, non-MTP | Agentic coding, MTP |
| Kimi-K3 (`kimik3`) | Agentic coding, non-DSpark — deprecated from day 0 | Agentic coding, DSpark |

**Status: not yet enacted.** Every non-spec-decode agentic arm above still runs. Removing them today would leave MiniMax-M3 and GLM-5.2 with no active config at all — their EAGLE3 and MTP agentic arms have not landed yet — and would drop all AMD and all SGLang agentic coverage for DeepSeek-V4-Pro and Qwen3.5, neither of which has an MTP sibling on those platforms. This round runs once the replacement arms exist.

**Going forward we no longer benchmark non-spec-decode versus spec-decode as an A/B.** The non-spec-decode arm existed as a neutral baseline back when acceptance length wasn't standardized. That is now solved: [`golden_al_distribution/`](golden_al_distribution/) commits one golden acceptance-length curve per model, thinking mode, and draft length, measured on the SPEED-Bench `coding` category, and AgentX pins every submission to that curve through synthetic acceptance (vLLM `synthetic_acceptance_length`, SGLang `SGLANG_SIMULATE_ACC_LEN`, TensorRT-LLM `TLLM_SPEC_DECODE_FORCE_NUM_ACCEPTED_TOKENS`, etc). With a fair, engine-independent acceptance target in place, spec-decode results are directly comparable on their own and a separate non-spec-decode track is redundant. Agentic coding recipes are therefore run and published with speculative decoding enabled only — MTP, EAGLE/EAGLE3, DSpark, or whatever draft method the model ships — and the non-spec-decode arm is neither run nor published. New models are onboarded that way from day 0, as Kimi-K3 is.

### Thursday, August 6, 2026
Expand All @@ -51,13 +55,13 @@ Speculative-decoding A/B retirements — in each pair below the spec-decode arm
|---|---|---|---|---|
| Qwen3.8 2.4T | `qwen3.8` | TBD | Agentic coding | |
| Kimi-K3 | `kimik3` | 2026-07-27 ([#2391](https://github.com/SemiAnalysisAI/InferenceX/pull/2391)) | Agentic coding (DSpark only) | Agentic coding non-DSpark arm (deprecated from day 0) |
| GLM-5.2 | `glm5.2` | 2026-07-18 ([#2268](https://github.com/SemiAnalysisAI/InferenceX/pull/2268)) | Agentic coding (MTP only from 2026-08-03) | |
| MiniMax-M3 | `minimaxm3` | 2026-06-12 ([#1724](https://github.com/SemiAnalysisAI/InferenceX/pull/1724)) | Single-turn 8k1k (until 2026-08-03), Agentic coding (EAGLE3 only from 2026-08-03) | Single-turn 1k1k |
| DeepSeek-V4-Pro | `dsv4` | 2026-04-24 ([#1130](https://github.com/SemiAnalysisAI/InferenceX/pull/1130)) | Single-turn 8k1k, Agentic coding (MTP only from 2026-08-03) | Single-turn 1k1k |
| GLM-5.2 | `glm5.2` | 2026-07-18 ([#2268](https://github.com/SemiAnalysisAI/InferenceX/pull/2268)) | Agentic coding (MTP-only pending — the non-MTP arm still runs; see the Deprecation Notice) | |
| MiniMax-M3 | `minimaxm3` | 2026-06-12 ([#1724](https://github.com/SemiAnalysisAI/InferenceX/pull/1724)) | Agentic coding | Single-turn 1k1k, Single-turn 8k1k (removed 2026-08-04, [#2493](https://github.com/SemiAnalysisAI/InferenceX/pull/2493)) |
| DeepSeek-V4-Pro | `dsv4` | 2026-04-24 ([#1130](https://github.com/SemiAnalysisAI/InferenceX/pull/1130)) | Single-turn 8k1k, Agentic coding (MTP-only pending — the non-MTP arm still runs; see the Deprecation Notice) | Single-turn 1k1k |
| GLM-5 / GLM-5.1 | `glm5`, `glm5.1` | 2026-03-06 ([#762](https://github.com/SemiAnalysisAI/InferenceX/pull/762)); GLM-5.1 added 2026-04-21 ([#1098](https://github.com/SemiAnalysisAI/InferenceX/pull/1098)) | — (retired 2026-07-18, [#2276](https://github.com/SemiAnalysisAI/InferenceX/pull/2276)) | Single-turn 1k1k, Single-turn 1k8k (GLM-5 only), Single-turn 8k1k |
| MiniMax-M2.5/2.7 | `minimaxm2.5` | 2026-02-18 ([#755](https://github.com/SemiAnalysisAI/InferenceX/pull/755)) | — (retired 2026-06-20, [#1874](https://github.com/SemiAnalysisAI/InferenceX/pull/1874)) | Single-turn 1k1k, Single-turn 1k8k, Single-turn 8k1k |
| Kimi-K2.5/2.6/2.7-Code | `kimik2.5` | 2026-02-17 ([#734](https://github.com/SemiAnalysisAI/InferenceX/pull/734)) | Single-turn 8k1k (until 2026-08-06), Agentic coding (until 2026-08-03) — fully retired after 2026-08-06 | Single-turn 1k1k, Single-turn 1k8k |
| Qwen3.5-397B-A17B | `qwen3.5` | 2026-02-16 ([#704](https://github.com/SemiAnalysisAI/InferenceX/pull/704)) | Single-turn 8k1k, Agentic coding (MTP only from 2026-08-03); fp8/fp4 only — bf16 recipes retired 2026-08-03 | Single-turn 1k1k, Single-turn 1k8k |
| Kimi-K2.5/2.6/2.7-Code | `kimik2.5` | 2026-02-17 ([#734](https://github.com/SemiAnalysisAI/InferenceX/pull/734)) | Single-turn 8k1k (until 2026-08-06) — fully retired after 2026-08-06 | Single-turn 1k1k, Single-turn 1k8k, Agentic coding (removed 2026-08-04, [#2493](https://github.com/SemiAnalysisAI/InferenceX/pull/2493)) |
| Qwen3.5-397B-A17B | `qwen3.5` | 2026-02-16 ([#704](https://github.com/SemiAnalysisAI/InferenceX/pull/704)) | Single-turn 8k1k, Agentic coding; fp8/fp4 only | Single-turn 1k1k, Single-turn 1k8k, all bf16 recipes (removed 2026-08-04, [#2493](https://github.com/SemiAnalysisAI/InferenceX/pull/2493)) |
| gpt-oss-120b | `gptoss` | 2025-09-09 | — (retired 2026-07-06, [#2101](https://github.com/SemiAnalysisAI/InferenceX/pull/2101)) | Single-turn 1k1k, Single-turn 1k8k, Single-turn 8k1k |
| DeepSeek-R1-0528 | `dsr1` | 2025-08-13 | Single-turn 8k1k | Single-turn 1k1k, Single-turn 1k8k |
| Llama-3.1-70B-Instruct | `llama70b` | 2025-08-12 | — (retired 2025-10-29, [#149](https://github.com/SemiAnalysisAI/InferenceX/pull/149)) | Single-turn 1k1k, Single-turn 1k8k, Single-turn 8k1k [^1] |
Expand Down
14 changes: 9 additions & 5 deletions MODELS_zh.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,8 @@ InferenceX-e2e 运行在数量固定且有限的 GPU 资源池上，并由一支

**2026 年 8 月 3 日（星期一）**为下列场景、精度与配方变体的最后运行日，此后即告弃用。

**已于 2026 年 8 月 4 日部分执行**（[#2493](https://github.com/SemiAnalysisAI/InferenceX/pull/2493)）：第一张表中的场景与精度下线已完成 —— 54 个配置键从启用的 master 配置中移除并归档至 [`configs/deprecated/`](configs/deprecated/)，其基准测试脚本亦移入同级 `deprecated/` 目录。第二张表中的投机解码 A/B 下线**尚未执行**，详见该表下方说明。

场景与精度下线：

| 模型 | 弃用内容 | 保留内容 |
Expand All @@ -30,6 +32,8 @@ InferenceX-e2e 运行在数量固定且有限的 GPU 资源池上，并由一支
| GLM-5.2（`glm5.2`） | 智能体编码，非 MTP | 智能体编码，MTP |
| Kimi-K3（`kimik3`） | 智能体编码，非 DSpark —— 自第 0 天（day 0）起即弃用 | 智能体编码，DSpark |

**状态：尚未执行。**上表中所有非投机解码智能体分支仍在运行。若此刻移除，MiniMax-M3 与 GLM-5.2 将没有任何启用配置（其 EAGLE3 与 MTP 智能体分支尚未合入），并会使 DeepSeek-V4-Pro 与 Qwen3.5 在 AMD 及 SGLang 上的智能体覆盖全部消失 —— 这些平台/引擎组合均无对应的 MTP 分支。待替代分支就绪后再执行本轮下线。

**今后我们不再以 A/B 对照的方式基准测试「非投机解码 vs 投机解码」。**当初保留非投机解码分支，是把它当作中立基线：那时接受长度（AL）完全取决于提交方草稿头（draft head）的实际水平，导致各家投机解码数据之间无法横向比较。这一问题现已解决：[`golden_al_distribution/`](golden_al_distribution/) 为每个模型、thinking 模式与草稿长度各提交了一条黄金 AL 曲线，均在 SPEED-Bench `coding` 类别上测得；AgentX 通过合成接受（synthetic acceptance）将所有提交锁定到该曲线（vLLM 用 `synthetic_acceptance_length`，SGLang 用 `SGLANG_SIMULATE_ACC_LEN`，TensorRT-LLM 用 `TLLM_SPEC_DECODE_FORCE_NUM_ACCEPTED_TOKENS`，等等）。既然已有公平且与引擎无关的接受目标，投机解码结果本身即可直接横向比较，单独保留一条非投机解码赛道已属冗余。因此，智能体编码配方一律仅在启用投机解码的条件下运行与发布 —— 具体为 MTP、EAGLE/EAGLE3、DSpark，或该模型自带的任何草稿方法 —— 非投机解码分支既不运行也不发布。新模型自第 0 天起即按此方式接入，Kimi-K3 即为一例。

### 2026 年 8 月 6 日（星期四）
Expand All @@ -51,13 +55,13 @@ InferenceX-e2e 运行在数量固定且有限的 GPU 资源池上，并由一支
|---|---|---|---|---|
| Qwen3.8 2.4T | `qwen3.8` | 待定 | 智能体编码 | |
| Kimi-K3 | `kimik3` | 2026-07-27 ([#2391](https://github.com/SemiAnalysisAI/InferenceX/pull/2391)) | 智能体编码（仅 DSpark） | 智能体编码非 DSpark 分支（自第 0 天起弃用） |
| GLM-5.2 | `glm5.2` | 2026-07-18（[#2268](https://github.com/SemiAnalysisAI/InferenceX/pull/2268)） | 智能体编码（自 2026-08-03 起仅 MTP） | |
| MiniMax-M3 | `minimaxm3` | 2026-06-12（[#1724](https://github.com/SemiAnalysisAI/InferenceX/pull/1724)） | 单轮 8k1k（至 2026-08-03）、智能体编码（自 2026-08-03 起仅 EAGLE3） | 单轮 1k1k |
| DeepSeek-V4-Pro | `dsv4` | 2026-04-24（[#1130](https://github.com/SemiAnalysisAI/InferenceX/pull/1130)） | 单轮 8k1k、智能体编码（自 2026-08-03 起仅 MTP） | 单轮 1k1k |
| GLM-5.2 | `glm5.2` | 2026-07-18（[#2268](https://github.com/SemiAnalysisAI/InferenceX/pull/2268)） | 智能体编码（「仅 MTP」待执行 —— 非 MTP 分支仍在运行，见弃用公告） | |
| MiniMax-M3 | `minimaxm3` | 2026-06-12（[#1724](https://github.com/SemiAnalysisAI/InferenceX/pull/1724)） | 智能体编码 | 单轮 1k1k、单轮 8k1k（2026-08-04 移除，[#2493](https://github.com/SemiAnalysisAI/InferenceX/pull/2493)） |
| DeepSeek-V4-Pro | `dsv4` | 2026-04-24（[#1130](https://github.com/SemiAnalysisAI/InferenceX/pull/1130)） | 单轮 8k1k、智能体编码（「仅 MTP」待执行 —— 非 MTP 分支仍在运行，见弃用公告） | 单轮 1k1k |
| GLM-5 / GLM-5.1 | `glm5`、`glm5.1` | 2026-03-06（[#762](https://github.com/SemiAnalysisAI/InferenceX/pull/762)）；GLM-5.1 于 2026-04-21 加入（[#1098](https://github.com/SemiAnalysisAI/InferenceX/pull/1098)） | —（2026-07-18 退役，[#2276](https://github.com/SemiAnalysisAI/InferenceX/pull/2276)） | 单轮 1k1k、单轮 1k8k（仅 GLM-5）、单轮 8k1k |
| MiniMax-M2.5/2.7 | `minimaxm2.5` | 2026-02-18（[#755](https://github.com/SemiAnalysisAI/InferenceX/pull/755)） | —（2026-06-20 退役，[#1874](https://github.com/SemiAnalysisAI/InferenceX/pull/1874)） | 单轮 1k1k、单轮 1k8k、单轮 8k1k |
| Kimi-K2.5/2.6/2.7-Code | `kimik2.5` | 2026-02-17（[#734](https://github.com/SemiAnalysisAI/InferenceX/pull/734)） | 单轮 8k1k（至 2026-08-06）、智能体编码（至 2026-08-03）—— 2026-08-06 后完全退役 | 单轮 1k1k、单轮 1k8k |
| Qwen3.5-397B-A17B | `qwen3.5` | 2026-02-16（[#704](https://github.com/SemiAnalysisAI/InferenceX/pull/704)） | 单轮 8k1k、智能体编码（自 2026-08-03 起仅 MTP）；仅 fp8/fp4 —— bf16 配方于 2026-08-03 下线 | 单轮 1k1k、单轮 1k8k |
| Kimi-K2.5/2.6/2.7-Code | `kimik2.5` | 2026-02-17（[#734](https://github.com/SemiAnalysisAI/InferenceX/pull/734)） | 单轮 8k1k（至 2026-08-06）—— 2026-08-06 后完全退役 | 单轮 1k1k、单轮 1k8k、智能体编码（2026-08-04 移除，[#2493](https://github.com/SemiAnalysisAI/InferenceX/pull/2493)） |
| Qwen3.5-397B-A17B | `qwen3.5` | 2026-02-16（[#704](https://github.com/SemiAnalysisAI/InferenceX/pull/704)） | 单轮 8k1k、智能体编码；仅 fp8/fp4 | 单轮 1k1k、单轮 1k8k、全部 bf16 配方（2026-08-04 移除，[#2493](https://github.com/SemiAnalysisAI/InferenceX/pull/2493)） |
| gpt-oss-120b | `gptoss` | 2025-09-09 | —（2026-07-06 退役，[#2101](https://github.com/SemiAnalysisAI/InferenceX/pull/2101)） | 单轮 1k1k、单轮 1k8k、单轮 8k1k |
| DeepSeek-R1-0528 | `dsr1` | 2025-08-13 | 单轮 8k1k | 单轮 1k1k、单轮 1k8k |
| Llama-3.1-70B-Instruct | `llama70b` | 2025-08-12 | —（2025-10-29 退役，[#149](https://github.com/SemiAnalysisAI/InferenceX/pull/149)） | 单轮 1k1k、单轮 1k8k、单轮 8k1k [^1] |
Expand Down
2 changes: 1 addition & 1 deletion benchmarks/multi_node/amd_utils/models_vllm.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ MiniMax-M3-MXFP8:
# --block-size 128 is mandatory (MSA sparse/index cache); text-only benchmark
# so --language-model-only frees the vision encoder. gfx950 uses FP8 KV cache.
# Serve flags + env kept in sync with the single-node recipe
# benchmarks/single_node/fixed_seq_len/minimaxm3_fp8_mi355x.sh:
# benchmarks/single_node/fixed_seq_len/deprecated/minimaxm3_fp8_mi355x.sh:
# --moe-backend aiter (AITER fused MoE), --linear-backend emulation, and the
# larger --max-num-batched-tokens 32768 prefill budget; plus the AITER
# router-append shared-experts fusion (self-disables under EP; the sweep is
Expand Down
2 changes: 1 addition & 1 deletion ..._node/minimaxm3_fp4_mi355x_atom-disagg.sh → ...cated/minimaxm3_fp4_mi355x_atom-disagg.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env bash

source "$(dirname "$0")/../benchmark_lib.sh"
source "$(dirname "$0")/../../benchmark_lib.sh"

check_env_vars \
CONC_LIST \
Expand Down
2 changes: 1 addition & 1 deletion ..._node/minimaxm3_fp4_mi355x_vllm-disagg.sh → ...cated/minimaxm3_fp4_mi355x_vllm-disagg.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env bash

source "$(dirname "$0")/../benchmark_lib.sh"
source "$(dirname "$0")/../../benchmark_lib.sh"

check_env_vars \
CONC_LIST \
Expand Down
2 changes: 1 addition & 1 deletion ..._node/minimaxm3_fp8_mi355x_atom-disagg.sh → ...cated/minimaxm3_fp8_mi355x_atom-disagg.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env bash

source "$(dirname "$0")/../benchmark_lib.sh"
source "$(dirname "$0")/../../benchmark_lib.sh"

check_env_vars \
CONC_LIST \
Expand Down
2 changes: 1 addition & 1 deletion ..._node/minimaxm3_fp8_mi355x_vllm-disagg.sh → ...cated/minimaxm3_fp8_mi355x_vllm-disagg.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env bash

source "$(dirname "$0")/../benchmark_lib.sh"
source "$(dirname "$0")/../../benchmark_lib.sh"

check_env_vars \
CONC_LIST \
Expand Down
2 changes: 1 addition & 1 deletion .../single_node/agentic/kimik2.5_fp4_b200.sh → ...e/agentic/deprecated/kimik2.5_fp4_b200.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ set -x
#
# KV_OFFLOADING=dram requires KV_OFFLOAD_BACKEND=lmcache.

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars MODEL TP CONC KV_OFFLOADING TOTAL_CPU_DRAM_GB RESULT_DIR DURATION

Expand Down
2 changes: 1 addition & 1 deletion .../single_node/agentic/kimik2.5_fp4_b300.sh → ...e/agentic/deprecated/kimik2.5_fp4_b300.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ set -x
#
# KV_OFFLOADING=dram requires KV_OFFLOAD_BACKEND=vllm-simple.

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars MODEL TP CONC KV_OFFLOADING TOTAL_CPU_DRAM_GB RESULT_DIR DURATION

Expand Down
2 changes: 1 addition & 1 deletion ...gle_node/agentic/kimik2.5_fp4_b300_mtp.sh → ...entic/deprecated/kimik2.5_fp4_b300_mtp.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
set -euo pipefail
set -x

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars MODEL TP CONC KV_OFFLOADING TOTAL_CPU_DRAM_GB RESULT_DIR DURATION

Expand Down
2 changes: 1 addition & 1 deletion ...ingle_node/agentic/kimik2.5_fp4_mi355x.sh → ...agentic/deprecated/kimik2.5_fp4_mi355x.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ set -x
# KV_OFFLOADING=dram requires KV_OFFLOAD_BACKEND=vllm-native.


source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars MODEL TP CONC KV_OFFLOADING TOTAL_CPU_DRAM_GB RESULT_DIR DURATION EP_SIZE

Expand Down
2 changes: 1 addition & 1 deletion ...single_node/agentic/kimik2.5_int4_b200.sh → .../agentic/deprecated/kimik2.5_int4_b200.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ set -x
# Required env vars:
# MODEL, TP, CONC, RESULT_DIR

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars MODEL TP CONC KV_OFFLOADING TOTAL_CPU_DRAM_GB RESULT_DIR DURATION

Expand Down
2 changes: 1 addition & 1 deletion ...single_node/agentic/kimik2.5_int4_h100.sh → .../agentic/deprecated/kimik2.5_int4_h100.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ set -x
# Required env vars:
# MODEL, TP, CONC, KV_OFFLOADING, TOTAL_CPU_DRAM_GB, RESULT_DIR

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars MODEL TP CONC KV_OFFLOADING TOTAL_CPU_DRAM_GB RESULT_DIR DURATION

Expand Down
2 changes: 1 addition & 1 deletion ...single_node/agentic/kimik2.5_int4_h200.sh → .../agentic/deprecated/kimik2.5_int4_h200.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ set -x
# Required env vars:
# MODEL, TP, CONC, KV_OFFLOADING, TOTAL_CPU_DRAM_GB, RESULT_DIR

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars MODEL TP CONC KV_OFFLOADING TOTAL_CPU_DRAM_GB RESULT_DIR DURATION

Expand Down
2 changes: 1 addition & 1 deletion .../single_node/agentic/qwen3.5_bf16_b200.sh → ...e/agentic/deprecated/qwen3.5_bf16_b200.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ set -x
# Required env vars:
# MODEL, TP, CONC, RESULT_DIR

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars MODEL TP CONC RESULT_DIR DURATION EP_SIZE

Expand Down
2 changes: 1 addition & 1 deletion ..._node/fixed_seq_len/minimaxm3_fp4_b200.sh → ..._seq_len/deprecated/minimaxm3_fp4_b200.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
# checkpoint. MiniMax-M3 modelopt NVFP4 support (vllm-project/vllm PR #46380) is
# baked into the perf container image, so no runtime patch is needed.

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ...e/fixed_seq_len/minimaxm3_fp4_b200_mtp.sh → ..._len/deprecated/minimaxm3_fp4_b200_mtp.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
# (vllm-project/vllm PR #46380) is baked into the perf container image, so no
# runtime patch is needed.

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ..._node/fixed_seq_len/minimaxm3_fp4_b300.sh → ..._seq_len/deprecated/minimaxm3_fp4_b300.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
# checkpoint. MiniMax-M3 modelopt NVFP4 support (vllm-project/vllm PR #46380) is
# baked into the perf container image, so no runtime patch is needed.

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ...e/fixed_seq_len/minimaxm3_fp4_b300_mtp.sh → ..._len/deprecated/minimaxm3_fp4_b300_mtp.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
# (vllm-project/vllm PR #46380) is baked into the perf container image, so no
# runtime patch is needed.

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ...ixed_seq_len/minimaxm3_fp4_mi355x_atom.sh → ...n/deprecated/minimaxm3_fp4_mi355x_atom.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env bash

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ..._seq_len/minimaxm3_fp4_mi355x_atom_mtp.sh → ...precated/minimaxm3_fp4_mi355x_atom_mtp.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env bash

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ...ixed_seq_len/minimaxm3_fp4_mi355x_vllm.sh → ...n/deprecated/minimaxm3_fp4_mi355x_vllm.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
# 64/128/256.
# * fp8 KV cache (--kv-cache-dtype fp8).

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ..._seq_len/minimaxm3_fp4_mi355x_vllm_mtp.sh → ...precated/minimaxm3_fp4_mi355x_vllm_mtp.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
# Inferact/MiniMax-M3-EAGLE3. The pinned nightly includes upstream AMD
# MiniMax-M3 SupportsEagle3 support, so no runtime model patch is needed.

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ..._node/fixed_seq_len/minimaxm3_fp8_b200.sh → ..._seq_len/deprecated/minimaxm3_fp8_b200.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
# dp-attn=true maps to DP×EP (DEP) per the recipe's "DP8 + Expert Parallel"
# layout; ep>1 maps to TP+EP (TEP).

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ...e/fixed_seq_len/minimaxm3_fp8_b200_mtp.sh → ..._len/deprecated/minimaxm3_fp8_b200_mtp.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@
# The target uses the FlashInfer TRT-LLM attention path. The EAGLE3-GQA drafter
# is pinned separately to FLASH_ATTN.

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
2 changes: 1 addition & 1 deletion ..._node/fixed_seq_len/minimaxm3_fp8_b300.sh → ..._seq_len/deprecated/minimaxm3_fp8_b300.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
# mandatory (MSA sparse/index cache); the benchmark is text-only, so
# --language-model-only frees the vision encoder's VRAM.

source "$(dirname "$0")/../../benchmark_lib.sh"
source "$(dirname "$0")/../../../benchmark_lib.sh"

check_env_vars \
MODEL \
Expand Down
Loading