Skip to content

recipe(lt-wikidata-comp-zh): add feature extraction recipes#1124

Draft
kujin66 wants to merge 1 commit into
mainfrom
kujin66/add-dell-lt-wikidata-comp-zh-recipe
Draft

recipe(lt-wikidata-comp-zh): add feature extraction recipes#1124
kujin66 wants to merge 1 commit into
mainfrom
kujin66/add-dell-lt-wikidata-comp-zh-recipe

Conversation

@kujin66

@kujin66 kujin66 commented Jul 16, 2026

Copy link
Copy Markdown

Adds recipe coverage for dell-research-harvard/lt-wikidata-comp-zh as a BERT feature-extraction model. The current origin/main baseline already exports the checkpoint, so this is an L0 recipe-only contribution with measurable L1 value from the checked-in w8a16 quantized recipe running successfully on CPU.

  1. Recipe path(s)
  • examples/recipes/dell-research-harvard_lt-wikidata-comp-zh/feature-extraction_fp16_config.json
  • examples/recipes/dell-research-harvard_lt-wikidata-comp-zh/feature-extraction_w8a16_config.json
  1. README row
  • Added dell-research-harvard/lt-wikidata-comp-zh | feature-extraction to examples/recipes/README.md.
  • Updated total from 75 to 76.
  1. Build output dir
  • Baseline: temp/baseline_lt_wikidata_comp_zh
  • Recipe fp16: temp/lt_wikidata_comp_zh_fp16_recipe_fixed
  • Recipe w8a16: temp/lt_wikidata_comp_zh_w8a16_recipe
  • L1 perf JSON: temp/lt_wikidata_comp_zh_w8a16_perf_cpu.json
  1. Build log
  • Baseline command: uv run winml build -m dell-research-harvard/lt-wikidata-comp-zh -o temp/baseline_lt_wikidata_comp_zh --ep cpu --device cpu --no-analyze --no-optimize --no-quant --no-compile --rebuild
  • Baseline result: Build complete in 59.8s; final artifact temp/baseline_lt_wikidata_comp_zh/model.onnx.
  • Recipe fp16 command: uv run winml build -c examples/recipes/dell-research-harvard_lt-wikidata-comp-zh/feature-extraction_fp16_config.json -m dell-research-harvard/lt-wikidata-comp-zh -o temp/lt_wikidata_comp_zh_fp16_recipe_fixed --no-analyze --no-compile --rebuild
  • Recipe fp16 result: Build complete in 53.6s; FP16 stage ran in 7.7s, artifact 194.1 MB, 202 FLOAT16 initializers, I/O types preserved.
  • Recipe w8a16 command: uv run winml build -c examples/recipes/dell-research-harvard_lt-wikidata-comp-zh/feature-extraction_w8a16_config.json -m dell-research-harvard/lt-wikidata-comp-zh -o temp/lt_wikidata_comp_zh_w8a16_recipe --no-analyze --no-compile --rebuild
  • Recipe w8a16 result: Build complete in 81.9s; quantized artifact 113.6 MB.
  1. Appended findings
  • No in-repo model_knowledge file is included in this Lane B model PR. Model-specific finding to record externally: bert: dell-research-harvard/lt-wikidata-comp-zh resolves as BertModel/feature-extraction, not tabular-classification; fp16 and w8a16 CPU recipes build, and w8a16 runs perf.
  1. Optimum-coverage probe
{
  model_type: bert,
  architectures: [BertModel],
  vendor: [],
  after_winml: [feature-extraction, fill-mask, multiple-choice, question-answering, text-classification, token-classification],
  added_by_winml: [feature-extraction, fill-mask, multiple-choice, question-answering, text-classification, token-classification]
}
  1. Claimed (Effort, Goal, Outcome)
  • Effort: L0 recipe-only, using existing WinML BERT registration.
  • Goal ceiling: L1, because baseline already covers L0 and the recipe delta is quantized w8a16 CPU perf evidence.
  • Outcome: L0, recipe JSON plus README row only.
  • Target EPs: cpu.
  • Baseline freshness: origin/main and baseline HEAD were both 904c20109ab31d737c5132c3686ab404236edd57.
  • PR head after reviewer fix: 937b000e.
  • winml --version: 0.2.0.
  1. Goal-ladder verdict table
    | Tier | Verdict | Evidence |
    |---|---|---|
    | L0 | PASS | WinMLBuildConfig.from_dict(...).validate() passed for both recipes; fp16 recipe build completed in 53.6s and emitted 202 FLOAT16 initializers; w8a16 recipe build completed in 81.9s; ONNX input shapes are input_ids, attention_mask, token_type_ids all [1,512]; output is last_hidden_state [1,512,768]. |
    | L1 | PASS | CPU EP perf on temp/lt_wikidata_comp_zh_w8a16_recipe/model.onnx completed with CPUExecutionProvider; providers snapshot was [DmlExecutionProvider, CPUExecutionProvider]; mean latency 595.581 ms, p50 654.255 ms, throughput 1.68 samples/sec, RSS total delta 285.93 MB; perf JSON saved to temp/lt_wikidata_comp_zh_w8a16_perf_cpu.json. |

  2. Methodology-evolution declaration

  • No new methodology friction observed for this model PR. A reviewer-style pass caught the fp16 recipe needed an explicit mode: fp16; this is already covered by existing reviewer rule _meta-014, so no new _meta-NNN or skill-file edit is required.
  • No skill files are edited in this Lane B model PR.

@kujin66 kujin66 force-pushed the kujin66/add-dell-lt-wikidata-comp-zh-recipe branch from dbd33db to 937b000 Compare July 16, 2026 06:39
@kujin66

kujin66 commented Jul 16, 2026

Copy link
Copy Markdown
Author

Reviewer-style verification (not a formal GitHub approval; same account authored the PR):

  • PR branch head: 937b000e891240234ec0ecfb0856e3501b486630.
  • Scope check: diff is limited to examples/recipes/README.md plus the two examples/recipes/dell-research-harvard_lt-wikidata-comp-zh/*.json recipe files. No source, tests, or skill files are included.
  • Baseline freshness: PR body cites origin/main/baseline HEAD 904c20109ab31d737c5132c3686ab404236edd57; current origin/main was refreshed and matches that commit.
  • Recipe check: feature-extraction_fp16_config.json now uses quant.mode=fp16; rebuilt artifact temp/lt_wikidata_comp_zh_fp16_recipe_fixed/model.onnx has 202 FLOAT16 initializers and preserved I/O. feature-extraction_w8a16_config.json artifact contains QDQ nodes (QuantizeLinear=428, DequantizeLinear=630).
  • L0/L1 evidence: PR body includes build output dirs, build-complete lines, structural I/O shapes, CPU provider snapshot, and w8a16 perf numbers.
  • CI: all checks are passing at time of comment: license/cla, lint, Analyze (Python), CodeQL, and all test jobs.

Remaining gate: external maintainer/reviewer approval and conversion from Draft to Ready.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant