recipe(lt-wikidata-comp-zh): add feature extraction recipes#1124
Draft
kujin66 wants to merge 1 commit into
Draft
recipe(lt-wikidata-comp-zh): add feature extraction recipes#1124kujin66 wants to merge 1 commit into
kujin66 wants to merge 1 commit into
Conversation
dbd33db to
937b000
Compare
Author
|
Reviewer-style verification (not a formal GitHub approval; same account authored the PR):
Remaining gate: external maintainer/reviewer approval and conversion from Draft to Ready. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds recipe coverage for
dell-research-harvard/lt-wikidata-comp-zhas a BERTfeature-extractionmodel. The currentorigin/mainbaseline already exports the checkpoint, so this is an L0 recipe-only contribution with measurable L1 value from the checked-inw8a16quantized recipe running successfully on CPU.examples/recipes/dell-research-harvard_lt-wikidata-comp-zh/feature-extraction_fp16_config.jsonexamples/recipes/dell-research-harvard_lt-wikidata-comp-zh/feature-extraction_w8a16_config.jsondell-research-harvard/lt-wikidata-comp-zh | feature-extractiontoexamples/recipes/README.md.75to76.temp/baseline_lt_wikidata_comp_zhtemp/lt_wikidata_comp_zh_fp16_recipe_fixedtemp/lt_wikidata_comp_zh_w8a16_recipetemp/lt_wikidata_comp_zh_w8a16_perf_cpu.jsonuv run winml build -m dell-research-harvard/lt-wikidata-comp-zh -o temp/baseline_lt_wikidata_comp_zh --ep cpu --device cpu --no-analyze --no-optimize --no-quant --no-compile --rebuildBuild complete in 59.8s; final artifacttemp/baseline_lt_wikidata_comp_zh/model.onnx.uv run winml build -c examples/recipes/dell-research-harvard_lt-wikidata-comp-zh/feature-extraction_fp16_config.json -m dell-research-harvard/lt-wikidata-comp-zh -o temp/lt_wikidata_comp_zh_fp16_recipe_fixed --no-analyze --no-compile --rebuildBuild complete in 53.6s; FP16 stage ran in7.7s, artifact194.1 MB,202FLOAT16 initializers, I/O types preserved.uv run winml build -c examples/recipes/dell-research-harvard_lt-wikidata-comp-zh/feature-extraction_w8a16_config.json -m dell-research-harvard/lt-wikidata-comp-zh -o temp/lt_wikidata_comp_zh_w8a16_recipe --no-analyze --no-compile --rebuildBuild complete in 81.9s; quantized artifact113.6 MB.model_knowledgefile is included in this Lane B model PR. Model-specific finding to record externally:bert:dell-research-harvard/lt-wikidata-comp-zhresolves asBertModel/feature-extraction, nottabular-classification;fp16andw8a16CPU recipes build, andw8a16runs perf.{ model_type: bert, architectures: [BertModel], vendor: [], after_winml: [feature-extraction, fill-mask, multiple-choice, question-answering, text-classification, token-classification], added_by_winml: [feature-extraction, fill-mask, multiple-choice, question-answering, text-classification, token-classification] }L0recipe-only, using existing WinML BERT registration.L1, because baseline already covers L0 and the recipe delta is quantizedw8a16CPU perf evidence.L0, recipe JSON plus README row only.cpu.origin/mainand baseline HEAD were both904c20109ab31d737c5132c3686ab404236edd57.937b000e.winml --version:0.2.0.Goal-ladder verdict table
| Tier | Verdict | Evidence |
|---|---|---|
| L0 | PASS |
WinMLBuildConfig.from_dict(...).validate()passed for both recipes; fp16 recipe build completed in53.6sand emitted202FLOAT16 initializers; w8a16 recipe build completed in81.9s; ONNX input shapes areinput_ids,attention_mask,token_type_idsall[1,512]; output islast_hidden_state [1,512,768]. || L1 | PASS | CPU EP perf on
temp/lt_wikidata_comp_zh_w8a16_recipe/model.onnxcompleted withCPUExecutionProvider; providers snapshot was[DmlExecutionProvider, CPUExecutionProvider]; mean latency595.581 ms, p50654.255 ms, throughput1.68 samples/sec, RSS total delta285.93 MB; perf JSON saved totemp/lt_wikidata_comp_zh_w8a16_perf_cpu.json. |Methodology-evolution declaration
fp16recipe needed an explicitmode: fp16; this is already covered by existing reviewer rule_meta-014, so no new_meta-NNNor skill-file edit is required.