Skip to content

Commit 724a0b1

Browse files
committed
fix: use proper chat template for warmup prompt
The warmup was using an unformatted plain text prompt, causing the processor to generate 0 tokens and leading to 'tokens: 0, features 256' error. Updated performWarmup() to format the prompt using the same chat template and system prompt as normal inference, ensuring proper tokenization. Fixes the warmup failure error that appeared after refactoring.
1 parent 24ceb51 commit 724a0b1

51 files changed

Lines changed: 1507 additions & 14711 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.prettierrc

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
{
2+
"semi": true,
3+
"singleQuote": true,
4+
"trailingComma": "es5",
5+
"tabWidth": 4,
6+
"useTabs": false,
7+
"printWidth": 100,
8+
"bracketSpacing": true,
9+
"arrowParens": "always",
10+
"endOfLine": "lf"
11+
}

backups/bak_53IT.js

Lines changed: 0 additions & 305 deletions
This file was deleted.

0 commit comments

Comments
 (0)