Commit b252779
committed
feat: replace trivial all-1.0 weights with true FP32 random initialization
Xavier uniform init for MatMul weights, RMSNorm weights ~1.0±0.15,
diverse random inputs. Verified 0/64 errors on both tiled and untiled.1 parent 623baed commit b252779
5 files changed
Lines changed: 7 additions & 5 deletions
File tree
- DeeployTest/Tests/Models/microLlama/FP32/microLlama1
- Deeploy/Targets/Snitch/Templates
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| 7 | + | |
| 8 | + | |
7 | 9 | | |
8 | 10 | | |
9 | 11 | | |
| |||
19 | 21 | | |
20 | 22 | | |
21 | 23 | | |
22 | | - | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
23 | 27 | | |
24 | | - | |
25 | | - | |
| 28 | + | |
26 | 29 | | |
27 | | - | |
28 | | - | |
| 30 | + | |
29 | 31 | | |
30 | 32 | | |
31 | 33 | | |
| |||
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file not shown.
0 commit comments