Skip to content

Let a transformer block initialize its residual projections - #83

Merged
jessegrabowski merged 2 commits into
pymc-devs:mainfrom
jessegrabowski:transformer-initializers
Aug 11, 2026
Merged

Let a transformer block initialize its residual projections#83
jessegrabowski merged 2 commits into
pymc-devs:mainfrom
jessegrabowski:transformer-initializers

Forward a residual initializer through TransformerBlock

0b231c4
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 warnings
unittest (ubuntu-latest, 3.12, rest)
succeeded Aug 11, 2026 in 3m 18s