Skip to content

Pull requests: foundation-model-stack/fms-fsdp

New pull request New
10 Open 98 Closed
10 Open 98 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Various dataloader updates and fixes
#144 opened May 23, 2025 by daviswer Collaborator Loading…
1
Add zloss and partial weight decay
#136 opened Apr 15, 2025 by daviswer Collaborator Loading…
Add support for Mamba-MoE
#129 opened Jan 23, 2025 by lchu6 Contributor Loading…
1
Add support for FIM training
#125 opened Jan 10, 2025 by daviswer Collaborator Loading…
Enable HF PretrainedModel loading for speculative model training
#122 opened Oct 18, 2024 by JRosenkranz Collaborator • Draft
@JRosenkranz
3
Suppress spammy warnings
#120 opened Oct 10, 2024 by daviswer Collaborator Loading…
Remove embed_* variants of model architectures in speculator training
#115 opened Sep 10, 2024 by sahilsuneja1 Collaborator Loading…
Add regression tests for get_latest and get_oldest functions
#110 opened Aug 15, 2024 by weiji14 Loading…
5
Minimal implementation of muP scaling for Llama
#98 opened Jul 22, 2024 by daviswer Collaborator Loading…
[peculator training] Update benchmark_speculator_logical.py to support gpt_bigcode/granite speculator training
#62 opened Mar 22, 2024 by sahilsuneja1 Collaborator Loading…
12
ProTip! Exclude everything labeled bug with -label:bug.