Skip to content

Pull requests: NousResearch/torchtitan

New pull request New
21 Open 49 Closed
21 Open 49 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat(grpo): zero-copy SHM transport and high-throughput trajectory reassembly logic
#70 opened Apr 10, 2026 by RUFFY-369 Loading…
feat(grpo): distributed reward normalization across training mesh
#69 opened Apr 2, 2026 by RUFFY-369 Loading…
feat(grpo): real-time numerical health monitor for training stability
#68 opened Apr 2, 2026 by RUFFY-369 Loading…
feat(grpo): asynchronous weight synchronization with vLLM background streams
#67 opened Apr 2, 2026 by RUFFY-369 Loading…
feat(grpo): context-parallel (CP) loss alignment and reduction
#66 opened Apr 2, 2026 by RUFFY-369 Loading…
feat(grpo): distributed parameter synchronization for sharded FSDP2 weights
#65 opened Apr 2, 2026 by RUFFY-369 Loading…
Add FA4 context parallel ring attention (round_robin + striped)
#64 opened Apr 1, 2026 by ighoshsubho Loading…
3 tasks done
feat: custom cpu offload engine
#63 opened Mar 26, 2026 by xrsrke • Draft
feat: autotune deepep
#62 opened Mar 19, 2026 by xrsrke • Draft
80b changes
#61 opened Mar 18, 2026 by rob-maron • Draft
4
feat: FA4
#56 opened Mar 5, 2026 by xrsrke Loading…
Lora save load
#51 opened Feb 19, 2026 by dmahan93 Loading…
Basic RL Testing
#50 opened Feb 18, 2026 by samherring99 Loading…
2
add moe noise
#49 opened Feb 13, 2026 by dmahan93 Loading…
RL Test Script
#46 opened Jan 24, 2026 by samherring99 • Draft
feat: support kimi 1t training
#45 opened Jan 20, 2026 by xrsrke • Draft
feat: add batch size scheduler for dynamic batch size warmup/rampup
#39 opened Jan 15, 2026 by xrsrke • Draft
feat: Add multi-stage data training support
#37 opened Jan 15, 2026 by xrsrke Loading…
[Feature] Add online evals during training
#30 opened Jan 9, 2026 by xrsrke Loading…
docs: fixed old links to actual
#8 opened Oct 15, 2025 by letmehateu Loading…
mistral small
#3 opened Jul 23, 2025 by sumo43 Loading…
ProTip! Exclude everything labeled bug with -label:bug.