Skip to content

[JAX] Remove shard_map from MoEBlock to support quant before FSDP AG using Grouped quant+GEMM custom partitioning rules#3131

Draft
jberchtold-nvidia wants to merge 38 commits into
NVIDIA:mainfrom
jberchtold-nvidia:jberchtold/quant-before-fsdp-ag-gmm
Draft

[JAX] Remove shard_map from MoEBlock to support quant before FSDP AG using Grouped quant+GEMM custom partitioning rules#3131
jberchtold-nvidia wants to merge 38 commits into
NVIDIA:mainfrom
jberchtold-nvidia:jberchtold/quant-before-fsdp-ag-gmm

Commits

Commits on May 26, 2026

Commits on Jun 1, 2026

Commits on Jun 2, 2026

Commits on Jun 3, 2026

Commits on Jun 4, 2026

Commits on Jun 8, 2026

Commits on Jun 9, 2026

Commits on Jun 15, 2026