Fix Stage 0 + Ulysses crash: make bwc_tensor_model_parallel_rank() resilient to MP API absence#7888
Open
nathon-lee wants to merge 8 commits intodeepspeedai:masterfrom
Open
Fix Stage 0 + Ulysses crash: make bwc_tensor_model_parallel_rank() resilient to MP API absence#7888nathon-lee wants to merge 8 commits intodeepspeedai:masterfrom
nathon-lee wants to merge 8 commits intodeepspeedai:masterfrom