Skip to content

fix: correct LoRA initialization and forward pass under tensor parallelism#150

Open
chen2021673 wants to merge 6 commits into
masterfrom
lora_ddp_loss
Open

fix: correct LoRA initialization and forward pass under tensor parallelism#150
chen2021673 wants to merge 6 commits into
masterfrom
lora_ddp_loss

fix(lora): handle DDP module prefix for adapter weights

f408788
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar