Skip to content

feat(quant): support tensorwise fp8 w8a8 (--quant_type fp8w8a8-pt)#1366

Open
sufubao wants to merge 1 commit into
ModelTC:stream_fcfrom
sufubao:support_fp8_pt
Open

feat(quant): support tensorwise fp8 w8a8 (--quant_type fp8w8a8-pt)#1366
sufubao wants to merge 1 commit into
ModelTC:stream_fcfrom
sufubao:support_fp8_pt

feat(quant): add triton fp8 w8a8 per-tensor quantization method

408a840
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs