Skip to content

DMD2训练损失震荡 #1617

Description

@123lcy123

用1张80G 的A100训练flux2-klien-base-4b的少步蒸馏版本,参数为提供的默认参数,发现损失震荡严重,用训练后的权重推理发现效果也很差,请问是否有人成功训练过呢?

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions