Cosmos3 Distilled support#14177
Conversation
yiyixuxu
left a comment
There was a problem hiding this comment.
thanks!
i left some comments
|
Hi @yzhautouskay, thanks for the PR! It does not appear to link an issue it fixes. If this PR addresses an existing issue, please add a closing keyword (e.g. |
|
thanks @yiyixuxu! I've refactored it to have separate |
|
@yzhautouskay can you resolve the conflict? |
177ee1e to
3ac7ec0
Compare
3ac7ec0 to
abb37e7
Compare
yiyixuxu
left a comment
There was a problem hiding this comment.
thanks, I left some comments
| ] | ||
|
|
||
|
|
||
| def _fake_distilled_components(t_list=(1.0, 0.75, 0.5, 0.25)): |
There was a problem hiding this comment.
can you update the test to use ModularPipelineTesterMixin?
https://github.com/huggingface/diffusers/blob/main/tests/modular_pipelines/flux2/test_modular_pipeline_flux2_klein.py
There was a problem hiding this comment.
Done, distilled tests now use ModularPipelineTesterMixin. For now tiny fixture lives under my personal account at yzhautouskay/tiny-cosmos3-distilled-modular-pipe
Could you create hf-internal-testing/tiny-cosmos3-distilled-modular-pipe and copy it over ? I'll then flip the TINY_DISTILLED_REPO constant in the test (and pretrained_model_name_or_path will need to be changed for components in modular_model_index.json)
What does this PR do?
Cosmos3 distilled (few-step) support
Adds inference support for the distilled few-step Cosmos3 checkpoints through the
modular pipeline (
Cosmos3OmniModularPipeline).Checkpoints supported
nvidia/Cosmos3-Super-Text2Image-4Step(distilled T2I)nvidia/Cosmos3-Super-Image2Video-4Step(distilled I2V)Both ship a
FlowMatchEulerDiscreteSchedulerwith a fixed sigma schedule(
scheduler.config.fixed_step_sampler_config.t_list) and bake classifier-freeguidance into the weights. They are only supported via the modular pipeline; the
task-based
Cosmos3OmniPipelinedoes not implement the distilled contract.Before submitting
.ai/review-rules.md?documentation guidelines, and
here are tips on formatting docstrings.
Who can review?
Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.