Add Echo-Memory optional loader and Wan 1.3B example - #1592
Conversation
Overlay the released context_k1 DiT fine-tune onto official Wan 2.1 1.3B without changing the core pipeline. Extra action/SSM keys stay in the Echo-Memory research stack. Co-authored-by: Cursor <cursoragent@cursor.com>
|
@WayneJin0918 Thanks for your contribution! We'll merge this PR after some code cleanup. Also, for future development, feel free to check out our skills guide. It can help you write code that aligns with the framework's best practices more quickly: https://modelscope.cn/collections/DiffSynth-Studio/DiffSynth-Studio-Model-Integration-Skills |
|
Thanks @Artiprocher — appreciated. We'll leave the cleanup to you unless you want a specific change from our side. If it helps, the loader is intentionally a thin overlay ( Skills guide noted for later rows. |
|
@WayneJin0918 As this open-source project is built upon the ModelScope platform, we would kindly ask you to upload your model to ModelScope first. Once that's done, we'll be more than happy to provide full support for it. Thank you for your understanding! |
|
@WayneJin0918 Additionally, we noticed that the model you provided doesn't include the complete set of weights. Would you mind packaging it into a full weight file? This would allow us to integrate the model in line with the framework's best practices and ensure proper support for training. We really appreciate your help! |
|
Thanks @Artiprocher — we'll do both.
If you also want the research extras ( Happy to point #1612 at the ModelScope id once it's up. |
Summary
context_k1DiT fine-tune onto officialWan-AI/Wan2.1-T2V-1.3B.This is a community fine-tune overlay, not a new backbone. The multi-chunk camera-action / revisit protocol stays in Echo-Memory (arXiv:2606.09803).
Test plan
python examples/wanvideo/model_inference/Echo-Memory.pywith Wan 2.1 1.3B and Hugging Face access toEcho-Team/Echo-MemoryMade with Cursor