Skip to content

Refactor async HF writer status files#1849

Open
caixianzhang wants to merge 1 commit into
InternLM:mainfrom
caixianzhang:feat/async-hf-writer-status-dir
Open

Refactor async HF writer status files#1849
caixianzhang wants to merge 1 commit into
InternLM:mainfrom
caixianzhang:feat/async-hf-writer-status-dir

Conversation

@caixianzhang
Copy link
Copy Markdown
Contributor

Summary

  • move async HF writer status JSON files into a per-save status directory
  • clean up the status directory during successful async HF finalization
  • keep the change independent from PR feat: add rank0 async HF save logs #1845

Validation

  • ruff check xtuner/v1/model/base.py xtuner/v1/model/compose/base.py
  • python3 -m py_compile xtuner/v1/model/base.py xtuner/v1/model/compose/base.py
  • git diff --check

@caixianzhang caixianzhang force-pushed the feat/async-hf-writer-status-dir branch from b87a9a6 to 996d4c3 Compare May 27, 2026 11:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant