Skip to content

[MUSA] Add visible-device alias support - #106

Open
froststeam wants to merge 1 commit into
MooreThreads:mainfrom
froststeam:musa-graph-safe-ops
Open

[MUSA] Add visible-device alias support#106
froststeam wants to merge 1 commit into
MooreThreads:mainfrom
froststeam:musa-graph-safe-ops

Conversation

@froststeam

Copy link
Copy Markdown
Contributor

Model

  • MOSS-TTS-Local

Launch

  • SGLang 0.5.16 MUSA 4.3.5 container
  • docker create / docker start / docker exec launch flow with MTHREADS_VISIBLE_DEVICES, GLOO_SOCKET_IFNAME, and TP_SOCKET_IFNAME

Performance

  • pytest -q tests/test_cuda_patching.py -k visible_devices_env -> 1 passed
  • pytest -q tests/test_log.py tests/test_multinomial.py -> 8 passed
  • pytest -q tests/test_platform.py -k "is_musa_platform or get_backend or is_gpu_device" -> 2 passed, 8 deselected
  • MOSS-TTS-Local startup smoke on the same MUSA stack reaches model initialization with the visible-device aliasing fix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant