Allow ROCm arch override#1896
Conversation
|
Thanks @ailuntz. |
|
Thanks for the feedback. I reviewed the code and agree the override should be a fallback only when rocminfo fails, and keeping both env vars is unnecessary. I've updated the PR to use only BNB_ROCM_GPU_ARCH as a fallback and pushed the changes. |
|
Thanks. Can you update the existing error message to mention BNB_ROCM_GPU_ARCH as a workaround so users know what to do when rocminfo fails (ask users to install rocminfo first, if it's not possible then ask them to set the env variable) |
Fixes #1444.\n\nSupport BNB_ROCM_GPU_ARCH override when rocminfo is unavailable.