diff --git a/docs/install.md b/docs/install.md index f5205ab..f7c09ed 100644 --- a/docs/install.md +++ b/docs/install.md @@ -5,6 +5,10 @@ - Linux x86_64, NVIDIA GPU, driver r580+ (CUDA 13) - Python >= 3.10, with [uv](https://docs.astral.sh/uv/) recommended (plain `pip` + `venv` works too) +- Multi-GPU (`--tensor-parallel-size > 1`): NCCL development libraries for + the JIT link step, e.g. `sudo apt-get install libnccl2 libnccl-dev`. + Without them the first TP launch fails at link time with + `/usr/bin/ld: cannot find -lnccl`. ## Method 1: Install from PyPI