From a43d3a50781bf6b5600d0af914b57edd82e40c05 Mon Sep 17 00:00:00 2001
From: alogotron <alogotron@users.noreply.github.com>
Date: Sun, 23 Aug 2026 08:49:20 +0100
Subject: [PATCH] docs(install): document NCCL dev libraries for multi-GPU
 tensor parallelism

---
 docs/install.md | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/docs/install.md b/docs/install.md
index f5205ab3..f7c09ed7 100644
--- a/docs/install.md
+++ b/docs/install.md
@@ -5,6 +5,10 @@
 - Linux x86_64, NVIDIA GPU, driver r580+ (CUDA 13)
 - Python >= 3.10, with [uv](https://docs.astral.sh/uv/) recommended (plain
   `pip` + `venv` works too)
+- Multi-GPU (`--tensor-parallel-size > 1`): NCCL development libraries for
+  the JIT link step, e.g. `sudo apt-get install libnccl2 libnccl-dev`.
+  Without them the first TP launch fails at link time with
+  `/usr/bin/ld: cannot find -lnccl`.
 
 ## Method 1: Install from PyPI