|
1 | 1 | --- |
2 | 2 | title: "Linux Installation" |
3 | | -description: "Install LocalAI on Linux using the installer script or binaries" |
| 3 | +description: "Install LocalAI on Linux using binaries" |
4 | 4 | weight: 3 |
5 | 5 | url: '/installation/linux/' |
6 | 6 | --- |
7 | 7 |
|
8 | | - |
9 | | -## One-Line Installer |
10 | | - |
11 | | -{{% notice warning %}} |
12 | | -**The `install.sh` script is currently experiencing issues and may produce broken or misconfigured installations. Please use alternative installation methods (Docker or manual binary installation) until [issue #8032](https://github.com/mudler/LocalAI/issues/8032) is resolved.** |
13 | | -{{% /notice %}} |
14 | | - |
15 | | -The fastest way to install LocalAI on Linux is with the installation script: |
16 | | - |
17 | | -```bash |
18 | | -curl https://localai.io/install.sh | sh |
19 | | -``` |
20 | | - |
21 | | -This script will: |
22 | | -- Detect your system architecture |
23 | | -- Download the appropriate LocalAI binary |
24 | | -- Set up the necessary configuration |
25 | | -- Start LocalAI automatically |
26 | | - |
27 | | -### Installer Configuration Options |
28 | | - |
29 | | -The installer can be configured using environment variables: |
30 | | - |
31 | | -```bash |
32 | | -curl https://localai.io/install.sh | VAR=value sh |
33 | | -``` |
34 | | - |
35 | | -#### Environment Variables |
36 | | - |
37 | | -| Environment Variable | Description | |
38 | | -|----------------------|-------------| |
39 | | -| **DOCKER_INSTALL** | Set to `"true"` to enable the installation of Docker images | |
40 | | -| **USE_AIO** | Set to `"true"` to use the all-in-one LocalAI Docker image | |
41 | | -| **USE_VULKAN** | Set to `"true"` to use Vulkan GPU support | |
42 | | -| **API_KEY** | Specify an API key for accessing LocalAI, if required | |
43 | | -| **PORT** | Specifies the port on which LocalAI will run (default is 8080) | |
44 | | -| **THREADS** | Number of processor threads the application should use. Defaults to the number of logical cores minus one | |
45 | | -| **VERSION** | Specifies the version of LocalAI to install. Defaults to the latest available version | |
46 | | -| **MODELS_PATH** | Directory path where LocalAI models are stored (default is `/var/lib/local-ai/models`) | |
47 | | -| **P2P_TOKEN** | Token to use for the federation or for starting workers. See [distributed inferencing documentation]({{%relref "features/distributed_inferencing" %}}) | |
48 | | -| **WORKER** | Set to `"true"` to make the instance a worker (p2p token is required) | |
49 | | -| **FEDERATED** | Set to `"true"` to share the instance with the federation (p2p token is required) | |
50 | | -| **FEDERATED_SERVER** | Set to `"true"` to run the instance as a federation server which forwards requests to the federation (p2p token is required) | |
51 | | - |
52 | | -#### Image Selection |
53 | | - |
54 | | -The installer will automatically detect your GPU and select the appropriate image. By default, it uses the standard images without extra Python dependencies. You can customize the image selection: |
55 | | - |
56 | | -- `USE_AIO=true`: Use all-in-one images that include all dependencies |
57 | | -- `USE_VULKAN=true`: Use Vulkan GPU support instead of vendor-specific GPU support |
58 | | - |
59 | | -#### Uninstallation |
60 | | - |
61 | | -To uninstall LocalAI installed via the script: |
62 | | - |
63 | | -```bash |
64 | | -curl https://localai.io/install.sh | sh -s -- --uninstall |
65 | | -``` |
66 | | - |
67 | 8 | ## Manual Installation |
68 | 9 |
|
69 | 10 | ### Download Binary |
|
0 commit comments