Skip to content

docs: README — add NVIDIA GB10 (CUDA) support #36

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
prabod merged 1 commit into from
Jul 31, 2026
Merged

docs: README — add NVIDIA GB10 (CUDA) support #36

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
20 changes: 12 additions & 8 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,23 +2,24 @@

# BaseRT

**Fastest LLM inference runtime for Apple Silicon.**
**Fastest LLM inference on Apple Silicon — now on NVIDIA GB10 (DGX Spark), too.**

Pull a model from HuggingFace, chat with it, or serve an OpenAI-compatible API — all from one CLI.

[![Docs](https://img.shields.io/badge/docs-docs.basecompute.co-5b8fa8)](https://docs.basecompute.co)
[![License](https://img.shields.io/badge/license-Apache--2.0-blue)](LICENSE)
[![Platform](https://img.shields.io/badge/platform-Apple%20Silicon-black)](#requirements)
[![Platform](https://img.shields.io/badge/platform-Apple%20Silicon%20%C2%B7%20NVIDIA%20GB10-black)](#requirements)
[![Bindings](https://img.shields.io/badge/bindings-Python%20%C2%B7%20Node%20%C2%B7%20Rust%20%C2%B7%20Swift-444)](docs/bindings/index.md)

</div>

---

BaseRT runs large language models locally on Apple Silicon, accelerated by
hand-written Metal kernels. This repository is the open ecosystem around the
engine: the `basert` CLI (model hub + converter), the `.base` model format, the
public C API, and language bindings for Python, Node, Rust, and Swift.
BaseRT runs large language models locally on Apple Silicon (Metal) and NVIDIA
GB10 / DGX Spark (CUDA), accelerated by hand-written GPU kernels. This repository
is the open ecosystem around the engine: the `basert` CLI (model hub +
converter), the `.base` model format, the public C API, and language bindings for
Python, Node, Rust, and Swift.

- **One CLI for everything** — `basert pull`, `chat`, `serve`, `convert`.
- **OpenAI-compatible server** — chat, completions, embeddings, transcription,
Expand All @@ -33,7 +34,10 @@ public C API, and language bindings for Python, Node, Rust, and Swift.

## Requirements

One of:

- Apple Silicon (M1 or later), macOS 14+.
- NVIDIA GB10 (DGX Spark), Linux / arm64 with a CUDA driver.

## Quickstart

Expand All @@ -43,8 +47,8 @@ public C API, and language bindings for Python, Node, Rust, and Swift.
curl -LsSf https://basecompute.co/install.sh | sh
```

This installs the prebuilt engine and the `basert` CLI to `~/.basert` and adds
it to your `PATH`. Restart your shell afterward (or
This installs the prebuilt engine for your platform and the `basert` CLI to
`~/.basert` and adds it to your `PATH`. Restart your shell afterward (or
`export PATH="$HOME/.basert:$PATH"`). See
[Installation](docs/getting-started/installation.md) for building from source.

Expand Down
Loading