Production ready toolkit to run AI locally
-
Updated
Apr 17, 2026 - C++
Production ready toolkit to run AI locally
Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built in Swift. Fully offline. Open source.
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
Example apps for Foundation Models Framework in iOS 26 and macOS 26
Playground examples to demonstrate Foundation Models Framework
Any AI, full control of your Mac. 17 LLM providers (Claude, GPT, Gemini, Ollama, Apple Intelligence, and more) wired into a native Mac app that writes code, builds Xcode, manages git, automates Safari, drives any app via Accessibility, and runs tasks from your iPhone via iMessage. Zero subscriptions.
React Native Apple LLM plugin using Foundation Models
Decrypted Generative Model safety files for Apple Intelligence containing filters
'afm' command cli: macOS server and single prompt mode that exposes Apple's Foundation and MLX Models and other APIs running on your Mac through a single aggregated OpenAI-compatible API endpoint. Supports Apple Vision and single command (non-server) inference with piping as well . Now with Web Browser and local AI API aggregator
macOS menu bar app that exposes Apple's on-device Foundation Models as an OpenAI-compatible local API. Zero cloud. Zero dependencies.
A text-based language for writing Apple Shortcuts. Experimental.
A powerful command-line interface for Foundation Models on Apple platforms.
Custom implementation of Apple Intelligence features
Open-source AI chat app powered by Apple Foundation Models. Runs in any browser. Self-hosted. Private. No cloud.
A C library for embedding Apple Intelligence on-device Foundation models in any programming language or application with full support for native tool calling and MCP.
On-device shell command generator for macOS Tahoe. Uses Apple's 3B model with dynamic few-shot retrieval from 21k tldr examples.
A Swift command-line interface tool for interacting with macOS Apple Intelligence foundation models.
Autocorrection, synonym suggestions for the word under the cursor, and rephrasing of the selected text. All with one key press.
Add a description, image, and links to the apple-intelligence topic page so that developers can more easily learn about it.
To associate your repository with the apple-intelligence topic, visit your repo's landing page and select "manage topics."