radix-attention

Here are 2 public repositories matching this topic...

High-performance On-Device MoA (Mixture of Agents) Engine in C++. Optimized for CPU inference with RadixCache & PagedAttention. (Tiny-MoA Native)

c cpp moa on-device-ai llm llamacpp llama-cpp ggml paged-attention cpu-optimization mixture-of-agents radix-attention

🤖 Enhance task management with Tiny MoA, a GPU-free multi-agent system that plans, reasons, and collaborates efficiently in real time.

c lightweight cpp falcon agents moa uv on-device-ai llm llamacpp llama-cpp ggml paged-attention cpu-optimization tool-calling lfm2 radix-attention

Add a description, image, and links to the radix-attention topic page so that developers can more easily learn about it.

To associate your repository with the radix-attention topic, visit your repo's landing page and select "manage topics."