Pinned Loading

1. asr-pool asr-pool Public

   FastAPI ASR pool with SSE completions, warm WhisperX runner slots, queue scheduling, pending-status updates, and artifact endpoints.

   Python

2. llm-pool llm-pool Public

   FastAPI LLM pool for local and OpenAI-compatible remote inference, with multimodal input, scheduling, replicas, metrics, and admin APIs.

   Python

3. omni-translate-app omni-translate-app Public

   Mobile-first FastAPI and web app for live speech and image translation, coordinating ASR, LLM, TTS, voice-library, and image-translation services.

   Python

4. tts-pool tts-pool Public

   FastAPI TTS pool with Kokoro, VoxCPM2, and NanoVLLM-VoxCPM backends, a common synthesis API, queue scheduling, runtime model management, metrics, and GPU memory inspection.

   Python

5. image-pool image-pool Public

   FastAPI image generation/editing pool with Diffusers backends, queue scheduling, runtime model management, metrics, and GPU memory inspection.

   Python

6. llm-workbench llm-workbench Public

   Browser shell for local AI service consoles and workflow playgrounds, with LLM/TTS/Image pool management, image training, translation services, and replay tools.

   JavaScript