Skip to content

@LMCache LMCache

Change the repository type filter

All

    Repositories list

    20 repositories

    • LMCache

      Public
      Supercharge Your LLM with the Fastest KV Cache Layer
      fastamdcudainferencepytorchspeedrocmkv-cachellmvllm
      Python
      •
      Apache License 2.0
      •853•6.7k•168•109•Updated Jan 10, 2026Jan 10, 2026

    • lmcache-agent-trace

      Public
      Agent application/benchmark/workload traces should be placed here.
      Python
      •
      Apache License 2.0
      •2•3•0•1•Updated Jan 8, 2026Jan 8, 2026

    • LMCache-Ascend

      Public
      LMCache on Ascend
      Python
      •
      Apache License 2.0
      •18•44•30•2•Updated Jan 7, 2026Jan 7, 2026

    • lmcache_redis

      Public
      zero copy python sdk
      Python
      •1•1•0•1•Updated Jan 7, 2026Jan 7, 2026

    • lmcache_frontend

      Public
      the frontend of lmcache
      Python
      •7•17•5•1•Updated Dec 31, 2025Dec 31, 2025

    • LMBenchmark

      Public
      Systematic and comprehensive benchmarks for LLM systems.
      Python
      •
      Apache License 2.0
      •21•47•1•0•Updated Nov 24, 2025Nov 24, 2025

    • kvcache-view

      Public
      KV cache visualizations
      JavaScript
      •
      Other
      •0•6•0•0•Updated Nov 20, 2025Nov 20, 2025

    • LMBench

      Public
      Modular Serving Engine x Workload Generator Benchmarking Tool
      Python
      •
      Apache License 2.0
      •3•7•5•0•Updated Nov 19, 2025Nov 19, 2025

    • lmcache.github.io

      Public
      LMCache official blog
      HTML
      •
      MIT License
      •6•1•0•0•Updated Oct 29, 2025Oct 29, 2025

    • demo-baseline-benchmarking

      Public
      JavaScript
      •0•1•0•0•Updated Sep 26, 2025Sep 26, 2025

    • lmcache-agentic

      Public
      Python
      •1•4•0•0•Updated Sep 8, 2025Sep 8, 2025

    • LMIgnite

      Public
      Shell
      •
      Apache License 2.0
      •4•27•0•0•Updated Jul 29, 2025Jul 29, 2025

    • hardware-diagnostic

      Public
      View Information about hardware
      Python
      •0•4•0•0•Updated Jul 25, 2025Jul 25, 2025

    • LMCache-Examples

      Public
      Jupyter Notebook
      •1•7•0•0•Updated Jul 9, 2025Jul 9, 2025

    • inference-engine-arena

      Public
      Postman & Chatbot Arena for inference benchmarking.
      Python
      •
      Apache License 2.0
      •0•1•0•0•Updated May 14, 2025May 14, 2025

    • demo

      Public
      Python
      •
      Apache License 2.0
      •12•27•5•1•Updated Apr 17, 2025Apr 17, 2025

    • lmcache-tests

      Public
      Python
      •
      Apache License 2.0
      •8•9•8•2•Updated Apr 2, 2025Apr 2, 2025

    • lmcache-vllm

      Public
      The driver for LMCache core to run in vLLM
      Python
      •
      Apache License 2.0
      •32•58•4•6•Updated Feb 4, 2025Feb 4, 2025

    • torchac_cuda

      Public
      Cuda
      •
      Apache License 2.0
      •6•3•2•4•Updated Jan 30, 2025Jan 30, 2025

    • lmcache-server

      Public
      Python
      •
      Apache License 2.0
      •4•6•0•0•Updated Sep 17, 2024Sep 17, 2024