LMCache

About

A KV cache management layer that accelerates LLM inference by turning temporary cache into reusable knowledge that persists across sessions. Reduces time-to-first-token and improves throughput for long-context and multi-turn conversations.