LMCache
LLM Providers
- Pricing
- Open source
- Open source
- Yes
- API
- Not listed
- Rating
- No reviews
- GitHub
- 11,891 stars
- Adoption
- Public evidence pending
- Benchmark
- No benchmark data
- Best for
- KV-cache layer for LLM serving that reduces latency and cost for repeated or shared model
- Tradeoff
- More control and inspectability, but more setup and operational ownership.
