LMCache v1

LMCache v1 has all features of v0 (except KV blending) and more. Check out these examples to use latest features of LMCache v1.

v1 Examples

• CPU Offloading
• Disaggregated prefill
• P2P KV Cache Sharing
  • Prerequisites
  • Steps