Use LMCache in Production

Deploying, scaling, and operating LMCache in production.

• Deployment Guide
  • Docker
  • Isolated IPC (running without --ipc host)
  • Kubernetes
  • Production Best Practices
  • Transfer Mode (--supported-transfer-mode, --shm-name)
• Kubernetes Deployment
• Kubernetes Operator
  • Why Use the Operator
  • Prerequisites
  • Installing the Operator
  • Deploying an LMCacheEngine
  • Connecting vLLM
  • Connection Injection (Webhook)
  • Verifying the Deployment
  • CRD Spec Reference
  • Examples
  • CacheBlend
  • PD Disaggregation
  • LMCacheCoordinator
  • Operator vs Manual Deployment
  • Security Considerations
  • Development
• Runtime Plugins
  • Key Use Cases
  • Configuration
  • Runtime Plugin Naming Convention
  • Execution Model
  • Example Runtime Plugins
  • Best Practices
• Dynamo Integration