Using Different Storage Backends

LMCache supports various storage backends to offload and share KV cache data.

Supported Backends

• CPU RAM
• Custom Storage Backends
• Device-DAX (/dev/dax)
• EIC
• Filesystem Backend
• GDS Backend
• Hugging Face Buckets Backend
• InfiniStore
• Local storage
• Maru
• Mock
• Mooncake
• Nixl
• Redis
• Google Cloud Bigtable
• RESP (Native Redis/Valkey)
• S3 Backend
• SageMaker Hyperpod
• Valkey
• Weka
• 3FS