Using Different Storage Backends

LMCache supports various storage backends to offload and share KV cache data.

Supported Backends

• CPU RAM
• Custom Storage Backends
• Device-DAX (/dev/dax)
• EIC
• GDS Backend
• InfiniStore
• Local storage
• Mock
• Mooncake
• Nixl
• Redis
• RESP (Native Redis/Valkey)
• S3 Backend
• SageMaker Hyperpod
• Valkey
• Weka