Skip to content

⌘ K

Getting Started

3 Min Quick Example: Docker + Speedup with vLLM
Pip Installation
Docker Installation

Configure LMCache

LMCache v1
- Configuring LMCache v1
LMCache v0
- Configuring LMCache v0

Detailed Examples

LMCache v1
LMCache v0

Models

Supported Models

Developer Documentation

LMCache Overview
LLM Engine
LMCache Engine
LMCache Backend

Advanced

LMCache Blend
LMCache Server
LMCache Storage Backend
LMCache Experimental
LMCache Integration

/

LMCache v1

LMCache v1#

v1 Configure LMCache

Configuring LMCache v1
- Using a YAML configuration file
- Using environment variables

Docker Installation

Configuring LMCache v1

© 2024, The LMCache Team Built with Sphinx 7.4.7