Search | LMCache

Skip to content

⌘ K

LMCache

Getting Started

3 Min Quick Example: Docker + Speedup with vLLM
Pip Installation
Docker Installation

Detailed Examples

Usage
Saving the decode cache
KV blending
Selecting a backend
End-to-end measurements

Models

Supported Models

Configuration

Configuring LMCache

Developer Documentation

LMCache Overview
LLM Engine
LMCache Engine
LMCache Backend

Advanced

LMCache Blend
LMCache Server
LMCache Storage Backend

/

Search

Please activate Javascript to enable searching the documentation.

© 2024, The LMCache Team Built with Sphinx 7.3.7