CLI Reference

The lmcache command-line interface provides tools for managing and inspecting LMCache servers.

lmcache <command> [options]

After installing LMCache, the lmcache command is available globally. Run lmcache -h to see all commands.

Available Commands

Command	Description
describe	Show detailed status of a running LMCache service.
query	Single-shot query interface for the serving engine.
ping	Liveness check for LMCache or vLLM servers.
bench	Run sustained performance benchmarks against an inference engine.
kvcache	Manage KV cache state (e.g. clear L1 cache).
server	Launch the LMCache server (ZMQ + HTTP).

For a comprehensive guide with examples, see CLI Reference.

• lmcache bench engine
  • Quick Start
  • General Options
  • Workloads
  • Interactive Mode
  • Config File
  • Output
  • Exit Codes
• lmcache kvcache
  • clear
  • Common Patterns