CLI Reference

The lmcache command-line interface provides tools for managing and inspecting LMCache servers.

lmcache <command> [options]

After installing LMCache, the lmcache command is available globally. Run lmcache -h to see all commands.

Available Commands

Command	Description
describe	Show detailed status of a running LMCache service.
query	Single-shot query interface for the serving engine.
ping	Liveness check for LMCache or vLLM servers.
bench	Run sustained performance benchmarks against an inference engine, an end-to-end sanity test against an LMCache MP server, or a throughput/latency benchmark against an L2 cache adapter.
kvcache	Manage KV cache state (e.g. clear L1 cache).
server	Launch the LMCache server (ZMQ + HTTP).

For a comprehensive guide with examples, see CLI Reference.

• lmcache bench engine
  • Quick Start
  • General Options
  • Workloads
  • Interactive Mode
  • Config File
  • Output
  • Exit Codes
• lmcache bench kvcache
  • What it does
  • Quick start
  • Options
  • KV cache shape spec
  • Example output
  • Exit codes
  • See also
• lmcache bench l2
  • What it does
  • Options
  • Adapter JSON spec
  • Example output
  • Round-trip verification
  • Exit codes
  • See also
• lmcache kvcache
  • clear
  • Common Patterns