Observability

Warning

This page documents the behavior of LMCache’s in-process mode (deprecated). Please consider using LMCache MP mode for better feature support and performance. For the MP mode equivalent of this page, see Observability.

• Metrics by vLLM API
  • Quick Start Guide
  • Available Metrics
• Internal API Server Metrics
  • Overview
  • Quick Start Guide
  • Port Configuration
  • Advanced Usage
• Metrics Reference
  • Available Metrics
• Chunk Statistics
  • Overview
  • Recording Strategies
  • Quick Start Guide
  • Configuration Options
  • Advanced Usage
  • Best Practices
  • Troubleshooting
• Health Monitor
  • Overview
  • Architecture
  • Auto-Discovery
  • Configuration
  • How It Works
  • Built-in Health Checks
  • Prometheus Metrics
  • Error Codes
  • Extending the Health Monitor
• Periodic Thread Monitoring API
  • Overview
  • API Endpoints
  • Thread Levels
  • IrrecoverableException Handling
  • Usage Examples
• LMCache Frontend
  • Features
  • Installation
  • Quick Start
  • Configuration
  • Proxying Requests
  • Contributing
  • More Information