Controller WebUI#

Overview#

The LMCache Controller provides a web-based dashboard for monitoring your LMCache instances. This web interface allows you to monitor system status, instances, workers, and performance metrics.

Quick Start#

To enable the Controller WebUI, start your LMCache instance with the following command:

python3 -m lmcache.v1.api_server \
    --host 0.0.0.0 \
    --port 9000 \
    --monitor-ports '{"pull":8300,"reply":8400}' \
    --lmcache-worker-timeout 100 \
    --health-check-interval 10

After starting the controller, access the WebUI at:

http://localhost:9000/

Configuration Options#

  • --host: Bind address for the API server (default: 0.0.0.0)

  • --port: Port for the API server (default: 9000)

  • --monitor-ports: ZMQ ports for controller communication

  • --lmcache-worker-timeout: Worker timeout in seconds

  • --health-check-interval: Health check interval in seconds

Dashboard Features#

The Controller Dashboard provides:

  • System overview and health monitoring

  • Instance and worker management

  • Performance metrics

  • Thread information

  • Environment variables inspection