KV Cache Size Calculator

Use this interactive calculator to:

• Calculate KV Cache Size: Estimate the memory required for caching a specific number of tokens

• Calculate Maximum Tokens: Find out how many tokens you can cache given your available GPU RAM

This helps you plan memory requirements for your LMCache deployment.