KV Cache Management#
Note
The multiprocess (MP) cache-management surface (operations such as
move, pin, and compress) is coming soon.
Until it lands, the in-process management commands are documented in the Legacy section: LMCache Controller.
Note
The multiprocess (MP) cache-management surface (operations such as
move, pin, and compress) is coming soon.
Until it lands, the in-process management commands are documented in the Legacy section: LMCache Controller.