KV Cache 管理#
备注
MP(多进程)缓存管理接口层(如 move、pin 和 compress 等操作)即将 推出。
Until it lands, the in-process management commands are documented in the Legacy section: LMCache Controller.
备注
MP(多进程)缓存管理接口层(如 move、pin 和 compress 等操作)即将 推出。
Until it lands, the in-process management commands are documented in the Legacy section: LMCache Controller.