LMCache Integration

Subpackages

• lmcache.integration.vllm package
  • Submodules
  • lmcache.integration.vllm.utils module
    • lmcache_get_config()
  • lmcache.integration.vllm.vllm_adapter module
    • RetrieveStatus
      • RetrieveStatus.CHUNK_PREFILL
      • RetrieveStatus.NONE
      • RetrieveStatus.PREFILL
    • StoreStatus
      • StoreStatus.CHUNK_PREFILL
      • StoreStatus.DECODE
      • StoreStatus.NONE
      • StoreStatus.PREFILL
      • StoreStatus.SUFFIX_PREFILL
    • broadcast_seq_group_list()
    • build_partial_prefill_input()
    • close_lmcache_engine()
    • init_lmcache_engine()
    • lmcache_retrieve_kv()
    • lmcache_should_retrieve()
    • lmcache_should_store()
    • lmcache_store_kv()
  • Module contents

Module contents