jc 04fde3b227 [PD Disaggregation] Prefill and decode support cache storage (#6768) ...

* Prefill and decode support cache storage

* up

* up

* update docs and refine mooncake store

* up

2026-03-16 14:44:49 +08:00

..

file_store

[Feature] [KVCache] support file_store kv cache backend (#6188)

2026-02-03 14:37:58 +08:00

kvcache_transfer

[PD Disaggregation] Fix cache messager performance problem & add kv transfer benchmark tool (#6434)

2026-03-02 14:28:14 +08:00

mooncake_store

[PD Disaggregation] Prefill and decode support cache storage (#6768)

2026-03-16 14:44:49 +08:00

__init__.py

[Feature] [KVCache] support file_store kv cache backend (#6188)

2026-02-03 14:37:58 +08:00

get_rdma_nics.sh

[BugFix] [MultiAPIServer] fix rdma script and port check for multi api server (#5935)

2026-01-12 10:38:52 +08:00

ipc_cache_transfer.py

[Feature] support rdma pd dy-c8 (#5788)

2026-01-07 14:55:25 +08:00

kvcache_storage.py

[Feature] [KVCache] support attention_store kv cache backend (#5823)

2026-01-22 21:01:23 +08:00

rdma_cache_transfer.py

[Feature] RDMACommunicator send key and value scale (#5737)

2026-01-05 10:04:24 +08:00

utils.py

[Feature] Support KV Cache Storage (#5571)

2025-12-25 16:30:35 +08:00