Yonghua Li 8d27a523e7 [Feature] [KVCache] support attention_store kv cache backend (#5823) ...

* [feat] support attention_store kv cache backend

* [fix] fix codestyle

* [chore] optimize log

* [fix] fix write storage task

* [fix] fix read storage

* [fix] fix code conflict after merge develop

* [fix] fix cache bytes and read task token ids

* [chore] add model for cache transfer manager

* [chore] add some log

* [chore] remove launched_cache_manager_signal

* [fix] fix write_back_storage_task match_block_num condition

* [fix] fix swap_cost_time

* [ci] fix ci

* Update fastdeploy/engine/sched/resource_manager_v1.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update fastdeploy/cache_manager/cache_transfer_manager.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update fastdeploy/cache_manager/transfer_factory/mooncake_store/attention_store.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

2026-01-22 21:01:23 +08:00

..

transfer_factory

[Feature] [KVCache] support attention_store kv cache backend (#5823)

2026-01-22 21:01:23 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

cache_data.py

[Feature] Support KV Cache Storage (#5571)

2025-12-25 16:30:35 +08:00

cache_messager.py

[Feature] [KVCache] support attention_store kv cache backend (#5823)

2026-01-22 21:01:23 +08:00

cache_metrics.py

[BugFix] Refine the preparation of cpu and storage cache (#5777)

2026-01-05 10:13:30 +08:00

cache_tasks.py

[Feature] [KVCache] support attention_store kv cache backend (#5823)

2026-01-22 21:01:23 +08:00

cache_transfer_manager.py

[Feature] [KVCache] support attention_store kv cache backend (#5823)

2026-01-22 21:01:23 +08:00

multimodal_cache_manager.py

[Optimization] support mm prefill batch (#5313)

2025-12-11 22:21:14 +08:00

ops.py

[Metax] adapt prefix caching & cpu swap (#5844)

2025-12-31 17:02:48 +08:00

prefix_cache_manager.py

[Feature] [KVCache] support attention_store kv cache backend (#5823)

2026-01-22 21:01:23 +08:00