Jiang-Jia-Jun b05a6c4206 [BugFix][KVCache] Add inter-process lock to fix NaN error under DP+EP (#6724) ...

* [BugFix] Support  to fix NaN bug in EP

* Optimze notion for all the funs

* Fix potential lock contention failure issues

* Update fastdeploy/inter_communicator/ipc_signal.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update envs.py

* Update default value for USE_KVCACHE_LOCK

Change default value of USE_KVCACHE_LOCK from 1 to 0.

* Update worker_process.py

* Fix suffix wrong

* Update test_prefix_cache_manager.py

---------

Co-authored-by: Jiang-Jia-Jun <jiangjiajun@baidu.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

2026-03-10 21:55:32 +08:00

..

transfer_factory

[PD Disaggregation] Fix cache messager performance problem & add kv transfer benchmark tool (#6434)

2026-03-02 14:28:14 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

cache_data.py

[Feature] Support KV Cache Storage (#5571)

2025-12-25 16:30:35 +08:00

cache_messager.py

[Others] Fix typos in log messages and comments (#6707)

2026-03-09 10:26:25 +08:00

cache_metrics.py

[BugFix] Refine the preparation of cpu and storage cache (#5777)

2026-01-05 10:13:30 +08:00

cache_tasks.py

[Feature] [KVCache] support attention_store kv cache backend (#5823)

2026-01-22 21:01:23 +08:00

cache_transfer_manager.py

[BugFix] Fix error in dynamic c8 cache (#6544)

2026-03-06 10:11:23 +08:00

multimodal_cache_manager.py

[Optimization] support mm prefill batch (#5313)

2025-12-11 22:21:14 +08:00

ops.py

[Metax] adapt prefix caching & cpu swap (#5844)

2025-12-31 17:02:48 +08:00

prefix_cache_manager.py

[BugFix][KVCache] Add inter-process lock to fix NaN error under DP+EP (#6724)

2026-03-10 21:55:32 +08:00