apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 21 Packages Projects Releases Wiki Activity

[RL] add version to the key of cache storage && refine raising error (#6160)

Browse Source 
* Waiting for cache transfer manager inited

* up

* up

* up

* up

* up

* fix according comments

* fix unittest

* fix

* fix unittest

* fix error

* pass storage_backend to worker
This commit is contained in:
jc
2026-01-27 10:47:46 +08:00
committed by GitHub
parent 7ffa88bb01
commit b1698a79cb
8 changed files with 121 additions and 107 deletions
Download Patch File Download Diff File Expand all files Collapse all files
fastdeploy/engine/engine.py
+1
View File
@@ -603,6 +603,7 @@ class LLMEngine:
worker_default_none_flag = {
"num_gpu_blocks_override": self.cfg.cache_config.num_gpu_blocks_override,
"kvcache_storage_backend": self.cfg.cache_config.kvcache_storage_backend,
}
for worker_flag, value in worker_default_none_flag.items():
if value: