apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity

[Feature] consider multimodal model when dummy run (#6045)

Browse Source 
* add mm do profile

* updata code

* update code

* update code

* update code

* update test case

* update code

* update code

* fix xpu bug

* update code

* add mm do profile

* update test case

* update code
This commit is contained in:
kevin
2026-02-09 17:49:55 +08:00
committed by GitHub
parent 783d56e28a
commit d60daca4a8
25 changed files with 166 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tests/eplb/test_experts_manager.py
+1
View File
@@ -56,6 +56,7 @@ class TestRedundantExpertManager(unittest.TestCase):
model_cfg.moe_layer_start_index = 1
model_cfg.model = "/test/model"
model_cfg.architectures = ["test_model"]
model_cfg.mm_max_tokens_per_item = None
cache_cfg.bytes_per_layer_per_block = 1
parallel_cfg = ParallelConfig(args)