apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity

[Model] support mode config for expert_dispatch (#5748)

Browse Source
This commit is contained in:
Longzhi Wang
2025-12-29 13:37:20 +08:00
committed by GitHub
parent 8ee055aafc
commit 11329ee35e
1 changed files with 5 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
custom_ops/gpu_ops/moe/ep_moe_expert_dispatch.cu
+5
View File
@@ -53,6 +53,11 @@
__VA_ARGS__ \
break; \
} \
case 10: { \
constexpr size_t NUM_EXPERTS_PER_RANK = 10; \
__VA_ARGS__ \
break; \
} \
case 16: { \
constexpr size_t NUM_EXPERTS_PER_RANK = 16; \
__VA_ARGS__ \