apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity
Files
fba8a51ad1c9f911db28bbc7e8b9345057d82b41
FastDeploy/examples/splitwise
T
History
mouxin 506f1545cd [Feature] Enhance Router with /v1/completions, docs, scripts, and version info (#5966) 
* [Doc] Update prerequisites in the documentation

* [Feature] Enhance Router with /v1/completions, docs, scripts, and version info

* [Feature] Enhance Router with /v1/completions, docs, scripts, and version info

---------

Co-authored-by: mouxin <mouxin@baidu.com>
2026-01-30 10:28:48 +08:00
..
README.md
[PD Disaggregation] Update usage of pd disaggregation and data parallel (#5742)
2026-01-05 17:51:29 +08:00
start_mixed.sh
[PD Disaggregation] [Refine] Refine splitwise deployment (#5151)
2025-11-21 15:30:24 +08:00
start_v0_tp1.sh
[PD Disaggregation] Update usage of pd disaggregation and data parallel (#5742)
2026-01-05 17:51:29 +08:00
start_v1_dp2.sh
[PD Disaggregation] Update usage of pd disaggregation and data parallel (#5742)
2026-01-05 17:51:29 +08:00
start_v1_tp1.sh
[PD Disaggregation] Update usage of pd disaggregation and data parallel (#5742)
2026-01-05 17:51:29 +08:00
start_v1_tp2.sh
[PD Disaggregation] Update usage of pd disaggregation and data parallel (#5742)
2026-01-05 17:51:29 +08:00
stop.sh
[PD Disaggregation] Support PD deployment of DeepSeekv3. (#5251)
2025-12-02 14:11:50 +08:00
test.sh
[Feature] [PD] add simple router and refine splitwise deployment (#4709)
2025-11-06 14:56:02 +08:00
utils.sh
[Feature] [PD Disaggregation] simplify configuration for pd-disaggregated deployment, and refactor post-init and usage for all ports (#5415)
2025-12-17 15:50:42 +08:00

README.md

PD分离式部署，请参考使用文档。

PD分离式部署，推荐使用Router来做请求调度（即是V1模式）。

启动脚本：

  • start_v1_tp1.sh：使用Router调度，P和D实例是TP1。
  • start_v1_tp2.sh：使用Router调度，P和D实例是TP2。
  • start_v1_dp2.sh：使用Router调度，P和D实例是DP2 TP1。
Reference in New Issue View Git Blame Copy Permalink