apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity

[Docs] Add docs for disaggregated deployment (#6700)

Browse Source 
* add docs for disaggregated deployment

* pre-commit run for style check

* update docs
This commit is contained in:
Jingfeng Wu
2026-04-01 19:27:09 +08:00
committed by GitHub
parent ceaf5df350
commit 3b564116d5
6 changed files with 513 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/features/disaggregated.md
+2
View File
@@ -1,5 +1,7 @@
[简体中文](../zh/features/disaggregated.md)
[Best Practice](../best_practices/Disaggregated.md)
# Disaggregated Deployment
Large Language Model (LLM) inference is divided into two phases: **Prefill** and **Decode**, which are compute-intensive and memory-bound, respectively.