mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2026-04-23 00:17:25 +08:00
[Feature] Fix counter release logic & update go-router download URL (#6280)
* [Doc] Update prerequisites in the documentation * [Feature] Enhance Router with /v1/completions, docs, scripts, and version info * [Feature] Enhance Router with /v1/completions, docs, scripts, and version info * [Feature] Enhance Router with /v1/completions, docs, scripts, and version info * [Feature] Fix counter release logic * [Feature] Update go-router download URL * [Feature] Update go-router download URL * [Feature] Update go-router download URL * [Feature] Update go-router download URL * [Feature] Update token counter logic and docs * [Feature] Update token counter logic and docs --------- Co-authored-by: mouxin <mouxin@baidu.com>
This commit is contained in:
@@ -67,11 +67,11 @@ bash build.sh
|
||||
|
||||
**Quick Start**
|
||||
|
||||
Start the Router service. The `--splitwise` parameter specifies the scheduling mode as disaggregated deployment. Log information is output to `log_router/router.log`.
|
||||
Start the Router service. The `--splitwise` parameter specifies the scheduling mode as disaggregated deployment. Log information is output to `log_router/router.log`. `fd-router` installation instructions can be found in the [Router documentation](../online_serving/router.md).
|
||||
|
||||
```bash
|
||||
export FD_LOG_DIR="log_router"
|
||||
python -m fastdeploy.router.launch \
|
||||
/usr/local/bin/fd-router \
|
||||
--host 0.0.0.0 \
|
||||
--port 30000 \
|
||||
--splitwise
|
||||
|
||||
Reference in New Issue
Block a user