mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2026-04-23 00:17:25 +08:00
Update serving parameters description
This commit is contained in:
committed by
XieYunshen
parent
8e6faa999c
commit
3d44c7a3e9
+1
-1
@@ -3,7 +3,7 @@
|
||||
使用如下命令进行服务部署
|
||||
|
||||
```bash
|
||||
python -m fastdeploy.entrypoints.openai.api_server --model ernie-45-turbo --port 8188 --tensor-parallel-size 8
|
||||
python -m fastdeploy.entrypoints.openai.api_server --model qwen2 --port 8188 --tensor-parallel-size 1
|
||||
```
|
||||
|
||||
其中api_server支持的参数包括
|
||||
|
||||
Reference in New Issue
Block a user