apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 21 Packages Projects Releases Wiki Activity

[Docs]fix sampling docs (#3113)

Browse Source 
* fix sampling docs

* fix sampling docs

* update
This commit is contained in:
Sunny-bot1
2025-08-11 20:42:27 +08:00
committed by GitHub
parent 8bf96217b4
commit 789dc67ff7
6 changed files with 14 additions and 8 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/online_serving/README.md
+3
View File
@@ -137,6 +137,9 @@ When sending requests using openai.Client, these parameters need to be placed in
The following sampling parameters are supported.
```python
bad_words: Optional[List[int]] = None
# List of forbidden words that the model should avoid generating (default None means no restriction).
top_k: Optional[int] = None
# Limits the consideration to the top K tokens with the highest probability at each generation step, used to control randomness (default None means no limit).