apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity

add detoken switch (#5463)
CE Compile Job / ce_job_pre_check (push) Has been cancelled
Details
CE Compile Job / print_ce_job_pre_check_outputs (push) Has been cancelled
Details
CE Compile Job / FD-Clone-Linux (push) Has been cancelled
Details
CE Compile Job / Show Code Archive Output (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8090 (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8689 (push) Has been cancelled
Details
CE Compile Job / CE_UPLOAD (push) Has been cancelled
Details
Deploy GitHub Pages / deploy (push) Has been cancelled
Details

Browse Source
This commit is contained in:
qwes5s5
2025-12-10 21:44:02 +08:00
committed by GitHub
parent 3bdd54ef6e
commit d79438bb86
7 changed files with 77 additions and 32 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/online_serving/README.md
+6
View File
@@ -223,6 +223,9 @@ include_draft_logprobs: Optional[bool] = False
# Whether to return log probabilities during draft stages (e.g., pre-generation or intermediate steps)
# for debugging or analysis of the generation process (default False means not returned).
include_logprobs_decode_token: Optional[bool] = True
# Whether to include decoded token in the logprobs/prompt_logprobs results, (default True means the decoded token is always include in results).
logits_processors_args: Optional[Dict] = None
# Additional arguments for logits processors, enabling customization of generation logic
# (e.g., dynamically adjusting probability distributions).
@@ -481,6 +484,9 @@ include_draft_logprobs: Optional[bool] = False
# Whether to return log probabilities during draft stages (e.g., pre-generation or intermediate steps)
# for debugging or analysis of the generation process (default False means not returned).
include_logprobs_decode_token: Optional[bool] = True
# Whether to include decoded token in the prompt_logprobs results, (default True means the decoded token is always include in results).
logits_processors_args: Optional[Dict] = None
# Additional arguments for logits processors, enabling customization of generation logic
# (e.g., dynamically adjusting probability distributions).