qwes5s5 b2a2e11551 [Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320) ...

* request disconnect

* request disconnect

* fix bug

* fix bug--amend

---------

Co-authored-by: root <root@yq01-sys-rpm26xc1knu.yq01.baidu.com>

2026-01-16 11:46:13 +08:00

..

cli

[Feature] Tracing: Fine-Grained Tracing for Request Latency Part1 (#5458)

2025-12-16 16:36:09 +08:00

openai

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

__init__.py

…

api_server.py

…

chat_utils.py

…

engine_client.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

llm.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00