qwes5s5 b2a2e11551 [Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320) ...

* request disconnect

* request disconnect

* fix bug

* fix bug--amend

---------

Co-authored-by: root <root@yq01-sys-rpm26xc1knu.yq01.baidu.com>

2026-01-16 11:46:13 +08:00

..

tool_parsers

[Feature] Unify the registration name recognition for tool_parser and reasoning_parser to “-” (#4668)

2025-10-31 10:45:27 +08:00

v1

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

api_server.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

middleware.py

[Feature] Enable FastDeploy to support adding the “--api-key” authentication parameter. (#4806)

2025-11-08 18:24:02 +08:00

multi_api_server.py

[BugFix] [MultiAPIServer] fix rdma script and port check for multi api server (#5935)

2026-01-12 10:38:52 +08:00

protocol.py

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

response_processors.py

[Feature]Optimization of Thinking Pattern Framework (#4302)

2025-12-10 16:17:06 +08:00

run_batch.py

[Feature] [PD Disaggregation] simplify configuration for pd-disaggregated deployment, and refactor post-init and usage for all ports (#5415)

2025-12-17 15:50:42 +08:00

serving_chat.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

serving_completion.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

serving_embedding.py

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

serving_engine.py

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

serving_models.py

Bugfix test exception (#4171)

2025-09-19 11:48:49 +08:00

serving_reward.py

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

test_openai.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

usage_calculator.py

feat: add support for API usage with multimodal models (#4548)

2025-10-28 20:23:46 +08:00

utils.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00