qwes5s5 b2a2e11551 [Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320) ...

* request disconnect

* request disconnect

* fix bug

* fix bug--amend

---------

Co-authored-by: root <root@yq01-sys-rpm26xc1knu.yq01.baidu.com>

2026-01-16 11:46:13 +08:00

..

tool_parsers

[Feature]Optimization of Thinking Pattern Framework (#4302)

2025-12-10 16:17:06 +08:00

v1

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

test_api_authentication.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

test_api_server.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

test_build_sample_logprobs.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00

test_chatcompletion_request.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00

test_completion_echo.py

[Feature] Support for request-level speculative decoding metrics monitoring. (#5518)

2025-12-12 12:22:18 +08:00

test_dealer_connection_manager.py

[Feature] add dealer manager to reuse the connection (#3471)

2025-08-21 13:11:13 +08:00

test_error_response.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

test_finish_reason.py

[Feature]Optimization of Thinking Pattern Framework (#4302)

2025-12-10 16:17:06 +08:00

test_max_streaming_tokens.py

[BugFix] Fix process_response_dict to support async in serving_completion (#5758)

2025-12-26 17:40:58 +08:00

test_metrics_routes.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

test_multi_api_server.py

[BugFix] [MultiAPIServer] fix rdma script and port check for multi api server (#5935)

2026-01-12 10:38:52 +08:00

test_response_processors.py

[Feature]Optimization of Thinking Pattern Framework (#4302)

2025-12-10 16:17:06 +08:00

test_run_batch_proto.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

test_run_batch_subcommand.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

test_run_batch.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

test_serving_chat.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

test_serving_completion.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

test_serving_embedding.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

test_serving_models.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

test_serving_reward.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

test_usage_calculator.py

feat: add support for API usage with multimodal models (#4548)

2025-10-28 20:23:46 +08:00

test_with_cancellation.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

test_wrap_streaming_generator.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00