qwes5s5 b2a2e11551 [Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320) ...

* request disconnect

* request disconnect

* fix bug

* fix bug--amend

---------

Co-authored-by: root <root@yq01-sys-rpm26xc1knu.yq01.baidu.com>

2026-01-16 11:46:13 +08:00

..

cli

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00

openai

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

test_abort.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

test_chat.py

[Fearture] Support mm model close prefix cache (#4459)

2025-10-21 15:37:59 +08:00

test_engine_client.py

[CI]【Hackathon 9th Sprint No.50】NO.50 功能模块 fastdeploy/entrypoints/engine_client.py 单测补充 -part #5045 (#5807)

2026-01-09 15:13:19 +08:00

test_generation.py

[BugFix]fix v1 loader lm head fp32 (#5270)

2025-11-27 20:12:56 +08:00

test_vllm_run_engine.py

[CI] Add unittest (#5328)

2025-12-09 19:19:42 +08:00