qwes5s5 b2a2e11551 [Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320) ...

* request disconnect

* request disconnect

* fix bug

* fix bug--amend

---------

Co-authored-by: root <root@yq01-sys-rpm26xc1knu.yq01.baidu.com>

2026-01-16 11:46:13 +08:00

..

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

pooler.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

stream_transfer_data.py

[Feature][Executor] GPU Model Runner Supports prompt_logprobs and max_logprobs (#4769)

2025-11-05 10:43:25 +08:00

token_processor.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00