chenjian 3878a99b69 [Fearture] Support cache kv cache for output tokens (#4535) ...

* [Fearture] Support cache kv cache for output tokens

* fix bug

* fix ci bug

* improve coverage

* enable output caching by default

* fix ci

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-12-04 20:53:08 +08:00

..

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

pooler.py

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

stream_transfer_data.py

[Feature][Executor] GPU Model Runner Supports prompt_logprobs and max_logprobs (#4769)

2025-11-05 10:43:25 +08:00

token_processor.py

[Fearture] Support cache kv cache for output tokens (#4535)

2025-12-04 20:53:08 +08:00