GoldPancake 909059c60a [Feature] Support for request-level speculative decoding metrics monitoring. (#5518) ...

* support spec metrics monitor per request

* fix bug

* remove debug log

* fix ut bugs

2025-12-12 12:22:18 +08:00

..

cli

[CLI]Update parameters in bench latecy cli tool and fix collect-env cli tool (#4558)

2025-10-24 16:46:45 +08:00

openai

[Feature] Support for request-level speculative decoding metrics monitoring. (#5518)

2025-12-12 12:22:18 +08:00

__init__.py

…

api_server.py

…

chat_utils.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

engine_client.py

[Optimization] support mm prefill batch (#5313)

2025-12-11 22:21:14 +08:00

llm.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00