GoldPancake 909059c60a [Feature] Support for request-level speculative decoding metrics monitoring. (#5518) ...

* support spec metrics monitor per request

* fix bug

* remove debug log

* fix ut bugs

2025-12-12 12:22:18 +08:00

..

tool_parsers

…

__init__.py

…

api_server.py

…

middleware.py

…

multi_api_server.py

…

protocol.py

[Feature] Support for request-level speculative decoding metrics monitoring. (#5518)

2025-12-12 12:22:18 +08:00

response_processors.py

[Feature]Optimization of Thinking Pattern Framework (#4302)

2025-12-10 16:17:06 +08:00

run_batch.py

…

serving_chat.py

[Feature] Support for request-level speculative decoding metrics monitoring. (#5518)

2025-12-12 12:22:18 +08:00

serving_completion.py

[Feature] Support for request-level speculative decoding metrics monitoring. (#5518)

2025-12-12 12:22:18 +08:00

serving_embedding.py

…

serving_engine.py

…

serving_models.py

…

serving_reward.py

…

test_openai.py

…

usage_calculator.py

…

utils.py

…