SunLei ee915220bd [Speculative Decoding] Add draft_logprobs Support for Speculative Decode MTP (#4467) ...

* feat: add draft_logprobs for Speculative Decode MTP

* feat: add draft_logprobs for Speculative Decode MTP

* feat: add draft_logprobs for Speculative Decode MTP

* fix: postprocess for speculative decode

* test: test_speculative_decoding_use_logprobs

* fix: test_completion_echo

* fix test_max_streaming_tokens

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-10-21 14:57:50 +08:00

..

cli

Optimizing the performance of think length limit using custom operators (#4279)

2025-10-20 21:09:13 +08:00

openai

[Speculative Decoding] Add draft_logprobs Support for Speculative Decode MTP (#4467)

2025-10-21 14:57:50 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

api_server.py

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

chat_utils.py

[Feature] add HTTP GET retry (#3838)

2025-09-08 10:11:14 +08:00

engine_client.py

Optimizing the performance of think length limit using custom operators (#4279)

2025-10-20 21:09:13 +08:00

llm.py

LLM.chat add "tools" param (#4415)

2025-10-17 20:25:03 +08:00