SunLei 5d9524fc3c [Models][Feature] Support new ERNIE reward model and add return_token_ids to reward API (#6638) ...

* reward model

* Add support for pooling-based inference in the reward model

* bugfix

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2026-03-06 18:51:00 +08:00

..

tool_parsers

【Optimization】update data_processor & add tool parser plugins (#6096)

2026-01-22 17:17:32 +08:00

v1

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

__init__.py

…

api_server.py

[BugFix] fix dp sheduler bug in ep4tp1 when start by using multi_api_server (#6598)

2026-03-05 10:04:12 +08:00

middleware.py

[Feature] Enable FastDeploy to support adding the “--api-key” authentication parameter. (#4806)

2025-11-08 18:24:02 +08:00

multi_api_server.py

[Iluvatar] Support CudaGraph and optimize flash_attn_unpadded and fused_neox_rope_embedding (#6553)

2026-03-02 14:07:17 +08:00

protocol.py

[Models][Feature] Support new ERNIE reward model and add return_token_ids to reward API (#6638)

2026-03-06 18:51:00 +08:00

response_processors.py

fix image gen (#6175)

2026-01-23 11:24:12 +08:00

run_batch.py

[Feature] [PD Disaggregation] simplify configuration for pd-disaggregated deployment, and refactor post-init and usage for all ports (#5415)

2025-12-17 15:50:42 +08:00

serving_chat.py

[Feature]Log Format Normalization and Trace Log Optimization (#6370)

2026-03-03 11:31:45 +08:00

serving_completion.py

[Feature]Log Format Normalization and Trace Log Optimization (#6370)

2026-03-03 11:31:45 +08:00

serving_embedding.py

[Optimization] The pre- and post-processing pipeline do not perform dict conversion (#5494)

2026-01-22 00:50:52 +08:00

serving_engine.py

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

serving_models.py

…

serving_reward.py

[Models][Feature] Support new ERNIE reward model and add return_token_ids to reward API (#6638)

2026-03-06 18:51:00 +08:00

test_openai.py

…

usage_calculator.py

…

utils.py

[Feature]Log Format Normalization and Trace Log Optimization (#6370)

2026-03-03 11:31:45 +08:00