ddchenhao66 a502dda1fe [BugFix] fix multi-step mtp bug (#6754)

2026-03-11 10:16:04 +08:00

..

sched

[BugFix] fix multi-step mtp bug (#6754)

2026-03-11 10:16:04 +08:00

__init__.py

…

args_utils.py

fix pd overlap (#6753)

2026-03-10 20:29:54 +08:00

async_llm.py

[Optimization] The pre- and post-processing pipeline do not perform dict conversion (#5494)

2026-01-22 00:50:52 +08:00

common_engine.py

[BugFix][KVCache] Add inter-process lock to fix NaN error under DP+EP (#6724)

2026-03-10 21:55:32 +08:00

engine.py

[Others] Fix typos in log messages and comments (#6707)

2026-03-09 10:26:25 +08:00

expert_service.py

[BugFix] fix incorrect function parameters of start_data_parallel_service (#6674)

2026-03-09 10:15:50 +08:00

kv_cache_interface.py

bug: fix list to List (#4818)

2025-11-06 16:13:12 +08:00

pooling_params.py

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

request.py

[Models][Feature] Support new ERNIE reward model and add return_token_ids to reward API (#6638)

2026-03-06 18:51:00 +08:00

resource_manager.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

sampling_params.py

[Feature] Add Deterministic Inference Support (#6476)

2026-02-26 19:31:51 -08:00

tasks.py

[feature] support reward api (#4518)

2025-10-29 00:20:28 +08:00