freeliuzc 4fd877ed43 [Speculative Decoding] Support mtp expert-parallel and support different modality deploy (#7018) ...

* support mtp ep and support different modality

* fix default arg

2026-03-26 13:52:16 +08:00

..

sched

[Speculative Decoding] Support mtp expert-parallel and support different modality deploy (#7018)

2026-03-26 13:52:16 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Speculative Decoding] Support mtp expert-parallel and support different modality deploy (#7018)

2026-03-26 13:52:16 +08:00

async_llm.py

[Optimization] Update ZMQ server (#6735)

2026-03-19 21:53:16 +08:00

common_engine.py

[Speculative Decoding] Support mtp expert-parallel and support different modality deploy (#7018)

2026-03-26 13:52:16 +08:00

engine.py

[Speculative Decoding] Support mtp expert-parallel and support different modality deploy (#7018)

2026-03-26 13:52:16 +08:00

expert_service.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00

kv_cache_interface.py

bug: fix list to List (#4818)

2025-11-06 16:13:12 +08:00

pooling_params.py

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

register_manager.py

[PD Disaggregation][RL] Register to router with version and support rdma eager connect for pd (#6718)

2026-03-17 14:43:35 +08:00

request.py

[Speculative Decoding] Support mtp expert-parallel and support different modality deploy (#7018)

2026-03-26 13:52:16 +08:00

resource_manager.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00

sampling_params.py

[Feature] Add Deterministic Inference Support (#6476)

2026-02-26 19:31:51 -08:00

tasks.py

[feature] support reward api (#4518)

2025-10-29 00:20:28 +08:00