freeliuzc e87ce4b8cd [Speculative Decoding] refactor MTP and optimize spec-decoding postprocess (#6973) ...

* support new mtp

* refactor(speculate_decoding and mtp): optimize mtp sturcture logic. Update spec-branch status-process

* fix cuda-graph for spec-decoding

* fix xpu mtp and fix some note

* fix unittest and optmize note

* fix model status update in eos-branch

2026-03-24 10:19:01 +08:00

..

__init__.py

…

dcu_model_runner.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

dcu_worker.py

Support setting communication groups in custom_allreduce and the all-to-all\transpose fused operator during the decoding phase. (#5917)

2026-01-12 14:09:39 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

[Feature] Support redundant expert for eplb (#5918)

2026-01-09 17:13:24 +08:00

gcu_model_runner.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00

gcu_worker.py

[Feature]Report FD statistical information (#5646)

2026-01-14 17:54:01 +08:00

gpu_model_runner.py

[Speculative Decoding] refactor MTP and optimize spec-decoding postprocess (#6973)

2026-03-24 10:19:01 +08:00

gpu_worker.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00

hpu_model_runner.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00

hpu_worker.py

[Feature]Report FD statistical information (#5646)

2026-01-14 17:54:01 +08:00

iluvatar_model_runner.py

[Iluvatar] refactor attn and moe code (#6887)

2026-03-18 10:31:00 +08:00

iluvatar_worker.py

Revert "[Optim] Remove limitation of number of kvcache blocks (#5612)" (#5702)

2025-12-23 15:41:33 +08:00

input_batch.py

[Others] Fix PD reorder for MTP (#6792)

2026-03-23 21:10:22 +08:00

metax_model_runner.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00

metax_worker.py

[Metax] adapt to the latest develop (#6282)

2026-01-29 23:21:20 -08:00

model_runner_base.py

[Graph Optimization][CINN] Use CINN in PaddleOCR-VL ViT part (#5223)

2025-12-09 14:37:00 +08:00

output.py

[Feature] GPU Memory Optimization and Retirement of V0 Scheduler (#6407)

2026-02-28 15:07:43 +08:00

tbo.py

cp 1131 tbo to develop (#6281)

2026-02-03 15:23:23 +08:00

worker_base.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

worker_process.py

[BugFix] add worker_process no grad (#6971)

2026-03-23 02:10:56 -07:00

xpu_model_runner.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00

xpu_worker.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00