Ayakouji a8f8791668 [Optimization] Qwen2.5-VL support multi-batch prefill (#5269) ...

* update

* fix

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix dict access

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2025-12-05 18:22:39 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_model_runner.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

dcu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

fix typos (#3684)

2025-09-01 17:50:17 +08:00

gcu_model_runner.py

[Models] Add forward_meta to moe models' forward function (#5138)

2025-12-04 13:26:58 +08:00

gcu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

gpu_model_runner.py

[Optimization] Qwen2.5-VL support multi-batch prefill (#5269)

2025-12-05 18:22:39 +08:00

gpu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

hpu_model_runner.py

[Intel HPU] fix bug about RP 5138 (#5380)

2025-12-05 11:33:29 +08:00

hpu_worker.py

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

iluvatar_model_runner.py

[Iluvatar GPU] fix ci error caused by rebuild_padding param and cuda graph (#4504)

2025-10-21 21:41:41 +08:00

iluvatar_worker.py

[Iluvatar GPU] Adapt VL model (#4313)

2025-10-17 16:13:38 +08:00

metax_model_runner.py

[Models] Add forward_meta to moe models' forward function (#5138)

2025-12-04 13:26:58 +08:00

metax_worker.py

[Metax] support ENABLE_V1_KVCACHE_SCHEDULER (#5163)

2025-11-24 19:19:49 +08:00

model_runner_base.py

[Feature] support chunked moe (#4575)

2025-12-01 15:17:18 +08:00

output.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00

tbo.py

[Feature] support Two batch overlap, mainly used in Prefill (#5078)

2025-12-05 14:58:50 +08:00

worker_base.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

worker_process.py

[PD Disaggregation] support DP via v1 router and decouple DP and EP (#5197)

2025-12-04 15:38:43 +08:00

xpu_model_runner.py

[XPU] [Optimization] [EP] EP communication optimization. (#5145)

2025-12-05 10:03:45 +08:00

xpu_worker.py

[xpu] support mtp for xpu(mix) (#5274)

2025-12-01 11:03:14 +08:00