Daci d8c6ba61f3 [BugFix] resource_manager_v1 lock PD (#5616) ...

* bugfix resource_manager_v1 lock PD

* with lock add_prefilled_request

---------

Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2026-01-08 10:02:54 +08:00

..

sched

[BugFix] resource_manager_v1 lock PD (#5616)

2026-01-08 10:02:54 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Metax] adapt prefix caching & cpu swap (#5844)

2025-12-31 17:02:48 +08:00

async_llm.py

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

common_engine.py

[PD Disaggregation] Update usage of pd disaggregation and data parallel (#5742)

2026-01-05 17:51:29 +08:00

engine.py

[PD Disaggregation] Update usage of pd disaggregation and data parallel (#5742)

2026-01-05 17:51:29 +08:00

expert_service.py

[Feature] [PD Disaggregation] simplify configuration for pd-disaggregated deployment, and refactor post-init and usage for all ports (#5415)

2025-12-17 15:50:42 +08:00

kv_cache_interface.py

bug: fix list to List (#4818)

2025-11-06 16:13:12 +08:00

pooling_params.py

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

request.py

[BugFix] Refine the preparation of cpu and storage cache (#5777)

2026-01-05 10:13:30 +08:00

resource_manager.py

[BugFix] Refine the preparation of cpu and storage cache (#5777)

2026-01-05 10:13:30 +08:00

sampling_params.py

[LogProbs]Enable prompt logprobs output and modify data transmission method for the online interface. (#5089)

2025-12-02 13:49:51 +08:00

tasks.py

[feature] support reward api (#4518)

2025-10-29 00:20:28 +08:00