Yonghua Li 5ac5ecd0b0 [BugFix] fix cache transfer tasks failure after cache cleared (#6202) ...

* [fix] fix cache transfer tasks failure after cache cleared

* [fix] fix submit_task

* [fix] fix cache manager hang when clearing prefix cache

* [fix] fix list_proxy has no clear method

* [fix] fix barrier

* [fix] add barrier0

* [fix] add cache_task_is_paused_signal

* [fix] fix condition

* [fix] fix cache transfer  sync and delay prefix cache tree clearing

* [fix] fix typo

* [chore] polish code

* [fix] revert only rank0 write kv_cache_status_signal

* [fix] fix thread pool and prefix cache manager hang

* [fix] add timeout for task_swapping_event

* [fix] tolerate prefix cache manager error while prefix tree is cleared

* [chore] add more log

* [fix] fix test_prefix_cache_manager

* [fix] fix prefix_cache_status_signal usage

2026-02-08 15:33:56 +08:00

..

sched

[BugFix] fix cache transfer tasks failure after cache cleared (#6202)

2026-02-08 15:33:56 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Model Runner] Support overlap schedule (#6259)

2026-02-04 10:49:44 +08:00

async_llm.py

[Optimization] The pre- and post-processing pipeline do not perform dict conversion (#5494)

2026-01-22 00:50:52 +08:00

common_engine.py

[BugFix] fix cache transfer tasks failure after cache cleared (#6202)

2026-02-08 15:33:56 +08:00

engine.py

[Model Runner] Support overlap schedule (#6259)

2026-02-04 10:49:44 +08:00

expert_service.py

[BugFix] Fix port-releated errors in mix mode when FD_ENABLE_INTERNAL_ADAPTER is enabled (#6309)

2026-02-03 19:49:01 +08:00

kv_cache_interface.py

bug: fix list to List (#4818)

2025-11-06 16:13:12 +08:00

pooling_params.py

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

request.py

[RL] add pause, update_weights, resume interface for async RL (#6052)

2026-01-23 10:18:07 +08:00

resource_manager.py

[Feature] Support stopping the inference for the corresponding request in the online service after a disconnection request. (#5320)

2026-01-16 11:46:13 +08:00

sampling_params.py

[Optimization] The pre- and post-processing pipeline do not perform dict conversion (#5494)

2026-01-22 00:50:52 +08:00

tasks.py

[feature] support reward api (#4518)

2025-10-29 00:20:28 +08:00