jc b1698a79cb [RL] add version to the key of cache storage && refine raising error (#6160) ...

* Waiting for cache transfer manager inited

* up

* up

* up

* up

* up

* fix according comments

* fix unittest

* fix

* fix unittest

* fix error

* pass storage_backend to worker

2026-01-27 10:47:46 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_model_runner.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

dcu_worker.py

Support setting communication groups in custom_allreduce and the all-to-all\transpose fused operator during the decoding phase. (#5917)

2026-01-12 14:09:39 +08:00

eplb.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

experts_manager.py

[Feature] Support redundant expert for eplb (#5918)

2026-01-09 17:13:24 +08:00

gcu_model_runner.py

[Model Runner] Prepare token count and move FA3 initialization into the graph (#6170)

2026-01-26 12:16:57 +08:00

gcu_worker.py

[Feature]Report FD statistical information (#5646)

2026-01-14 17:54:01 +08:00

gpu_model_runner.py

[Model Runner] Prepare token count and move FA3 initialization into the graph (#6170)

2026-01-26 12:16:57 +08:00

gpu_worker.py

[RL] add pause, update_weights, resume interface for async RL (#6052)

2026-01-23 10:18:07 +08:00

hpu_model_runner.py

[Intel HPU] enable MoE EP for hpu (#5855)

2026-01-15 13:08:00 +08:00

hpu_worker.py

[Feature]Report FD statistical information (#5646)

2026-01-14 17:54:01 +08:00

iluvatar_model_runner.py

[Iluvatar] Support V1_KVCACHE_SCHEDULER and paddleocr-vl rope mode (#5555)

2025-12-18 02:14:25 -08:00

iluvatar_worker.py

Revert "[Optim] Remove limitation of number of kvcache blocks (#5612)" (#5702)

2025-12-23 15:41:33 +08:00

metax_model_runner.py

[Model Runner] Prepare token count and move FA3 initialization into the graph (#6170)

2026-01-26 12:16:57 +08:00

metax_worker.py

[Metax] optimize mla attention (#5258)

2025-12-09 11:18:19 +08:00

model_runner_base.py

[Graph Optimization][CINN] Use CINN in PaddleOCR-VL ViT part (#5223)

2025-12-09 14:37:00 +08:00

output.py

[Others] remove stop_nums (#6182)

2026-01-26 12:12:47 +08:00

tbo.py

[Others] update tbo related code (#5485)

2025-12-11 12:34:46 +08:00

worker_base.py

[FDConfig]Remove splitwise_role and engine_worker_queue_port in FDConfig (#4147)

2025-09-19 17:01:52 +08:00

worker_process.py

[RL] add version to the key of cache storage && refine raising error (#6160)

2026-01-27 10:47:46 +08:00

xpu_model_runner.py

Enable CudaGraph

2026-01-22 19:49:33 +08:00

xpu_worker.py

[XPU][Graph Optimization] XPU Support CUDAGraph (#6152)

2026-01-22 14:41:56 +08:00