yinwei 3a4db15765 Fix out-of-memory issue during single-XPU deployment (#3133)

2025-08-01 17:12:03 +08:00

..

__init__.py

…

dcu_worker.py

…

eplb.py

…

experts_manager.py

…

gcu_model_runner.py

[Executor] Refactor GetBlockShapeAndSplitKVBlock Kernel (#2989)

2025-07-31 00:09:31 +08:00

gcu_worker.py

…

gpu_model_runner.py

[Executor] Refactor GetBlockShapeAndSplitKVBlock Kernel (#2989)

2025-07-31 00:09:31 +08:00

gpu_worker.py

…

iluvatar_model_runner.py

[Executor] Refactor GetBlockShapeAndSplitKVBlock Kernel (#2989)

2025-07-31 00:09:31 +08:00

iluvatar_worker.py

…

model_runner_base.py

…

output.py

[Feature] General support for logprobs (#2974)

2025-07-31 20:25:56 +08:00

utils.py

…

worker_base.py

…

worker_process.py

…

xpu_model_runner.py

…

xpu_worker.py

Fix out-of-memory issue during single-XPU deployment (#3133)

2025-08-01 17:12:03 +08:00