ltd0924 d17886de19 [Feature] support ep in mixed mode (#3001) ...

* [LLM] support ep

* Update worker_process.py

* Update expert_service.py

* Update worker_process.py

* format files

2025-07-30 20:43:39 +08:00

..

cache_manager

[*] fix the memory leak when modify qp to rts failed (#3051)

2025-07-30 19:49:07 +08:00

demo

…

distributed

…

engine

[Feature] support ep in mixed mode (#3001)

2025-07-30 20:43:39 +08:00

entrypoints

[feat] extra parameters are all passed directly via http payload now, or in extra_body if using openai client (#3058)

2025-07-30 19:25:20 +08:00

input

…

inter_communicator

…

metrics

…

model_executor

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

output

…

platforms

…

reasoning

…

rl

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

scheduler

…

spec_decode

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

splitwise

…

worker

[Feature] support ep in mixed mode (#3001)

2025-07-30 20:43:39 +08:00

__init__.py

…

config.py

qwen loader (#3057)

2025-07-30 19:09:38 +08:00

envs.py

…

import_ops.py

…

stop.sh

…

test.yaml

…

utils.py

…