周周周 c83dc58105 [Feature] support Two batch overlap, mainly used in Prefill (#5078)

2025-12-05 14:58:50 +08:00

..

benchmarks

…

cache_manager

[PD Disaggregation] support DP via v1 router and decouple DP and EP (#5197)

2025-12-04 15:38:43 +08:00

demo

…

distributed

…

engine

fix trace log (#5386)

2025-12-05 14:45:52 +08:00

entrypoints

[BugFix] Compatible with asynchronous functions (#5378)

2025-12-05 11:05:21 +08:00

eplb

[BugFix] fix cuda-python requirement (#5261)

2025-11-27 13:58:18 +08:00

input

[Bug fix] fix pooling models (#5358)

2025-12-04 11:06:30 +08:00

inter_communicator

[PD Disaggregation] support DP via v1 router and decouple DP and EP (#5197)

2025-12-04 15:38:43 +08:00

logger

…

metrics

[BugFix][Metrics] Fix Prometheus Multiprocess Metrics Issues and Add ZMQ Communication Metrics (#5185)

2025-11-27 15:05:09 +08:00

model_executor

[Feature] support Two batch overlap, mainly used in Prefill (#5078)

2025-12-05 14:58:50 +08:00

multimodal

…

output

[Fearture] Support cache kv cache for output tokens (#4535)

2025-12-04 20:53:08 +08:00

platforms

[Feature] support flash_mask_attention backend (#5134)

2025-11-28 10:12:16 +08:00

plugins

…

reasoning

…

rl

[fix] update check_model_weights_status loop (#5249)

2025-12-04 19:43:01 +08:00

router

[PD Disaggregation] support DP via v1 router and decouple DP and EP (#5197)

2025-12-04 15:38:43 +08:00

scheduler

fix get_request from scheduler (#5369)

2025-12-04 21:59:10 +08:00

spec_decode

[Models] Add forward_meta to moe models' forward function (#5138)

2025-12-04 13:26:58 +08:00

splitwise

[PD Disaggregation] support DP via v1 router and decouple DP and EP (#5197)

2025-12-04 15:38:43 +08:00

trace

…

transformer_utils

…

worker

[Feature] support Two batch overlap, mainly used in Prefill (#5078)

2025-12-05 14:58:50 +08:00

__init__.py

remove fastsafetensors (#5371)

2025-12-04 19:22:04 +08:00

collect_env.py

…

config.py

[Fearture] Support cache kv cache for output tokens (#4535)

2025-12-04 20:53:08 +08:00

envs.py

remove fastsafetensors (#5371)

2025-12-04 19:22:04 +08:00

import_ops.py

…

stop.sh

…

test.yaml

…

utils.py

[LogProbs]Enable prompt logprobs output and modify data transmission method for the online interface. (#5089)

2025-12-02 13:49:51 +08:00