fxyfxy777 b8d36348d2 [Optimization] merge_allreduce (#7039) ...

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2026-04-17 15:47:11 +00:00

..

benchmarks

[CLI]Update parameters in bench latecy cli tool and fix collect-env cli tool (#4558)

2025-10-24 16:46:45 +08:00

cache_manager

[BugFix] Remove ipc lock to avoid nan (#7312)

2026-04-12 13:58:19 +08:00

demo

[PD Disaggregation] Add timestamp for analyzing splitwise deployment (#5317)

2025-12-08 10:08:44 +08:00

distributed

Support setting communication groups in custom_allreduce and the all-to-all\transpose fused operator during the decoding phase. (#5917)

2026-01-12 14:09:39 +08:00

engine

[Cherry-Pick][BugFix] Fix real token exceeding max_batched_tokens limit(#7438) (#7440)

2026-04-17 16:18:03 +08:00

entrypoints

[BugFix][Cherry-Pick] Fix race condition in async RL control request (#7433)

2026-04-17 16:45:50 +08:00

eplb

fix eplb weight updating (#5529)

2025-12-19 14:30:32 +08:00

golang_router

[Feature] Fix counter release logic & update go-router download URL (#6280)

2026-02-04 15:02:38 +08:00

input

[Optimization] Enable text-only deployment for multimodal models (#7234)

2026-04-08 16:32:19 +08:00

inter_communicator

[BugFix] Remove ipc lock to avoid nan (#7312)

2026-04-12 13:58:19 +08:00

logger

[Others] lazy write log when writing (#6323)

2026-02-03 20:11:13 +08:00

metrics

[Cherry-Pick] [BugFix] fix speculative gauge metrics in multi api server (#7082) (#7100)

2026-03-31 21:24:14 +08:00

model_executor

[Optimization] merge_allreduce (#7039)

2026-04-17 15:47:11 +00:00

multimodal

[BugFix] fix dyc8 cache bug (#5958)

2026-01-08 19:25:47 -08:00

output

[Optimization] Enable text-only deployment for multimodal models (#7234)

2026-04-08 16:32:19 +08:00

platforms

[Feature]Report FD statistical information (#5646)

2026-01-14 17:54:01 +08:00

plugins

【Optimization】update data_processor & add tool parser plugins (#6096)

2026-01-22 17:17:32 +08:00

reasoning

[Feature]Optimization of Thinking Pattern Framework (#4302)

2025-12-10 16:17:06 +08:00

rl

fix oom bug, optimize async weight loading and update read step by yaml (#7171) (#7175)

2026-04-03 14:07:06 +08:00

router

[Cherry-Pick][Feature] Added the /v1/abort_requests endpoint(#6992) (#7093)

2026-04-01 11:49:22 +08:00

scheduler

Revert "[Optimize] Optimize ttft for ep (#6098)" (#6402)

2026-02-09 19:01:23 +08:00

spec_decode

[Optimization] Enable text-only deployment for multimodal models (#7234)

2026-04-08 16:32:19 +08:00

splitwise

test_abort (#6890)

2026-03-17 20:50:28 +08:00

trace

[Cherry-Pick] [BugFix] Fix inaccurate cache hit rate and TTFT after request preemption (#6626)

2026-03-05 16:25:07 +08:00

transformer_utils

[Feature] support pool (#3827)

2025-09-22 14:09:09 +08:00

usage

[Feature]Report FD statistical information (#5646)

2026-01-14 17:54:01 +08:00

worker

[BugFix] Remove ipc lock to avoid nan (#7312)

2026-04-12 13:58:19 +08:00

__init__.py

[Cherry-Pick] [BugFix] fix speculative gauge metrics in multi api server (#7082) (#7100)

2026-03-31 21:24:14 +08:00

collect_env.py

feat: add support for API usage with multimodal models (#4548)

2025-10-28 20:23:46 +08:00

config.py

[Optimization] Enable text-only deployment for multimodal models (#7234)

2026-04-08 16:32:19 +08:00

envs.py

[Cherry-Pick][TI-consistent] support quant use pow2scale(#7308) (#7303)

2026-04-13 00:01:38 -07:00

import_ops.py

[build] support build sm 80,86,89,90 to one whl package (#6173)

2026-01-26 11:30:02 +08:00

stop.sh

[PD Disaggregation] Support Qwen3-MoE use PD + EP inference. (#4691)

2025-11-06 10:32:15 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

[Cherry-Pick] [Feature] support v1 update/clear api for RL (#6761) (#6974)

2026-03-25 19:18:35 +08:00