chen 0bcf924e10 [Optimization] Optimization for gather_logprob by 10GB (#5817) ...

* opt logprobs gather_logprob,reduce device memory usage by 10GB when token_num=8k

2025-12-30 15:33:34 +08:00

..

batch_invariant

…

benchmarks

…

cache_manager

[PD Disaggregation]remove unsed para in RDMACommManager (#5814)

2025-12-30 11:38:30 +08:00

ce

[BugFix] fix shm opened but not closed in set_data_ipc (#5826)

2025-12-29 23:35:07 +08:00

ci_use

[Feature] support w4afp8 v1_loader and v0_loader(tp>1) (#5757)

2025-12-30 14:11:52 +08:00

distributed

…

e2e

[Models] Add Qwen3-VL Model Support (#5763)

2025-12-29 17:39:33 +08:00

engine

[CI] Fix path error and port conflict (#5803)

2025-12-27 12:50:58 +08:00

entrypoints

[BugFix] Fix process_response_dict to support async in serving_completion (#5758)

2025-12-26 17:40:58 +08:00

eplb

[FDConfig] disable chunked_mm_input in ernie5 (#5774)

2025-12-26 15:31:27 +08:00

graph_optimization

[FDConfig] disable chunked_mm_input in ernie5 (#5774)

2025-12-26 15:31:27 +08:00

input

[Models] Add Qwen3-VL Model Support (#5763)

2025-12-29 17:39:33 +08:00

inter_communicator

…

layers

[Optimization] Optimization for gather_logprob by 10GB (#5817)

2025-12-30 15:33:34 +08:00

logger

…

metax_ci

…

metrics

[log]console log to llm log (#5680)

2025-12-23 10:05:45 +08:00

model_executor

[BugFix] Fix entropy bugs (#5818)

2025-12-29 20:44:29 -08:00

model_loader

…

multimodal

…

operators

[Speculative Decoding] Fix attn_mask_offset for multi-step MTP in mixed and PD-split modes (#5738)

2025-12-25 01:54:59 -08:00

output

[Optimization] refactor(chat_handler,completion_handler): extract base classes and use AsyncLLM (#5195)

2025-12-25 16:28:15 +08:00

platforms

…

plugins

…

pooling

…

quantization

…

reasoning

…

rl

…

scheduler

[CI]【Hackathon 9th Sprint No.55】NO.55 功能模块 fastdeploy/scheduler/local_scheduler.py 单测补充 (#5050)

2025-12-29 12:41:50 +08:00

spec_decode

…

splitwise

[CI] 【Hackathon 9th Sprint No.41】NO.41 功能模块单测补充 -new

2025-12-24 14:05:32 +08:00

trace

…

utils

[FDConfig] disable chunked_mm_input in ernie5 (#5774)

2025-12-26 15:31:27 +08:00

v1

[FDConfig] disable chunked_mm_input in ernie5 (#5774)

2025-12-26 15:31:27 +08:00

worker

[Models] Add Qwen3-VL Model Support (#5763)

2025-12-29 17:39:33 +08:00

xpu_ci

[XPU] xpu support ep4tp4 (#5773)

2025-12-29 11:27:01 +08:00

conftest.py

…

cov_pytest.ini

…

utils.py

[FDConfig] disable chunked_mm_input in ernie5 (#5774)

2025-12-26 15:31:27 +08:00