Liumengyuan 2a73a6df03 fix_fp8_deepgemm_moe_tp_bug (#3658)

2025-08-28 17:19:02 +08:00

..

cache_manager

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

demo

…

distributed

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

engine

[BugFix] ep mixed offline exit (#3661)

2025-08-28 17:09:07 +08:00

entrypoints

[BugFix] fix logger (#3666)

2025-08-28 17:08:00 +08:00

input

delete ernie4_5_vl_tokenizer (#3631)

2025-08-27 20:36:02 +08:00

inter_communicator

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

logger

…

metrics

…

model_executor

fix_fp8_deepgemm_moe_tp_bug (#3658)

2025-08-28 17:19:02 +08:00

multimodal

Unify server-side and model-side Config(Part-5) (#3497)

2025-08-21 19:00:21 +08:00

output

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

platforms

Revert "[Feature] block sparse attention (#3209)" (#3647)

2025-08-27 17:35:04 +08:00

plugins

…

reasoning

…

rl

Revert "[Feature] block sparse attention (#3209)" (#3647)

2025-08-27 17:35:04 +08:00

scheduler

…

spec_decode

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

splitwise

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

worker

[V1 Loader]support param create and load for wint2 and xpu backend (#3581)

2025-08-28 09:49:36 +08:00

__init__.py

…

config.py

Update config.py (#3669)

2025-08-28 15:30:51 +08:00

envs.py

[Optimize]support machete weight only gemm (#3561)

2025-08-28 09:49:58 +08:00

import_ops.py

…

stop.sh

…

test.yaml

…

utils.py

[BugFix] fix logger (#3666)

2025-08-28 17:08:00 +08:00