bukejiyu 14d46181b8 [Loader] add multi-thread model loading (#6877) ...

* multi-thread-loader

* fix ut

2026-04-09 23:40:15 -07:00

..

graph_optimization

[FDConfig] Support CLI args for quantization params and add cudagraph validation (#7281)

2026-04-10 14:13:42 +08:00

guided_decoding

[Optimization] Use a separate driver when using Triton with Paddle (#6897)

2026-03-24 10:56:00 +08:00

layers

[FDConfig] Support CLI args for quantization params and add cudagraph validation (#7281)

2026-04-10 14:13:42 +08:00

logits_processor

[Bugfix] Align thinking_budget behavior with ERNIE reasoning flow (#6934)

2026-03-23 14:15:55 +08:00

model_loader

[Loader] add multi-thread model loading (#6877)

2026-04-09 23:40:15 -07:00

models

[RL] support moe-topk use topk_reduce_func (#7218)

2026-04-09 11:01:03 +08:00

ops

[Iluvatar] Support wi4a16 group_gemm (#7078)

2026-03-30 19:03:51 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

entropy_utils.py

[Bugfix] Fix entropy calculation bugs (#5941)

2026-01-08 20:57:35 +08:00

forward_meta.py

[Models]support GLM4.7 Flash && Ernie_MLA (#7139)

2026-04-03 17:41:33 +08:00

load_weight_utils.py

[Loader] add multi-thread model loading (#6877)

2026-04-09 23:40:15 -07:00

pre_and_post_process.py

[Feature] Support mtp overlap schedule (#7001)

2026-04-01 14:24:26 +08:00

utils.py

[Feature] Support NVFP4 Flashinfer-cutedsl MoE on SM100 (#6963)

2026-03-30 11:37:04 +08:00

xpu_pre_and_post_process.py

[XPU] Refactor pre process (#6993)

2026-04-01 20:29:55 +08:00