AIbin 1fb8194191 [OP][Models][Optimization] 优化 RoPE CUDA kernel 并更新 DeepSeek V3 配置 (#7359) ...

* dsk del prefill mask

* dsk support 1M+ seq_len rope

* update rope tests

* Replace max_position_embeddings with max_model_len

* 1D grid: gridDim.x has a maximum size of 2^31-1, far exceeding the actual number of tokens.

2026-04-13 19:12:36 +08:00

..

graph_optimization

[FDConfig] Support CLI args for quantization params and add cudagraph validation (#7281)

2026-04-10 14:13:42 +08:00

guided_decoding

[Optimization] Use a separate driver when using Triton with Paddle (#6897)

2026-03-24 10:56:00 +08:00

layers

[TI-consistent] support quant use pow2scale (#7308)

2026-04-13 00:01:53 -07:00

logits_processor

[Bugfix] Align thinking_budget behavior with ERNIE reasoning flow (#6934)

2026-03-23 14:15:55 +08:00

model_loader

[Loader] add multi-thread model loading (#6877)

2026-04-09 23:40:15 -07:00

models

[OP][Models][Optimization] 优化 RoPE CUDA kernel 并更新 DeepSeek V3 配置 (#7359)

2026-04-13 19:12:36 +08:00

ops

[Iluvatar] Support wi4a16 group_gemm (#7078)

2026-03-30 19:03:51 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

entropy_utils.py

[Bugfix] Fix entropy calculation bugs (#5941)

2026-01-08 20:57:35 +08:00

forward_meta.py

[Models]support GLM4.7 Flash && Ernie_MLA (#7139)

2026-04-03 17:41:33 +08:00

load_weight_utils.py

[Loader] add multi-thread model loading (#6877)

2026-04-09 23:40:15 -07:00

pre_and_post_process.py

[Feature] Support mtp overlap schedule (#7001)

2026-04-01 14:24:26 +08:00

utils.py

[Feature] Support NVFP4 Flashinfer-cutedsl MoE on SM100 (#6963)

2026-03-30 11:37:04 +08:00

xpu_pre_and_post_process.py

[XPU] Refactor get_padding_offset to single kernel. (#7029)

2026-04-13 11:04:50 +08:00