ShaneGZhu 2d8338f9e4 [Optimization][DeepSeekV3.2]Reducing slot_mapping compute frequency from twice per layer to a single pre-processing step. (#7367)

2026-04-16 19:54:12 +08:00

..

attention

[Optimization][DeepSeekV3.2]Reducing slot_mapping compute frequency from twice per layer to a single pre-processing step. (#7367)

2026-04-16 19:54:12 +08:00

backends

[XPU] Split the block_attn operator into smaller operators (#6798)

2026-04-16 14:28:40 +08:00

batch_invariant_ops

[Cleanup] Replace torch proxy alias with public compat API (#7348)

2026-04-13 11:43:26 +08:00

moe

[Feature] 添加 MoE 层 latent mode 支持 (#7382)

2026-04-15 13:57:07 +08:00

pool

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

quantization

[Optimization] enable trtllm_all_reduce fusion kernel in glm model (#6660)

2026-04-16 14:10:19 +08:00

sample

[XPU] Unify Spec and non-spec branch.(#6947) (#7180)

2026-04-16 14:58:38 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

[Feature] use phi permute/unpermute & rm swiglu (#6361)

2026-03-12 02:01:57 -07:00

embeddings.py

[Feature][OP] Add batch-invariant RMSNorm kernel and TP embedding Custom AR path (#6749)

2026-03-13 14:34:44 +08:00

flashinfer_comm_fusion.py

[Optimization] enable trtllm_all_reduce fusion kernel in glm model (#6660)

2026-04-16 14:10:19 +08:00

linear.py

[Optimization] enable trtllm_all_reduce fusion kernel in glm model (#6660)

2026-04-16 14:10:19 +08:00

lm_head.py

[Model] tp+ep support v1_loader (#5465)

2025-12-18 14:31:54 +08:00

mtp_linear.py

[Model] tp+ep support v1_loader (#5465)

2025-12-18 14:31:54 +08:00

normalization.py

[Optimization] enable trtllm_all_reduce fusion kernel in glm model (#6660)

2026-04-16 14:10:19 +08:00

pooler.py

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

rotary_embedding.py

[BugFix] fix mm rope (#7274)

2026-04-14 11:36:08 +08:00

utils.py

[Feature] Support NVFP4 Flashinfer-cutedsl MoE on SM100 (#6963)

2026-03-30 11:37:04 +08:00