JYChen a6a740f759 support deepgemm without bias input (#7559)

2026-04-22 19:49:48 +08:00

..

attention

[Feature][KVCache] Implement Cache Manager V1 with GPU + CPU Cache Support (1/n) (#7097)

2026-04-21 14:39:00 +08:00

backends

[Iiluvatar] fix ci error and update readme (#7453)

2026-04-17 20:42:56 +08:00

batch_invariant_ops

[Cleanup] Replace torch proxy alias with public compat API (#7348)

2026-04-13 11:43:26 +08:00

moe

[OP] latent moe deepgemm support (#7537)

2026-04-22 13:47:06 +08:00

pool

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

quantization

support deepgemm without bias input (#7559)

2026-04-22 19:49:48 +08:00

sample

[XPU] Unify Spec and non-spec branch.(#6947) (#7180)

2026-04-16 14:58:38 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

[Feature] use phi permute/unpermute & rm swiglu (#6361)

2026-03-12 02:01:57 -07:00

embeddings.py

[Feature][OP] Add batch-invariant RMSNorm kernel and TP embedding Custom AR path (#6749)

2026-03-13 14:34:44 +08:00

flashinfer_comm_fusion.py

[Optimization] enable trtllm_all_reduce fusion kernel in glm model (#6660)

2026-04-16 14:10:19 +08:00

linear.py

[Optimization] enable trtllm_all_reduce fusion kernel in glm model (#6660)

2026-04-16 14:10:19 +08:00

lm_head.py

[Model] tp+ep support v1_loader (#5465)

2025-12-18 14:31:54 +08:00

mtp_linear.py

[Model] tp+ep support v1_loader (#5465)

2025-12-18 14:31:54 +08:00

normalization.py

[Optimization] enable trtllm_all_reduce fusion kernel in glm model (#6660)

2026-04-16 14:10:19 +08:00

pooler.py

[Feature] support reward model (#5301)

2025-12-02 14:55:31 +08:00

rotary_embedding.py

[BugFix] fix mm rope (#7274)

2026-04-14 11:36:08 +08:00

utils.py

[Feature] Support NVFP4 Flashinfer-cutedsl MoE on SM100 (#6963)

2026-03-30 11:37:04 +08:00