Sunny-bot1 930f7b781c [Optimization] Put get_block_shape_and_split_kv_block in cuda graph for append attention backend (#4443) ...

* get block in cuda graph

* fix sot

2025-10-17 10:59:56 +08:00

..

attention

[Optimization] Put get_block_shape_and_split_kv_block in cuda graph for append attention backend (#4443)

2025-10-17 10:59:56 +08:00

backends

[FDConfig]Remove total_block_num/dtype/block_size/enc_dec_block_num in ParallelConfig (#4400)

2025-10-16 20:00:37 +08:00

moe

[BugFix]Fix wfp8afp8 triton moe group_topk renormalized=True (#4449)

2025-10-16 23:17:48 +08:00

pool

[Feature] support qwen3-embedding model load (#4202)

2025-09-23 00:14:35 -07:00

quantization

[BugFix]Fix wfp8afp8 triton moe group_topk renormalized=True (#4449)

2025-10-16 23:17:48 +08:00

sample

[Intel HPU] Enable dist sampler on intel hpu platform (#4445)

2025-10-16 19:02:27 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

activation.py

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

embeddings.py

[BugFix] fix qwen3-embedding model tp>1 (#4223)

2025-09-24 14:13:26 +08:00

linear.py

fix machete pre quant (#4295)

2025-09-28 16:11:09 +08:00

lm_head.py

[Feature] support qwen3-embedding model load (#4202)

2025-09-23 00:14:35 -07:00

mtp_linear.py

support tmp (#3675)

2025-08-28 19:42:32 +08:00

normalization.py

adaptive rms_norm's dtype (#3617)

2025-08-26 15:29:15 +08:00

pooler.py

Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344)

2025-10-15 19:42:59 +08:00

rotary_embedding.py

[Intel HPU] Support intel hpu platform (#4161)

2025-09-24 12:27:50 +08:00

utils.py

[OPs] MoE support wfp8afp8(channelwise) and improve per_token_quant_fp8 (#4238)

2025-09-24 16:39:51 +08:00