AIbin 0a0d2959b9 qkv_a_proj horizontal fusion (#3591) ...

Support DSK qkv_a_proj horizontal fusion under V0 Loder

2025-08-26 14:25:57 +08:00

..

attention

Add custom op declaration for all_reduce (#3473)

2025-08-20 20:29:58 +08:00

backends

[MetaxGPU] adapt to the latest fastdeploy on metax gpu (#3492)

2025-08-25 17:44:20 +08:00

moe

[Features] support hugging face qwen3 dense and qwen2 model (#3574)

2025-08-26 10:54:53 +08:00

quantization

support w4afp8 EP inference (#3044)

2025-08-25 11:27:45 +08:00

sample

[Feature] Add temp_scaled_logprobs and top_p_normalized_logprobs parameters for logits and logprobs post processing (#3552)

2025-08-25 14:11:49 +08:00

__init__.py

…

activation.py

…

embeddings.py

[V1 Loader] support weight_only (#3413)

2025-08-23 13:13:41 +08:00

linear.py

qkv_a_proj horizontal fusion (#3591)

2025-08-26 14:25:57 +08:00

lm_head.py

[Features] support hugging face qwen3 dense and qwen2 model (#3574)

2025-08-26 10:54:53 +08:00

mtp_linear.py

…

normalization.py

…

rotary_embedding.py

…

utils.py

[V1 Loader] support weight_only (#3413)

2025-08-23 13:13:41 +08:00