Logo
Explore Help
Sign In
apps/FastDeploy
1
0
Fork 0
You've already forked FastDeploy
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-05-09 17:04:42 +08:00
Code Issues Actions 7 Packages Projects Releases Wiki Activity
Files
b9255330517bc4293eac30b201e0caadcc48ddbc
FastDeploy/fastdeploy/model_executor/layers/moe
T
History
yangjianfengo1 ae7bee8122 【New Feature】W4afp8 supports per group quantization (#4987)
* w4afp8 支持per group

* code style

* fix transpose

* revert fast hardmard

---------

Co-authored-by: yuanxiaolan <yuanxiaolan01@baidu.com>
Co-authored-by: plusNew001 <95567040+plusNew001@users.noreply.github.com>
2025-11-13 19:17:27 +08:00
..
__init__.py
support w4afp8 EP inference (#3044)
2025-08-25 11:27:45 +08:00
ep.py
【New Feature】W4afp8 supports per group quantization (#4987)
2025-11-13 19:17:27 +08:00
fused_moe_backend_base.py
refactor pt loading (#4532)
2025-11-11 21:30:39 +08:00
fused_moe_cutlass_backend.py
【New Feature】W4afp8 supports per group quantization (#4987)
2025-11-13 19:17:27 +08:00
fused_moe_deepgemm_backend.py
refactor pt loading (#4532)
2025-11-11 21:30:39 +08:00
fused_moe_marlin_backend.py
[noauxtc_kernel] remove useless code (#4643)
2025-10-30 18:59:04 +08:00
fused_moe_triton_backend.py
[BugFix] fix VL fp8 bug when moe token_num is 0 (#4928)
2025-11-12 21:19:36 +08:00
fused_moe_wint2_backend.py
【New Feature】W4afp8 supports per group quantization (#4987)
2025-11-13 19:17:27 +08:00
moe.py
[Iluvatar][CI] fix safetensors_rust.SafetensorError: framework paddle is invalid (#4972)
2025-11-12 14:13:40 +08:00
triton_moe_kernels.py
[OPs] MoE support wfp8afp8(channelwise) and improve per_token_quant_fp8 (#4238)
2025-09-24 16:39:51 +08:00
Powered by Gitea Version: 1.26.0 Page: 494ms Template: 4ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API