apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 08:21:53 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity
Files
cb6819d086706cea1ace3b27bd59c5b6cb1871fd
FastDeploy/fastdeploy/model_executor/layers/quantization
T
History
AIbin cb6819d086 [Optimization][OP]support per_token_group_fp8_quant cuda kernel (#6865) 
* support per_token_group_fp8_quant cuda kernel

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

* update code

---------

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
2026-03-17 19:17:51 +08:00
..
ops
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
__init__.py
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
block_wise_fp8.py
[Feature] Add deepgemm bias epilogue for SM100 (#6857)
2026-03-16 20:12:00 +08:00
fp8_utils.py
[Optimization][OP]support per_token_group_fp8_quant cuda kernel (#6865)
2026-03-17 19:17:51 +08:00
kv_cache.py
[Intel HPU] enable tensor_wise_fp8 (#5324)
2025-12-17 16:45:03 +08:00
mix_quant.py
support w4afp8 moe offline permute & load (#5613)
2025-12-22 15:12:57 +08:00
mxfp4.py
[Feature] support compute shared experts before combine for better overlap (#6697)
2026-03-17 15:18:51 +08:00
nvfp4.py
[Feature] support compute shared experts before combine for better overlap (#6697)
2026-03-17 15:18:51 +08:00
quant_base.py
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
tensor_wise_fp8.py
[Intel HPU] enable tensor_wise_fp8 (#5324)
2025-12-17 16:45:03 +08:00
w4a8.py
[XPU] refactor moe ffn (#5501)
2025-12-18 14:14:05 +08:00
w4afp8.py
[Feature] support w4afp8 v1_loader and v0_loader(tp>1) (#5757)
2025-12-30 14:11:52 +08:00
w8a8.py
fix w8a8.py (#3733)
2025-09-03 10:57:26 +08:00
weight_only.py
[Models][OP][Optimization] Support DeepSeek-v3.2 model, integrate DSA & Indexer architecture with FlashMLA/DeepGEMM (#6689)
2026-03-10 15:05:14 +08:00
wfp8afp8.py
[Loader] support dummy load weight (#6169)
2026-01-26 13:58:53 +08:00
wint2.py
fix wint2 config (#4721)
2025-10-31 15:44:14 +08:00