JYChen eb80724b71 [Feature] Support Ernie FP8 on sm100 (#5593) ...

* Deepgemm暂时可用版本

* dense部分 e8m0 ok

* EB模型E8M0跑通的版本

* code check

* support 21b-tp2, dev_paddle

* 单机4.5T ep OK的版本

* 修复删除的代码,单机4.5T ep(非cudagraph)

* eb tp

* Support SM100 block-wise FP8 inference

* refine codes, support deepgemm on sm100

* add thirdparty PFCC/DeepGEMM

* fix ep decode

* 使用deepep ue8m0, 解决精度问题

* 修复FP8 TP精度

* Deepgemm升级适配Hopper逻辑

* add ue8m0 kernel

* add ue8m0 kernel

* fix custom_ops/gpu_ops/cpp_extensions.cc

* eb 输出正常

* eb5 text is right

* 目测精度一致

* 自测精度对齐

* 替换masked_per_token_quant, ep精度OK

* 性能提升约30%

* 暂时跑通ep但是有问题

* 自测一致

* rm test fun

* fix ep event

* 图优化算子更新Deepgemm

* fix build

* 暂时绕过deepgemm CI编译问题

* 根据SM区分deepgemm版本

* remove useless code

---------

Co-authored-by: ckl117 <ckl117@163.com>
Co-authored-by: K11OntheBoat <“ruianmaidanglao@163.com”>
Co-authored-by: fxyfxy777 <fxyfxy777@163.com>

2026-01-29 13:49:54 +08:00

..

__init__.py

[Optimize]support machete weight only gemm (#3561)

2025-08-28 09:49:58 +08:00

cutlass_scaled_mm.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

machete_mm.py

[Feature] Support Ernie FP8 on sm100 (#5593)

2026-01-29 13:49:54 +08:00

scaled_fp8_quant.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00