mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-05-07 16:08:58 +08:00

Files

T

yeliang2258 2a68a23baf Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend (#257 )

* add quantize model support for trt and paddle

* fix bugs

* fix

* update paddle2onnx version

* update version

* add quantize test

Co-authored-by: Jason <jiangjiajun@baidu.com>

2022-10-09 20:00:05 +08:00

backends

Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend (#257 )

2022-10-09 20:00:05 +08:00

core

Integrate FalconCV to boost image preprocessing (#331 )

2022-10-09 10:34:51 +08:00

function

Upgrade eigen func (#253 )

2022-09-20 10:58:07 +08:00

pybind

Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend (#257 )

2022-10-09 20:00:05 +08:00

text

Rename fastdeploy_runtime.h to runtime.h and Frontend to ModelFormat (#263 )

2022-09-22 13:24:05 +08:00

utils

Add paddlelite backend support (#260 )

2022-09-21 13:22:34 +08:00

vision

Add Initialize function to PP-OCR (#326 )

2022-10-09 17:31:37 +08:00

CMakeLists.txt

Modify file structure to separate python and cpp code (#223 )

2022-09-14 15:44:13 +08:00

fastdeploy_model.cc

Remove debug code (#266 )

2022-09-22 15:18:50 +08:00

fastdeploy_model.h

Add some comments for ppyoloe (#324 )

2022-10-07 20:41:04 +08:00

README.md

Add some comments for ppyoloe (#324 )

2022-10-07 20:41:04 +08:00

runtime.cc

Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend (#257 )

2022-10-09 20:00:05 +08:00

runtime.h

Add paddle quantize model support for ORT, TRT and MKLDNN deploy backend (#257 )

2022-10-09 20:00:05 +08:00

text.h

Modify file structure to separate python and cpp code (#223 )

2022-09-14 15:44:13 +08:00

vision.h

Modify file structure to separate python and cpp code (#223 )

2022-09-14 15:44:13 +08:00

README.md

FastDeploy C++ API Summary

Runtime

FastDeploy Runtime can be used as an inference engine with the same code, we can deploy Paddle/ONNX model on different device by different backends.
Currently, FastDeploy supported backends listed as below,

Backend	Hardware	Support Model Format	Platform
Paddle Inference	CPU/Nvidia GPU	Paddle	Windows(x64)/Linux(x64)
ONNX Runtime	CPU/Nvidia GPU	Paddle/ONNX	Windows(x64)/Linux(x64/aarch64)/Mac(x86/arm64)
TensorRT	Nvidia GPU	Paddle/ONNX	Windows(x64)/Linux(x64)/Jetson
OpenVINO	CPU	Paddle/ONNX	Windows(x64)/Linux(x64)/Mac(x86)

Example code

Vision Models

Task	Model	API	Example
object detection	PaddleDetection/PPYOLOE	fastdeploy::vision::detection::PPYOLOE	C++/Python

README.md

FastDeploy C++ API Summary

Runtime

Example code

Related APIs

Vision Models