yeliang2258 8d31fe59e8 [Backend] Support the deployment of models which is larger than 2G in ORT and TRT backend (#514) ...

* support model bigger than 2G

* update code

* update code

* fix bug

* update code

2022-11-09 11:14:15 +08:00

..

ops

Modify file structure to separate python and cpp code (#223)

2022-09-14 15:44:13 +08:00

ort_backend.cc

[Backend] Support the deployment of models which is larger than 2G in ORT and TRT backend (#514)

2022-11-09 11:14:15 +08:00

ort_backend.h

[Serving][backend]serving support multi stream and backend support external stream (#431)

2022-10-26 14:46:13 +08:00

utils.cc

remote HOSTDEVICE modifier

2022-10-02 04:28:30 +00:00

utils.h

Modify file structure to separate python and cpp code (#223)

2022-09-14 15:44:13 +08:00