apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-25 18:13:21 +08:00
Code Issues Actions 5 Packages Projects Releases Wiki Activity
2,738 Commits 40 Branches 17 Tags
9c8292fb19a4e4d392790e50a30d7bd2bd7a317d
Commit Graph

3 Commits

Author SHA1 Message Date
周周周 ddb10ac509 [Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880) 
* remove padding_offsets from atten
 2025-07-17 18:41:31 +08:00
RAM 0fad10b35a [Executor] CUDA Graph support padding batch (#2844) 
* cuda graph support padding batch

* Integrate the startup parameters for the graph optimization backend and provide support for user - defined capture sizes.

* Do not insert max_num_seqs when the user specifies a capture list

* Support set graph optimization config from YAML file

* update cuda graph ci

* fix ci bug

* fix ci bug
 2025-07-15 19:49:01 -07:00
littledgg 59071268b6 [Executor] Move forward_meta.py to fastdeploy/model_executor (#2774) 
* Use PEP 563 in attention.py and fix conflict

* merge commit

* Change what was left out last time
 2025-07-10 20:36:51 +08:00