apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-24 09:44:10 +08:00
Code Issues Actions 9 Packages Projects Releases Wiki Activity
Files
2359c8d21cce8d23dd0ec4e1d2a5d0ecdf86cc02
FastDeploy/tests/ce/deploy/21b_sot.yaml
T
Ryan a5b4866ff1 [CudaGraph][SOT] Add unit tests for splitting the static graph into piecewise graphs that support cuda_graph (#3590) 
* add unitest

* change sot_warmup_sizes

* wtf; add missed commit
2025-08-26 11:25:04 +08:00

9 lines
184 B
YAML
Raw Blame History

max_model_len: 32768
max_num_seqs: 128
tensor_parallel_size: 1
quantization: wint4
use_cudagraph: True
graph_optimization_config:
graph_opt_level: 1
sot_warmup_sizes: [2,16,32,64]
Reference in New Issue View Git Blame Copy Permalink