apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity

[Graph Optimization] Add dy_runnable and introduce cudagraph_switch_threshold for cudagraph mode switching (#4578)

Browse Source 
* add new branch for sot

* reorder

* fix batch bug
This commit is contained in:
Ryan
2025-10-24 18:36:52 +08:00
committed by GitHub
parent e02a812880
commit f42ed6d5f2
2 changed files with 8 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tests/graph_optimization/test_graph_opt_backend.py
+1 -1
View File
@@ -83,7 +83,7 @@ class TestGraphOptBackend(unittest.TestCase):
self.input_shape = (4, 8)
self.dtype = "int32"
self.model_config = {}
self.max_num_seqs = 1
self.max_num_seqs = 4
# Create baseline configuration (dynamic graph, no cudagraph)
baseline_graph_opt_config = GraphOptimizationConfig(args={})