RAM 0fad10b35a [Executor] CUDA Graph support padding batch (#2844) ...

* cuda graph support padding batch

* Integrate the startup parameters for the graph optimization backend and provide support for user - defined capture sizes.

* Do not insert max_num_seqs when the user specifies a capture list

* Support set graph optimization config from YAML file

* update cuda graph ci

* fix ci bug

* fix ci bug

2025-07-15 19:49:01 -07:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cudagraph_piecewise_backend.py

[Executor] CUDA Graph support padding batch (#2844)

2025-07-15 19:49:01 -07:00

decorator.py

Clear dead code And supplementary notes (#2757)

2025-07-09 16:17:34 +08:00

graph_optimization_backend.py

Clear dead code And supplementary notes (#2757)

2025-07-09 16:17:34 +08:00