RAM 870364b547 [CUDAGraph]CUDA Graph support unique memory pool (#4230) ...

* cuda graph use unique memory pool

* fix custom device import bug

* refine code

* refine code

* refine code

2025-09-24 19:45:22 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cudagraph_piecewise_backend.py

[CUDAGraph]CUDA Graph support unique memory pool (#4230)

2025-09-24 19:45:22 +08:00

decorator.py

[BugFix] Fix image_feature 0-Size causing insert failed (#4042)

2025-09-12 19:13:08 +08:00

dynamic_dims_marker.py

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

graph_optimization_backend.py

fix typos (#3684)

2025-09-01 17:50:17 +08:00

utils.py

[SOT] Add sot warmup (NVIDIA GPU Only) (#2929)

2025-07-22 21:36:14 +08:00