Jundong Liu 70ee910cd5 [Excutor] Change cudagraph hashkey from batch size to num_tokens (#3454)

2025-08-18 16:16:48 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cudagraph_piecewise_backend.py

[Excutor] Change cudagraph hashkey from batch size to num_tokens (#3454)

2025-08-18 16:16:48 +08:00

decorator.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

dynamic_dims_marker.py

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

graph_optimization_backend.py

[SOT] Add sot warmup (NVIDIA GPU Only) (#2929)

2025-07-22 21:36:14 +08:00

utils.py

[SOT] Add sot warmup (NVIDIA GPU Only) (#2929)

2025-07-22 21:36:14 +08:00