GoldPancake 2178f2829b [Speculative Decoding] Support suffix decoding (#6403) ...

* support suffix decoding

2026-02-26 11:42:05 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cudagraph_piecewise_backend.py

[Speculative Decoding] Support suffix decoding (#6403)

2026-02-26 11:42:05 +08:00

decorator.py

[BugFix] Fix image_feature 0-Size causing insert failed (#4042)

2025-09-12 19:13:08 +08:00

dynamic_dims_marker.py

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

graph_optimization_backend.py

[Graph Optimization] Support CUDAGraph for P/PD mixed Batch using SOT subgraph spliting mode (#6196)

2026-01-29 16:29:54 +08:00

utils.py

[Iluvatar] add vl into ci and support v1 loader (#4774)

2025-11-11 10:50:17 +08:00