Yonghua Li 638009387d [Cherry-Pick] [BugFix] fix cache manager not launched in case of mtp or blockwise fp8 (#5840) (#5841) ...

* [BugFix] fix cache manager not launched in case of mtp or blockwise fp8

* [fix] fix mtp cache in mtp.py

* [fix] fix gpu ops import

* [fix] fix mtp layer idx

2025-12-31 15:08:34 +08:00

..

__init__.py

[xpu] support mtp for xpu(mix) (#5274)

2025-12-01 11:03:14 +08:00

base.py

[Speculative Decoding][MTP]Support attn mask offset (#4641)

2025-11-03 10:08:01 +08:00

mtp.py

[Cherry-Pick] [BugFix] fix cache manager not launched in case of mtp or blockwise fp8 (#5840) (#5841)

2025-12-31 15:08:34 +08:00

ngram.py

[Executor]CUDAGraph support Speculate Decode (#3769)

2025-10-09 21:18:29 +08:00