Yonghua Li 833d00e2d7 [BugFix] move cache creation back to cache transfer process and adapt clear/update (#6144) ...

* [fix] move cache creation back to cache transfer process

* [fix] fix clear cache

* [chore] change some log level

* [fix] fix clear cache

* [fix] fix clear cache for blockwisefp8 and mtp

* [fix] fix c8

* [fix] fix clear_mtp_cache args

* [chore] update cache_transfer_manager

* [fix] fix update mtp cache

2026-01-24 21:59:13 +08:00

..

__init__.py

[xpu] support mtp for xpu(mix) (#5274)

2025-12-01 11:03:14 +08:00

base.py

[Speculative Decoding][MTP]Support attn mask offset (#4641)

2025-11-03 10:08:01 +08:00

mtp.py

[BugFix] move cache creation back to cache transfer process and adapt clear/update (#6144)

2026-01-24 21:59:13 +08:00

ngram.py

[Executor]CUDAGraph support Speculate Decode (#3769)

2025-10-09 21:18:29 +08:00