4 Commits

Author	SHA1	Message	Date
sunxin	c29e86fc9d	[Feature] Support mtp overlap schedule (#7001)	2026-04-01 14:24:26 +08:00
freeliuzc	e87ce4b8cd	[Speculative Decoding] refactor MTP and optimize spec-decoding postprocess (#6973) ... * support new mtp * refactor(speculate_decoding and mtp): optimize mtp sturcture logic. Update spec-branch status-process * fix cuda-graph for spec-decoding * fix xpu mtp and fix some note * fix unittest and optmize note * fix model status update in eos-branch	2026-03-24 10:19:01 +08:00
freeliuzc	9018ccf74e	[Speculative Decoding] Fix attn_mask_offset for multi-step MTP in mixed and PD-split modes (#5738) ... * fix attn_mask_offset in mtp with multi-step and pd-split-mode * fix xpu operater register * update pmtp multi-step mtp strategy in d-split -mode * add note * fix xpu register	2025-12-25 01:54:59 -08:00
co63oc	976aa88e66	【Hackathon 9th No.69】add test_draft_model_preprocess (#3832) ... * add test_draft_model_preprocess * fix * ci	2025-09-08 17:08:50 +08:00