GoldPancake a1fc4e249e [Bugfix] Fix mtp logprob hang problem when include stop_seq (#5927) ...

* fix mtp logprob hang when include stop_seq

2026-01-08 14:21:24 +08:00

..

draft_model

[Speculative Decoding] Fix attn_mask_offset for multi-step MTP in mixed and PD-split modes (#5738)

2025-12-25 01:54:59 -08:00

ngram_match.cc

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

speculate_calcu_accept_ratio.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_clear_accept_nums.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_get_output_padding_offset.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_get_output_with_topk.cc

[Feature] support mtp logprob (#4464)

2025-10-20 15:18:12 +08:00

speculate_get_output.cc

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

speculate_get_padding_offset.cu

Remove CUDA ERROR 9 of inputs of get_padding_offset kernel (#5440)

2025-12-09 14:17:30 +08:00

speculate_get_seq_lens_output.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_get_token_penalty_multi_scores.cu

rename speculate_token_penalty_multi_scores.cu (#3735)

2025-09-02 18:12:11 +08:00

speculate_limit_thinking_content_length_v1.cu

[BugFix] fix speculate_limit_thinking_content_length (#5590)

2025-12-16 04:31:45 -08:00

speculate_limit_thinking_content_length_v2.cu

[BugFix] fix speculate_limit_thinking_content_length (#5590)

2025-12-16 04:31:45 -08:00

speculate_logprob_utils.cu

[Feature] support mtp logprob (#4464)

2025-10-20 15:18:12 +08:00

speculate_msg.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_save_output_with_topk.cc

[Bugfix] Fix mtp logprob hang problem when include stop_seq (#5927)

2026-01-08 14:21:24 +08:00

speculate_save_output.cc

[MTP]support mtp chunk_prefill_v1 (#4366)

2025-10-15 13:21:32 +08:00

speculate_schedule_cache.cu

support mtp in splitewise and scheduler_v1 mode (#4743)

2025-11-03 10:07:15 +08:00

speculate_set_stop_value_multi_seqs.cu

[Feature] support stop_token_ids (#5399)

2025-12-09 17:49:12 +08:00

speculate_set_value_by_flags_and_idx.cu

Optimizing the performance of think length limit using custom operators (#4279)

2025-10-20 21:09:13 +08:00

speculate_step_reschedule.cu

fix typos (#3684)

2025-09-01 17:50:17 +08:00

speculate_step_system_cache.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_step.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_update_input_ids_cpu.cc

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_update.cu

[Speculative Decoding][MTP]Support attn mask offset (#4641)

2025-11-03 10:08:01 +08:00

speculate_verify.cu

[Feature] support mtp distribution equivalence verification (#4699)

2025-10-31 11:45:04 +08:00

top_p_candidates.cu

[Metax] modify wrapSize to WARP_SIZE (#5442)

2025-12-09 01:44:02 -08:00