freeliuzc 22a4f6019d [Speculative Decoding][BugFix] Fix apply repeat times penalty kernel and change spec default verify strategy (#7467) ...

* fix repeat_time kernel and change default spec verify strategy

* fix unit_test

2026-04-18 00:38:01 +08:00

..

draft_model

[Speculative Decoding] Add MTP logprob support for PD disaggregation (#7442)

2026-04-17 21:37:38 +08:00

build_sampling_params.cu

…

naive_update_model_status.cu

…

ngram_match_common.cuh

…

ngram_match.cu

…

speculate_calcu_accept_ratio.cu

…

speculate_clear_accept_nums.cu

…

speculate_get_output_with_topk.cc

[Speculative Decoding] Add MTP logprob support for PD disaggregation (#7442)

2026-04-17 21:37:38 +08:00

speculate_get_output.cc

…

speculate_get_seq_lens_output.cu

…

speculate_get_token_penalty_multi_scores.cu

[Speculative Decoding][BugFix] Fix apply repeat times penalty kernel and change spec default verify strategy (#7467)

2026-04-18 00:38:01 +08:00

speculate_limit_thinking_content_length.cu

[Speculate Decoding] Fix step_idx semantics in limit_thinking and set_stop_value kernels (#7166)

2026-04-13 20:53:42 +08:00

speculate_logprob_msg.h

[Speculative Decoding] Add MTP logprob support for PD disaggregation (#7442)

2026-04-17 21:37:38 +08:00

speculate_logprob_utils.cu

…

speculate_msg.h

…

speculate_preprocess.cu

…

speculate_save_output_with_topk.cc

[Speculative Decoding] Add MTP logprob support for PD disaggregation (#7442)

2026-04-17 21:37:38 +08:00

speculate_save_output.cc

…

speculate_schedule_cache.cu

…

speculate_set_stop_value_multi_seqs.cu

[Speculate Decoding] Fix step_idx semantics in limit_thinking and set_stop_value kernels (#7166)

2026-04-13 20:53:42 +08:00

speculate_set_value_by_flags_and_idx.cu

…

speculate_step_reschedule.cu

…

speculate_step_system_cache.cu

…

speculate_step.cu

…

speculate_update_input_ids_cpu.cc

…

speculate_update.cu

…

speculate_verify.cu

…

top_p_candidates.cu

…

unified_update_model_status.cu

[Speculate Decoding] Fix step_idx semantics in limit_thinking and set_stop_value kernels (#7166)

2026-04-13 20:53:42 +08:00

verify_draft_tokens.cu

…