FastDeploy

append_attn

[RL] change glm rope_emb calculation (#7316 )

2026-04-11 18:36:28 +08:00

common

…

custom_all_reduce

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

cutlass_extensions

…

cutlass_kernels

support moe for sm103 (#7238 )

2026-04-08 15:52:39 +08:00

flash_mask_attn

[BugFix] Fix Async D2H copy bug & flash mash atten cache V out of bound bug (#7221 )

2026-04-10 11:31:51 +08:00

fp8_gemm_with_cutlass

[Others] Fix typo (#7280 )

2026-04-14 17:28:22 +08:00

glog

…

int8_gemm_with_cutlass

…

machete

[BugFix] detection jinja2 (#7251 )

2026-04-09 11:30:16 +08:00

mla_attn

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

moba_attn

…

moe

[OP]Unify MoE op with moe_permute path for bf16 GLM (#7164 )

2026-04-09 16:17:56 +08:00

quantization

cuda13.0, implement changes to CCCL (#6751 )

2026-03-10 16:47:02 +08:00

sample_kernels

cuda13.0, implement changes to CCCL (#6751 )

2026-03-10 16:47:02 +08:00

sparse_indexer

fix dsa (#7252 )

2026-04-08 20:21:38 +08:00

speculate_decoding

[Speculative Decoding] Add MTP logprob support for PD disaggregation (#7442 )

2026-04-17 21:37:38 +08:00

w4afp8_gemm

…

wfp8afp8_sparse_gemm

…

append_attention.cu

[RL] RoPE without fmad opt (#6901 )

2026-03-24 21:19:53 +08:00

beam_search_softmax.cu

cuda13.0, implement changes to CCCL (#6751 )

2026-03-10 16:47:02 +08:00

cccl_compat.h

cuda13.0, implement changes to CCCL (#6751 )

2026-03-10 16:47:02 +08:00

cpp_extensions.cc

[Optimization][DeepSeekV3.2]Reducing slot_mapping compute frequency from twice per layer to a single pre-processing step. (#7367 )

2026-04-16 19:54:12 +08:00

cuda_multiprocess.h

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

custom_ftok.h

[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822 )

2026-03-16 14:22:18 +08:00

dequant_int8.cu

…

enforce_generation.cu

…

env.h

…

fused_get_rotary_embedding.cu

…

fused_hadamard_quant_fp8.cu

…

fused_mask_swiglu_fp8_quant_kernel.cu

[Optimization] optimize fused_swiglu_fp8_quant_kernel (#7007 )

2026-03-27 16:10:16 +08:00

fused_neox_rope_embedding.cu

…

fused_rotary_position_encoding.cu

[OP][Models][Optimization] 优化 RoPE CUDA kernel 并更新 DeepSeek V3 配置 (#7359 )

2026-04-13 19:12:36 +08:00

gather_idx.cu

…

gelu_tanh.cu

…

get_attn_mask_q.cu

update attn_mask_q 2 (#7371 )

2026-04-13 23:06:04 +08:00

get_data_ptr_ipc.cu

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

get_img_boundaries.cc

…

get_mm_split_fuse.cc

…

get_output_ep.cc

[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822 )

2026-03-16 14:22:18 +08:00

get_output_msg_with_topk.cc

[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822 )

2026-03-16 14:22:18 +08:00

get_output.cc

[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822 )

2026-03-16 14:22:18 +08:00

get_padding_offset_system.cu

…

get_padding_offset.cu

…

get_position_ids_and_mask_encoder_batch.cu

[Optimization][DeepSeekV3.2]Reducing slot_mapping compute frequency from twice per layer to a single pre-processing step. (#7367 )

2026-04-16 19:54:12 +08:00

helper.cu

[RL] RoPE without fmad opt (#6901 )

2026-03-24 21:19:53 +08:00

helper.h

[RL] RoPE without fmad opt (#6901 )

2026-03-24 21:19:53 +08:00

init_signal_layerwise.cc

…

ipc_sent_key_value_cache_by_remote_ptr.cu

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

limit_thinking_content_length.cu

…

merge_prefill_decode_output.cu

[Optimization] [OP] [Models] dsk del prefill mask (#7313 )

2026-04-11 19:32:27 +08:00

msg_utils.h

…

multi_head_latent_attention.cu

…

ngram_mask.cu

…

noaux_tc_redundant.cu

…

noaux_tc.cu

…

noauxtc_kernel.h

…

open_shm_and_get_meta_signal.cc

…

per_token_quant_fp8.cu

[Feature] Support EP prefill with num_worst_tokens (#6574 )

2026-03-11 17:09:07 +08:00

read_data_ipc.cu

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

read_ids.py

…

read_temp_ids.py

…

reasoning_phase_token_constraint.cu

[Speculate Decoding] Fix bug of reasoning_phase_token_constraint kernel (#7349 )

2026-04-14 20:57:11 +08:00

rebuild_padding.cu

[Feature] Support mtp overlap schedule (#7001 )

2026-04-01 14:24:26 +08:00

recover_decode_task.cu

…

remote_cache_kv_ipc.cc

…

remote_cache_kv_ipc.h

[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822 )

2026-03-16 14:22:18 +08:00

save_output_msg_with_topk.cc

[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822 )

2026-03-16 14:22:18 +08:00

save_with_output_msg.cc

[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822 )

2026-03-16 14:22:18 +08:00

save_with_output_msg.h

…

save_with_output.cc

…

scaled_gemm_f8_i4_f16_gemm.cu

…

scaled_gemm_f8_i4_f16_weight_quantize.cu

…

seqs2seqs.cu

…

set_data_ipc.cu

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

set_flags.cu

…

set_mask_value.cu

…

set_value_by_flags_and_idx.cu

…

share_external_data.cu

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

step_reschedule.cu

[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822 )

2026-03-16 14:22:18 +08:00

step_system_cache.cu

…

step.cu

cuda13.0, implement changes to CCCL (#6751 )

2026-03-10 16:47:02 +08:00

stop_generation_multi_ends.cu

…

stop_generation.cu

…

swap_cache_batch.cu

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

swap_cache_layout.cu

…

swap_cache.cu

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

system2group.cu

…

text_image_gather_scatter.cu

…

text_image_index_out.cu

…

token_penalty_multi_scores.cu

[Feature][BugFix][OP] Enhance Deterministic Inference Mode with Kernel-level Fixes and Batch-invariant BMM (#6610 )

2026-03-09 10:27:53 +08:00

token_penalty_only_once.cu

…

token_transfer.hpp

…

transfer_output.cc

…

tune_cublaslt_gemm.cu

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533 )

2026-03-16 21:32:43 +08:00

unset_data_ipc.cu

…

update_attn_mask_offsets.cu

[Speculative Decoding] Optimize attn_mask_offset and fix mtp bug (#7005 )

2026-03-25 01:52:06 -07:00

update_inputs_beam.cu

…

update_inputs_v1.cu

…

update_inputs.cu

…

update_split_fuse_input.cu

…