apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity
Files
defaffd5fbbd2f4d36396e6f2e6147f5a910100b
FastDeploy/custom_ops/gpu_ops
T
History
Ding defaffd5fb 【Hackathon 10th Spring No.45】FastDeploy 支持在 T4/V100 硬件的编译 -part (#6488) 
* fix(custom_ops): gate unsupported ops for sm70/sm75 build

* fix(custom_ops): gate deepgemm exports to sm75+ only

* [BugFix][OP] deduplicate CUDA sources to avoid moe_deepgemm multiple definition

* revert two custom_ops files to 352f922f9
2026-03-23 19:16:23 +08:00
..
append_attn
[Others] clean code (#6839)
2026-03-14 11:09:28 +08:00
common
init (#6642)
2026-03-04 21:55:31 +08:00
custom_all_reduce
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
cutlass_extensions
init (#6642)
2026-03-04 21:55:31 +08:00
cutlass_kernels
init (#6642)
2026-03-04 21:55:31 +08:00
flash_mask_attn
…
fp8_gemm_with_cutlass
init (#6642)
2026-03-04 21:55:31 +08:00
glog
init (#6642)
2026-03-04 21:55:31 +08:00
int8_gemm_with_cutlass
init (#6642)
2026-03-04 21:55:31 +08:00
machete
init (#6642)
2026-03-04 21:55:31 +08:00
mla_attn
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
moba_attn
init (#6642)
2026-03-04 21:55:31 +08:00
moe
[BugFix] Fix ep compatibility issues & Optimize permute operator (#6821)
2026-03-17 10:32:11 +08:00
quantization
cuda13.0, implement changes to CCCL (#6751)
2026-03-10 16:47:02 +08:00
sample_kernels
cuda13.0, implement changes to CCCL (#6751)
2026-03-10 16:47:02 +08:00
sparse_indexer
[Optimization][Feature]Supports multiple batches of DSK-DSA. (#6930)
2026-03-20 15:59:22 +08:00
speculate_decoding
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
2026-03-16 14:22:18 +08:00
w4afp8_gemm
…
wfp8afp8_sparse_gemm
init (#6642)
2026-03-04 21:55:31 +08:00
append_attention.cu
…
beam_search_softmax.cu
cuda13.0, implement changes to CCCL (#6751)
2026-03-10 16:47:02 +08:00
cccl_compat.h
cuda13.0, implement changes to CCCL (#6751)
2026-03-10 16:47:02 +08:00
cpp_extensions.cc
【Hackathon 10th Spring No.45】FastDeploy 支持在 T4/V100 硬件的编译 -part (#6488)
2026-03-23 19:16:23 +08:00
cuda_multiprocess.h
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
custom_ftok.h
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
2026-03-16 14:22:18 +08:00
dequant_int8.cu
init (#6642)
2026-03-04 21:55:31 +08:00
enforce_generation.cu
init (#6642)
2026-03-04 21:55:31 +08:00
env.h
init (#6642)
2026-03-04 21:55:31 +08:00
fused_get_rotary_embedding.cu
init (#6642)
2026-03-04 21:55:31 +08:00
fused_hadamard_quant_fp8.cu
init (#6642)
2026-03-04 21:55:31 +08:00
fused_mask_swiglu_fp8_quant_kernel.cu
[Feature] Support EP prefill with num_worst_tokens (#6574)
2026-03-11 17:09:07 +08:00
fused_neox_rope_embedding.cu
…
fused_rotary_position_encoding.cu
init (#6642)
2026-03-04 21:55:31 +08:00
gather_idx.cu
init (#6642)
2026-03-04 21:55:31 +08:00
gelu_tanh.cu
…
get_attn_mask_q.cu
…
get_data_ptr_ipc.cu
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
get_img_boundaries.cc
…
get_mm_split_fuse.cc
init (#6642)
2026-03-04 21:55:31 +08:00
get_output_ep.cc
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
2026-03-16 14:22:18 +08:00
get_output_msg_with_topk.cc
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
2026-03-16 14:22:18 +08:00
get_output.cc
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
2026-03-16 14:22:18 +08:00
get_padding_offset_system.cu
init (#6642)
2026-03-04 21:55:31 +08:00
get_padding_offset.cu
…
get_position_ids_and_mask_encoder_batch.cu
init (#6642)
2026-03-04 21:55:31 +08:00
helper.cu
[Feature][BugFix][OP] Enhance Deterministic Inference Mode with Kernel-level Fixes and Batch-invariant BMM (#6610)
2026-03-09 10:27:53 +08:00
helper.h
[Feature] Support EP prefill with num_worst_tokens (#6574)
2026-03-11 17:09:07 +08:00
init_signal_layerwise.cc
init (#6642)
2026-03-04 21:55:31 +08:00
ipc_sent_key_value_cache_by_remote_ptr.cu
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
limit_thinking_content_length.cu
…
merge_prefill_decode_output.cu
init (#6642)
2026-03-04 21:55:31 +08:00
msg_utils.h
init (#6642)
2026-03-04 21:55:31 +08:00
multi_head_latent_attention.cu
…
ngram_mask.cu
init (#6642)
2026-03-04 21:55:31 +08:00
noaux_tc_redundant.cu
…
noaux_tc.cu
init (#6642)
2026-03-04 21:55:31 +08:00
noauxtc_kernel.h
…
open_shm_and_get_meta_signal.cc
init (#6642)
2026-03-04 21:55:31 +08:00
per_token_quant_fp8.cu
[Feature] Support EP prefill with num_worst_tokens (#6574)
2026-03-11 17:09:07 +08:00
read_data_ipc.cu
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
read_ids.py
…
read_temp_ids.py
…
reasoning_phase_token_constraint.cu
…
rebuild_padding.cu
…
recover_decode_task.cu
init (#6642)
2026-03-04 21:55:31 +08:00
remote_cache_kv_ipc.cc
init (#6642)
2026-03-04 21:55:31 +08:00
remote_cache_kv_ipc.h
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
2026-03-16 14:22:18 +08:00
save_output_msg_with_topk.cc
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
2026-03-16 14:22:18 +08:00
save_with_output_msg.cc
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
2026-03-16 14:22:18 +08:00
save_with_output_msg.h
init (#6642)
2026-03-04 21:55:31 +08:00
save_with_output.cc
init (#6642)
2026-03-04 21:55:31 +08:00
scaled_gemm_f8_i4_f16_gemm.cu
init (#6642)
2026-03-04 21:55:31 +08:00
scaled_gemm_f8_i4_f16_weight_quantize.cu
init (#6642)
2026-03-04 21:55:31 +08:00
seqs2seqs.cu
init (#6642)
2026-03-04 21:55:31 +08:00
set_data_ipc.cu
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
set_flags.cu
init (#6642)
2026-03-04 21:55:31 +08:00
set_mask_value.cu
init (#6642)
2026-03-04 21:55:31 +08:00
set_value_by_flags_and_idx.cu
…
share_external_data.cu
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
step_reschedule.cu
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
2026-03-16 14:22:18 +08:00
step_system_cache.cu
init (#6642)
2026-03-04 21:55:31 +08:00
step.cu
cuda13.0, implement changes to CCCL (#6751)
2026-03-10 16:47:02 +08:00
stop_generation_multi_ends.cu
…
stop_generation.cu
init (#6642)
2026-03-04 21:55:31 +08:00
swap_cache_batch.cu
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
swap_cache_layout.cu
…
swap_cache.cu
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
system2group.cu
init (#6642)
2026-03-04 21:55:31 +08:00
text_image_gather_scatter.cu
…
text_image_index_out.cu
init (#6642)
2026-03-04 21:55:31 +08:00
token_penalty_multi_scores.cu
[Feature][BugFix][OP] Enhance Deterministic Inference Mode with Kernel-level Fixes and Batch-invariant BMM (#6610)
2026-03-09 10:27:53 +08:00
token_penalty_only_once.cu
init (#6642)
2026-03-04 21:55:31 +08:00
token_transfer.hpp
init (#6642)
2026-03-04 21:55:31 +08:00
transfer_output.cc
init (#6642)
2026-03-04 21:55:31 +08:00
tune_cublaslt_gemm.cu
[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)
2026-03-16 21:32:43 +08:00
unset_data_ipc.cu
init (#6642)
2026-03-04 21:55:31 +08:00
update_attn_mask_offsets.cu
…
update_inputs_beam.cu
…
update_inputs_v1.cu
…
update_inputs.cu
…
update_split_fuse_input.cu
init (#6642)
2026-03-04 21:55:31 +08:00