freeliuzc cf7934a4b2 [Speculative Decoding] Unify Spec and non-spec branch (#6685) ...

* optimize spec-inference architecture

* delete debug log

* optimize spec_method usage  && fix unit_test

* add claude unit-test skill

* fix some ugly bug

* enhance robustness and bounds check

* unify method & spec_method to method to avoid bug

* activate CI

* fix unit test

* Unify logprobs computation for naive and speculative decoding, fix CUDA kernel

* fix logprob bug && optimize verify kernel

* fix exist_decode() judge

2026-03-10 23:58:44 -07:00

..

graph_optimization

[Speculative Decoding] Unify Spec and non-spec branch (#6685)

2026-03-10 23:58:44 -07:00

guided_decoding

[Feature] Guided Decoding add LLguidance backend (#5124)

2025-12-03 20:23:57 +08:00

layers

[Speculative Decoding] Unify Spec and non-spec branch (#6685)

2026-03-10 23:58:44 -07:00

logits_processor

[Feature] Support ThinkingBudget Logits processor to control thinking content length (#6367)

2026-02-25 14:17:09 +08:00

model_loader

add reconstruct (#6675)

2026-03-10 11:25:37 +08:00

models

[Models][OP][Optimization] Support DeepSeek-v3.2 model, integrate DSA & Indexer architecture with FlashMLA/DeepGEMM (#6689)

2026-03-10 15:05:14 +08:00

ops

[Models][OP][Optimization] Support DeepSeek-v3.2 model, integrate DSA & Indexer architecture with FlashMLA/DeepGEMM (#6689)

2026-03-10 15:05:14 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

entropy_utils.py

[Bugfix] Fix entropy calculation bugs (#5941)

2026-01-08 20:57:35 +08:00

forward_meta.py

[Models][OP][Optimization] Support DeepSeek-v3.2 model, integrate DSA & Indexer architecture with FlashMLA/DeepGEMM (#6689)

2026-03-10 15:05:14 +08:00

load_weight_utils.py

add reconstruct (#6675)

2026-03-10 11:25:37 +08:00

pre_and_post_process.py

[Speculative Decoding] Unify Spec and non-spec branch (#6685)

2026-03-10 23:58:44 -07:00

utils.py

add reconstruct (#6675)

2026-03-10 11:25:37 +08:00

xpu_pre_and_post_process.py

[XPU] Fix PD + MTP (#6495)

2026-02-27 19:07:35 +08:00