[Speculative Decoding] Optimize draft logprob (#5842)

* optimize draft logprob * fix ut
2026-04-23 00:17:25 +08:00 · 2025-12-31 13:35:56 +08:00
parent 9e45ef7ca9
commit 4e10ae5d99
6 changed files with 25 additions and 9 deletions
@@ -740,6 +740,8 @@ class SpeculativeConfig:

        self.num_extra_cache_layer = 0

+        self.enable_draft_logprob: bool = False
+
        for key, value in args.items():
            if hasattr(self, key):
                setattr(self, key, value)