freeliuzc 2d1dade5e2 [Speculative Decoding][MTP] Support static CacheKV C8 quantization and optimize memory usage (#5155) ...

* support static cachekv c8 quantization in mtp mode

* optimize memory allocation

2025-11-21 15:10:13 +08:00

..

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

config.py

[Speculative Decoding][MTP] Support static CacheKV C8 quantization and optimize memory usage (#5155)

2025-11-21 15:10:13 +08:00

data.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

dp_scheduler.py

[Optimize] Support and robust for tpN for PD (#4595)

2025-11-03 15:38:31 +08:00

global_scheduler.py

test scheduler (#4739)

2025-11-03 20:12:14 +08:00

local_scheduler.py

Fix schedule error in splitwise deployment (#5149)

2025-11-20 21:18:10 +08:00

splitwise_scheduler.py

[Optimization] xgrammar async compile, multi thread, speed up (#4835)

2025-11-14 18:05:26 +08:00

storage.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

workers.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00