 jc
|
d6b3c722c1
|
[KVCache] Storage cache supports c8 model (#6298)
* Refine cache transfer manager
* Storage cache supports c8 model
|
2026-02-06 12:01:17 +08:00 |
|
|
jc
|
7da5f54fb3
|
[CI] Add unit test for swap_layout && remove unit test of splitwise_scheduler (#6250)
* Add unit test for swap_layout
* remove splitwise_scheduler test
|
2026-01-28 19:20:20 +08:00 |
|
|
jc
|
309c7d9764
|
router support divided roolout (#6150)
|
2026-01-22 10:39:39 +08:00 |
|
|
Juncai
|
412867fd99
|
[Feature] Support KV Cache Storage (#5571)
* Support Mooncake Store
* up
* up
* add op
* fix conflict
* fix error
* up for comments
* avoid thread lock
* up
* fix unittest
* fix unittest
* remove debug info
* consider tp_size > 1
* add default rdma_nics
* add utils
* up
* fix error
---------
Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
|
2025-12-25 16:30:35 +08:00 |
|