Juncai 412867fd99 [Feature] Support KV Cache Storage (#5571) ...

* Support Mooncake Store

* up

* up

* add op

* fix conflict

* fix error

* up for comments

* avoid thread lock

* up

* fix unittest

* fix unittest

* remove debug info

* consider tp_size > 1

* add default rdma_nics

* add utils

* up

* fix error

---------

Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>

2025-12-25 16:30:35 +08:00

..

__init__.py

[Feature] support eplb in api_server (#4782)

2025-11-24 20:22:29 +08:00

engine_cache_queue.py

[Feature] Support KV Cache Storage (#5571)

2025-12-25 16:30:35 +08:00

engine_worker_queue.py

[Optim] Improve task-checking performance in engine-worker-queue (#5376)

2025-12-11 10:33:32 +08:00

fmq_factory.py

[Feature] [Benchmark]: add ZMQ-based FMQ implementation and benchmark tools (#5418)

2025-12-08 22:04:49 +08:00

fmq.py

[Feature] [Benchmark]: add ZMQ-based FMQ implementation and benchmark tools (#5418)

2025-12-08 22:04:49 +08:00

ipc_signal_const.py

[Feature] support eplb in api_server (#4782)

2025-11-24 20:22:29 +08:00

ipc_signal.py

[Feature] support eplb in api_server (#4782)

2025-11-24 20:22:29 +08:00

zmq_client.py

[BugFix][Metrics] Fix Prometheus Multiprocess Metrics Issues and Add ZMQ Communication Metrics (#5185)

2025-11-27 15:05:09 +08:00

zmq_server.py

[Engine] [Feature] Refactor async_llm:cross-process with EngineService，based on zmq communication (#4868)

2025-12-09 10:53:40 +08:00