luukunn c3d8db85c4 [Optimization] Update ZMQ server (#6735) ...

* add batch zmq send reaponse

* update

* Revert "update"

This reverts commit 0234a25b47.

* update

* remove lock

* fix unit test

* add unit test

* add unit test

* pre commit

* add unit test

* fix unit test

* add unit test

* fix worker>1

* update zmq_worker_pid

* fix unit test

* fix unit test

* fix unit test

* add unit test

* fix unit test

* fix first token time

* fix logprobs

* add unit test

* op

* remore debug log

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>

2026-03-19 21:53:16 +08:00

..

__init__.py

[BugFix][KVCache] Add inter-process lock to fix NaN error under DP+EP (#6724)

2026-03-10 21:55:32 +08:00

engine_cache_queue.py

[BugFix] fix cache transfer tasks failure after cache cleared (#6202)

2026-02-08 15:33:56 +08:00

engine_worker_queue.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00

fmq_factory.py

[Feature] [Benchmark]: add ZMQ-based FMQ implementation and benchmark tools (#5418)

2025-12-08 22:04:49 +08:00

fmq.py

[RL] add pause, update_weights, resume interface for async RL (#6052)

2026-01-23 10:18:07 +08:00

ipc_signal_const.py

[Feature] support eplb in api_server (#4782)

2025-11-24 20:22:29 +08:00

ipc_signal.py

[BugFix][KVCache] Add inter-process lock to fix NaN error under DP+EP (#6724)

2026-03-10 21:55:32 +08:00

zmq_client.py

[BugFix][Metrics] Fix Prometheus Multiprocess Metrics Issues and Add ZMQ Communication Metrics (#5185)

2025-11-27 15:05:09 +08:00

zmq_server.py

[Optimization] Update ZMQ server (#6735)

2026-03-19 21:53:16 +08:00