Yonghua Li 456637002d [BugFix] fix cache transfer manager updating/clearing (#5930) ...

* [fix] fix cache transfer manager updating/clearing

* [fix] fix code style

* [fix] fix config

* [fix] fix engine client

* [fix] let worker update kv cache status signal

* [fix] update worker process

* [fix] fix clear/update for case if comm group is shutdown

* [fix] update dynamic weight manager

* [fix] fix port

* [fix] add num_cpu_blocks arg for async_llm, and remove unnecessary waiting

2026-01-13 05:09:29 -08:00

..

cli

[Feature] Tracing: Fine-Grained Tracing for Request Latency Part1 (#5458)

2025-12-16 16:36:09 +08:00

openai

[BugFix] [MultiAPIServer] fix rdma script and port check for multi api server (#5935)

2026-01-12 10:38:52 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

api_server.py

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

chat_utils.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

engine_client.py

[BugFix] fix cache transfer manager updating/clearing (#5930)

2026-01-13 05:09:29 -08:00

llm.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00