Yonghua Li 9445fbe054 [KVCache] launch cache transfer processes only if hierarchical cache or kv cache storage is enabled (#5871) ...

* [fix] temporarily forbid cpu cache in update/clear api

* [fix] stop launching cache transfer manager unless hierarchical cache is enabled

* [fix] fix no attr hierarchical cache

* [fix] fix ci

* [fix] fix test_prefix_cache_manager.py

2026-01-06 14:27:47 +08:00

..

cli

[Feature] Tracing: Fine-Grained Tracing for Request Latency Part1 (#5458)

2025-12-16 16:36:09 +08:00

openai

[BugFix] Fix redundant prompt_logprobs in the second chunk of streaming response when return_token_ids is enabled for v1/completions and fix trace file name (#5829)

2026-01-06 14:11:43 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

api_server.py

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

chat_utils.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

engine_client.py

[KVCache] launch cache transfer processes only if hierarchical cache or kv cache storage is enabled (#5871)

2026-01-06 14:27:47 +08:00

llm.py

fix logprobs (#5335)

2025-12-04 10:38:51 +08:00