Yonghua Li cead6b26fa [Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#4993) ...

* [update] update time_to_first_tokens to include queue time, and remove first_token_latency and infer_latency

* [doc] update docs

* [ci] fix test

* [chore] delete redundant code

---------

Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>

2025-11-26 14:42:17 +08:00

..

transfer_factory

[PD Disaggregation][XPU] Add XPU support for PD disaggregation (#5113)

2025-11-21 14:09:01 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

cache_data.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

cache_messager.py

[PD Disaggregation][XPU] Add XPU support for PD disaggregation (#5113)

2025-11-21 14:09:01 +08:00

cache_metrics.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

cache_transfer_manager.py

[Feature] dyc8 support prefixcache (#5125)

2025-11-21 19:46:26 +08:00

multimodal_cache_manager.py

[Feature] mm support prefix cache (#4134)

2025-10-27 17:39:51 +08:00

ops.py

dummy import fd (#5192)

2025-11-24 20:23:07 +08:00

prefix_cache_manager.py

[Metrics] Update time_to_first_token to include tokenization & queue time, and remove redundant metrics (#4993)

2025-11-26 14:42:17 +08:00