Yonghua Li fa1906bd6f [BugFix] Fix inaccurate cache hit rate and TTFT after request preemption (#6620) ...

* [chore] add has_been_rescheduled flag for requests

* [refactor] rename reschedule to preempted for accuracy and fix cache hit metrics

* [chore] add ttft_s

2026-03-05 16:25:02 +08:00

..

__init__.py

…

constants.py

[BugFix] Fix inaccurate cache hit rate and TTFT after request preemption (#6620)

2026-03-05 16:25:02 +08:00

trace_logger.py

[Feature]Log Format Normalization and Trace Log Optimization (#6370)

2026-03-03 11:31:45 +08:00