Yonghua Li 59ae9576d2 [Cherry-Pick] [BugFix] Fix inaccurate cache hit rate and TTFT after request preemption (#6626) ...

* [chore] add has_been_rescheduled flag for requests

* [refactor] rename reschedule to preempted for accuracy and fix cache hit metrics

* [chore] add ttft_s

2026-03-05 16:25:07 +08:00

..

__init__.py

[Log] Add trace log and add loggingInstrumentor tool (#4692)

2025-11-17 11:08:57 +08:00

constants.py

[Cherry-Pick] [BugFix] Fix inaccurate cache hit rate and TTFT after request preemption (#6626)

2026-03-05 16:25:07 +08:00

trace_logger.py

set tracelogger stacklevel=2 (#5766)

2025-12-26 17:43:32 +08:00