10 Commits

Author	SHA1	Message	Date
zhouchong	6e16438a57	[Feature] implement log channel separation and request log level system (#7190) ... * feat: implement log channel separation and request log level system * fix: log system improvements based on review * add request_id to error logs, use RequestLogLevel enum, and unify logger implementation from utils to logger module	2026-04-16 15:13:05 +08:00
chenjian	6727df8286	[Optimization] Optimize ttft for prefill pd (#6680) ... * optimize ttft * fix * fix * fix ci * fix ci * fix * fix bug * fix * add comments * fix ci * fix * fix ci * fix format * update according to review * add comment * fix * fix format	2026-03-30 20:36:23 +08:00
1	3a85ecf3bc	[Others] Fix typos in log messages and comments (#6707) ... Fix spelling errors in log messages, docstrings, and comments: - 'occured' -> 'occurred' (8 instances) - 'Recieve'/'recieved' -> 'Receive'/'received' (7 instances) - 'happend' -> 'happened' (3 instances) - 'expet_servic' -> 'expert_service' (2 instances) - 'meas' -> 'means' (1 instance) No functional changes. Only log strings, docstrings, and comments are affected. Co-authored-by: cloudforge1 <cloudforge1@users.noreply.github.com>	2026-03-09 10:26:25 +08:00
ddchenhao66	fa4815b93a	[BugFix] fix dp sheduler bug in ep4tp1 when start by using multi_api_server (#6598) ... * [BugFix] fix dp sheduler bug in ep4tp1 when start by using multi_api_server * [BugFix] modify request_queue and result_queue of dp scheduler	2026-03-05 10:04:12 +08:00
chenjian	35c24f3f71	Revert "[Optimize] Optimize ttft for ep (#6098)" (#6402) ... This reverts commit 90db0bdd0d.	2026-02-09 19:01:23 +08:00
chenjian	90db0bdd0d	[Optimize] Optimize ttft for ep (#6098) ... * optimize ttft * fix * fix * fix ci * fix ci * fix * fix bug * fix * add comments * fix ci * fix	2026-02-04 15:03:29 +08:00
chenjian	3ea1b44a58	[Optimization] Improve perf for fd response token with internal adapter (#4992) ... * [Optimize] Improve perf for fd response token with internal adapter * fix * fix bug * fix ci * fix ci * fix ci * fix ci	2025-11-21 19:02:03 +08:00
chenjian	25498efcf3	[Optimize] Support and robust for tpN for PD (#4595) ... * [Optimize] Support and robust for tpN for PD * fix * fix * support dpM tpN for cache messager * fix * fix token counter * fix bug for merge develop * fix bug * robust cache messager for v0	2025-11-03 15:38:31 +08:00
chenjian	670aaa3f83	[Bug fix] Fix pd for x1 thinking (#4433)	2025-10-16 12:03:45 +08:00
chenjian	918ccdb123	[Feature] Support pd ep deployment with yiyan adapter (#4029) ... * [Feature] Support mixed deployment with yiyan adapter in release2.2 * fix metrics * add unit test * add unit test * add unit test * Support pd ep deployment with yiyan adapter * Support pd ep deployment with yiyan adapter * refactor cache messager * support scheduler v1 in PD * suppport pd v1 + chunk prefill * suppport pd v1 + chunk prefill * add eplb * support eplb * support eplb * support eplb * support v1 * fix * fix * fix bug * remove eplb support * support prefix cache in P * fix bug * fix bug * support one stop in V1 * fix bug * fix ci * fix ci * fix * fix * fix * fix * fix --------- Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-09-22 16:41:38 +08:00