fba8a51ad1
[Feature] Fix mixed cache-aware ( #7129 )
...
* [Feature] Config eviction_duration
* [Feature] Config eviction_duration
* [Feature] Config eviction_duration
* [Feature] Config eviction_duration
* [Feature] Fix mixed cache-aware
---------
Co-authored-by: mouxin <mouxin@baidu.com >
2026-04-01 19:29:29 +08:00
6cae9b1f50
[Feature] Config eviction_duration ( #7125 )
...
* [Feature] Config eviction_duration
* [Feature] Config eviction_duration
* [Feature] Config eviction_duration
* [Feature] Config eviction_duration
---------
Co-authored-by: mouxin <mouxin@baidu.com >
2026-04-01 16:46:21 +08:00
61a9079c60
[Feature] Update logging ( #7072 )
2026-03-30 11:20:27 +08:00
6c24f1955c
[Feature] Update error logging ( #7045 )
2026-03-27 15:13:12 +08:00
96b0ecea6b
[Feature] Update Counter Release ( #6943 )
2026-03-20 10:51:37 +08:00
2a371a3450
[Feature] Update tpSize ( #6896 )
2026-03-17 20:20:39 +08:00
b61731bb96
[Feature][Docs] Adjust prefill release & expose load metrics ( #6884 )
2026-03-17 15:23:13 +08:00
1ed6073d94
[Feature] Update logging for Golang Router ( #6801 )
2026-03-12 15:18:31 +08:00
b6190de557
[Feature] Add concurrency protection to selectworker ( #6775 )
...
* [Feature] Add concurrency protection to selectworker
---------
Co-authored-by: mouxin <mouxin@baidu.com >
2026-03-11 14:32:06 +08:00
22d308a274
[Docs] Specify the default strategy ( #6728 )
...
* [Docs] Update the document
---------
Co-authored-by: mouxin <mouxin@baidu.com >
2026-03-10 13:16:31 +08:00
6e96bd0bd2
[Feature] Fix counter release logic & update go-router download URL ( #6280 )
...
* [Doc] Update prerequisites in the documentation
* [Feature] Enhance Router with /v1/completions, docs, scripts, and version info
* [Feature] Enhance Router with /v1/completions, docs, scripts, and version info
* [Feature] Enhance Router with /v1/completions, docs, scripts, and version info
* [Feature] Fix counter release logic
* [Feature] Update go-router download URL
* [Feature] Update go-router download URL
* [Feature] Update go-router download URL
* [Feature] Update go-router download URL
* [Feature] Update token counter logic and docs
* [Feature] Update token counter logic and docs
---------
Co-authored-by: mouxin <mouxin@baidu.com >
2026-02-04 15:02:38 +08:00
506f1545cd
[Feature] Enhance Router with /v1/completions, docs, scripts, and version info ( #5966 )
...
* [Doc] Update prerequisites in the documentation
* [Feature] Enhance Router with /v1/completions, docs, scripts, and version info
* [Feature] Enhance Router with /v1/completions, docs, scripts, and version info
---------
Co-authored-by: mouxin <mouxin@baidu.com >
2026-01-30 10:28:48 +08:00
0a92e96f20
[Feature] Add Golang-based Router for Request Scheduling and Load Balancing ( #5882 )
...
* [Feature] add golang router
* [Feature] add golang router
* [Feature] add golang router
* [Feature] add golang router
* [Feature] add golang router
* [Feature] Add Golang-based Router for Request Scheduling and Load Balancing
* [Feature] Add Golang-based Router for Request Scheduling and Load Balancing
* [Feature] Add Golang-based Router for Request Scheduling and Load Balancing
* [Feature] Add Golang-based Router for Request Scheduling and Load Balancing
---------
Co-authored-by: mouxin <mouxin@baidu.com >
2026-01-07 21:28:08 +08:00
mouxin