apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity

feat: add post-processing step for pool_output (#4462)

Browse Source 
* feat: add post-processing step for pool_output

* bugfix

* fix: test_serving_embedding

* fix test_request_to_batch_dicts

* fix: code style
This commit is contained in:
SunLei
2025-10-21 20:24:26 +08:00
committed by GitHub
parent 2bd3fb6315
commit 809c1ac7ec
7 changed files with 113 additions and 49 deletions
Download Patch File Download Diff File Expand all files Collapse all files
fastdeploy/entrypoints/openai/utils.py
+1 -1
View File
@@ -123,7 +123,7 @@ class DealerConnectionManager:
raw_data = await dealer.read()
response = msgpack.unpackb(raw_data[-1])
request_id = response[-1]["request_id"]
if "cmpl" == request_id[:4]:
if request_id[:4] in ["cmpl", "embd"]:
request_id = request_id.rsplit("_", 1)[0]
elif "chatcmpl" == request_id[:8]:
request_id = request_id.rsplit("_", 1)[0]