mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2026-04-23 00:17:25 +08:00
[Optimization] The pre- and post-processing pipeline do not perform dict conversion (#5494)
* to_request_for_infer initial commit * refact to from_chat_completion_request * preprocess use request initial commit * bugfix * processors refact to using request * bug fix * refact Request from_generic_request * post process initial commit * bugfix * postprocess second commit * bugfix * serving_embedding initial commit * serving_reward initial commit * bugfix * replace function name * async_llm initial commit * offline initial commit and fix bug * bugfix * fix async_llm * remove add speculate_metrics into data * fix logprobs bug * fix echo bug * fix bug * fix reasoning_max_tokens * bugfix * bugfix and modify unittest * bugfix and modify unit test * bugfix * bugfix * bugfix * modify unittest * fix error when reasong_content is none for text_processor * remove some unnessary logic * revert removed logic * implement add and set method for RequestOutput and refact code * modify unit test * modify unit test * union process_request and process_request_obj * remove a unit test * union process_response and process_response_obj * support qwen3_vl_processor * modify unittest and remove comments * fix prompt_logprobs * fix codestyle * add v1 * v1 * fix unit test * fix unit test * fix pre-commit * fix * add process request * add process request * fix * fix * fix unit test * fix unit test * fix unit test * fix unit test * fix unit test * remove file * add unit test * add unit test * add unit test * fix unit test * fix unit test * fix * fix --------- Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com> Co-authored-by: luukunn <981429396@qq.com> Co-authored-by: luukunn <83932082+luukunn@users.noreply.github.com> Co-authored-by: Zhang Yulong <35552275+ZhangYulongg@users.noreply.github.com>
This commit is contained in:
@@ -47,7 +47,12 @@ from paddleformers.utils.log import logger as pf_logger
|
||||
|
||||
from fastdeploy.engine.sampling_params import SamplingParams
|
||||
from fastdeploy.entrypoints.llm import LLM
|
||||
from fastdeploy.utils import console_logger, current_package_version, envs, get_version_info
|
||||
from fastdeploy.utils import (
|
||||
console_logger,
|
||||
current_package_version,
|
||||
envs,
|
||||
get_version_info,
|
||||
)
|
||||
|
||||
paddle.compat.enable_torch_proxy(scope={"triton"})
|
||||
# paddle.compat.enable_torch_proxy(scope={"triton"}) enables the torch proxy
|
||||
@@ -81,7 +86,7 @@ try:
|
||||
if version_info is not None and "paddle_commit" in version_info:
|
||||
build_paddle_commit = version_info["paddle_commit"]
|
||||
runtime_paddle_commit = paddle.version.commit
|
||||
|
||||
|
||||
if build_paddle_commit != runtime_paddle_commit:
|
||||
console_logger.warning(
|
||||
f"The Paddle version in the current runtime environment is inconsistent with the Paddle code version "
|
||||
|
||||
Reference in New Issue
Block a user