apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity

[Feature] support async download features (#5003)
CE Compile Job / ce_job_pre_check (push) Has been cancelled
Details
CE Compile Job / print_ce_job_pre_check_outputs (push) Has been cancelled
Details
CE Compile Job / FD-Clone-Linux (push) Has been cancelled
Details
CE Compile Job / Show Code Archive Output (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8090 (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8689 (push) Has been cancelled
Details
CE Compile Job / CE_UPLOAD (push) Has been cancelled
Details
Deploy GitHub Pages / deploy (push) Has been cancelled
Details

Browse Source 
* support async download features

* add test case

* update code
This commit is contained in:
kevin
2025-11-19 22:23:36 +08:00
committed by GitHub
parent bde97e09f7
commit 109d48e456
10 changed files with 433 additions and 75 deletions
Download Patch File Download Diff File Expand all files Collapse all files
fastdeploy/engine/args_utils.py
+11
View File
@@ -467,6 +467,11 @@ class EngineArgs:
Url for router server, such as `0.0.0.0:30000`.
"""
enable_async_download_features: bool = False
"""
Flag to enable async download features. Default is False (disabled).
"""
def __post_init__(self):
"""
Post-initialization processing to set default tokenizer if not provided.
@@ -849,6 +854,12 @@ class EngineArgs:
default=EngineArgs.enable_expert_parallel,
help="Enable expert parallelism.",
)
parallel_group.add_argument(
"--enable-async-download-features",
action="store_true",
default=EngineArgs.enable_async_download_features,
help="Enable async download features.",
)
# Load group
load_group = parser.add_argument_group("Load Configuration")