mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2026-04-23 00:17:25 +08:00
[Docs][CI] Fix prebuilt wheel installation and update Docs (#7289)
* [CI] Fix prebuilt wheel installation and update Docs * [CI] Update Dockerfile.gpu to restrict SM80/86/89/90, CUDA 12.6 and Python 3.10 * Update nvidia_gpu.md * Update nvidia_gpu.md * Revise NVIDIA GPU installation instructions Updated installation instructions for PaddlePaddle and FastDeploy to remove specific CUDA version mentions and clarify support for multiple GPU architectures. --------- Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>
This commit is contained in:
@@ -15,7 +15,10 @@ The following installation methods are available when your environment meets the
|
||||
**Notice**: The pre-built image supports SM 80/86/89/90 architecture GPUs (e.g. A800/H800/L20/L40/4090).
|
||||
|
||||
```shell
|
||||
# CUDA 12.6
|
||||
docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/fastdeploy-cuda-12.6:2.5.0
|
||||
# CUDA 12.9
|
||||
docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/fastdeploy-cuda-12.9:2.5.0
|
||||
```
|
||||
|
||||
## 2. Pre-built Pip Installation
|
||||
@@ -23,13 +26,13 @@ docker pull ccr-2vdh3abv-pub.cnc.bj.baidubce.com/paddlepaddle/fastdeploy-cuda-12
|
||||
First install paddlepaddle-gpu. For detailed instructions, refer to [PaddlePaddle Installation](https://www.paddlepaddle.org.cn/en/install/quick?docurl=/documentation/docs/en/develop/install/pip/linux-pip_en.html)
|
||||
```shell
|
||||
# Install stable release
|
||||
# CUDA 12.6
|
||||
# CUDA
|
||||
python -m pip install paddlepaddle-gpu==3.3.1 -i https://www.paddlepaddle.org.cn/packages/stable/cu126/
|
||||
# CUDA 12.9
|
||||
python -m pip install paddlepaddle-gpu==3.3.1 -i https://www.paddlepaddle.org.cn/packages/stable/cu129/
|
||||
|
||||
# Install latest Nightly build
|
||||
# CUDA 12.6
|
||||
# CUDA
|
||||
python -m pip install --pre paddlepaddle-gpu -i https://www.paddlepaddle.org.cn/packages/nightly/cu126/
|
||||
# CUDA 12.9
|
||||
python -m pip install --pre paddlepaddle-gpu -i https://www.paddlepaddle.org.cn/packages/nightly/cu129/
|
||||
@@ -40,13 +43,13 @@ Then install fastdeploy. **Do not install from PyPI**. Use the following methods
|
||||
**Note**: Stable FastDeploy release pairs with stable PaddlePaddle; Nightly Build FastDeploy pairs with Nightly Build PaddlePaddle. The `--extra-index-url` is only used for downloading fastdeploy-gpu's dependencies; fastdeploy-gpu itself must be installed from the Paddle source specified by `-i`.
|
||||
```
|
||||
# Install stable release FastDeploy
|
||||
# CUDA 12.6
|
||||
# CUDA
|
||||
python -m pip install fastdeploy-gpu==2.5.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu126/ --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
|
||||
# CUDA 12.9
|
||||
python -m pip install fastdeploy-gpu==2.5.0 -i https://www.paddlepaddle.org.cn/packages/stable/cu129/ --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
|
||||
|
||||
# Install Nightly Build FastDeploy
|
||||
# CUDA 12.6
|
||||
# CUDA
|
||||
python -m pip install fastdeploy-gpu -i https://www.paddlepaddle.org.cn/packages/nightly/cu126/ --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
|
||||
# CUDA 12.9
|
||||
python -m pip install fastdeploy-gpu -i https://www.paddlepaddle.org.cn/packages/nightly/cu129/ --extra-index-url https://mirrors.tuna.tsinghua.edu.cn/pypi/web/simple
|
||||
@@ -54,7 +57,7 @@ python -m pip install fastdeploy-gpu -i https://www.paddlepaddle.org.cn/packages
|
||||
|
||||
## 3. Build from Source Using Docker
|
||||
|
||||
- Note: ```dockerfiles/Dockerfile.gpu``` by default supports SM 80/90 architectures. To support other architectures, modify ```bash build.sh 1 python false [80,90]``` in the Dockerfile. It's recommended to specify no more than 2 architectures.
|
||||
> Note: `dockerfiles/Dockerfile.gpu` currently supports CUDA 12.6 only, targeting SM 80/86/89/90 architectures. To support other architectures, modify ```bash build.sh 1 python false [80,90]``` in the Dockerfile. It's recommended to specify no more than 2 architectures.
|
||||
|
||||
```shell
|
||||
git clone https://github.com/PaddlePaddle/FastDeploy
|
||||
@@ -84,7 +87,6 @@ The built packages will be in the ```FastDeploy/dist``` directory.
|
||||
## 5. Precompiled Operator Wheel Packages
|
||||
|
||||
FastDeploy provides precompiled GPU operator wheel packages for quick setup without building the entire source code.
|
||||
This method currently supports **SM80/90 architecture (e.g., A100/H100)** and **CUDA 12.6** environments only.
|
||||
|
||||
> By default, `build.sh` compiles all custom operators from source.To use the precompiled package, enable it with the `FD_USE_PRECOMPILED` parameter.
|
||||
> If the precompiled package cannot be downloaded or does not match the current environment, the system will automatically fall back to `4. Build Wheel from Source`.
|
||||
@@ -113,7 +115,7 @@ cd FastDeploy
|
||||
bash build.sh 1 python false [90] 1
|
||||
|
||||
# Use precompiled wheel from a specific commit
|
||||
bash build.sh 1 python false [90] 1 8a9e7b53af4a98583cab65e4b44e3265a93e56d2
|
||||
bash build.sh 1 python false [90] 1 d693d4be1448d414097882386fdc24c8bec2a63a
|
||||
```
|
||||
|
||||
The downloaded wheel packages will be stored in the `FastDeploy/pre_wheel` directory.
|
||||
@@ -122,9 +124,9 @@ After the build completes, the operator binaries can be found in `FastDeploy/fas
|
||||
> **Notes:**
|
||||
>
|
||||
> - This mode prioritizes downloading precompiled GPU operator wheels to reduce build time.
|
||||
> - Currently supports **GPU, SM80/90, CUDA 12.6** only.
|
||||
> - Supports **GPU, SM80/86/89/90.
|
||||
> - For custom architectures or modified operator logic, please use **source compilation (Section 4)**.
|
||||
> - You can check whether the precompiled wheel for a specific commit has been successfully built on the [FastDeploy CI Build Status Page](https://github.com/PaddlePaddle/FastDeploy/actions/workflows/ci_image_update.yml).
|
||||
> - You can check whether the precompiled wheel for a specific commit has been successfully built on the [FastDeploy CI Build Status Page](https://github.com/PaddlePaddle/FastDeploy/actions/workflows/ce_job.yml).
|
||||
|
||||
## Environment Verification
|
||||
|
||||
|
||||
Reference in New Issue
Block a user