apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity
Files
48cfb608aa96e78b717876398c5deb3eeacb41b2
FastDeploy/benchmarks/yaml/qwen3dot6b-32k-bf16-a800-tp1.yaml
T
Jiang-Jia-Jun 92c2cfa2e7 Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00

6 lines
112 B
YAML
Raw Blame History

max_model_len: 32768
max_num_seqs: 256
gpu_memory_utilization: 0.9
kv_cache_ratio: 0.75
tensor_parallel_size: 1
Reference in New Issue View Git Blame Copy Permalink