mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2026-04-23 00:17:25 +08:00
jc
04fde3b227
* Prefill and decode support cache storage * up * up * update docs and refine mooncake store * up
794 B
794 B
Global Cache Pooling Examples
This directory contains example scripts for Global Cache Pooling with MooncakeStore.
Documentation
Quick Start
# Multi-instance scenario
bash run.sh
# PD disaggregation scenario
bash run_03b_pd_storage.sh
Scripts
| Script | Scenario | Description |
|---|---|---|
run.sh |
Multi-Instance | Two standalone instances sharing cache |
run_03b_pd_storage.sh |
PD Disaggregation | P+D instances with global cache pooling |
Files
mooncake_config.json- Mooncake configuration fileutils.sh- Utility functions for scriptsstop.sh- Stop all running services