apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity
4,818 Commits 41 Branches 17 Tags
a6351dea0b30fee8e9c4e663b14e445c29020eb4
Commit Graph

4 Commits

Author SHA1 Message Date
zhouchong 5d9b5e4a5b [Engine] [Feature] Refactor async_llm:cross-process with EngineService，based on zmq communication (#4868) 
* Refactor async_llm:cross-process with EngineService

* fix: async_llm output process

* fix: return prompt_token_ids and prompt_tokens in first res

* optimize common_engine start func
 2025-12-09 10:53:40 +08:00
zhouchong 35286ce31a fix total_block_num init error in worker_process (#4687) 2025-10-30 19:53:09 +08:00
zhouchong 567f61072c [CI][BugFix] fix port conflicts in concurrent ci test and add more unit test on async_llm (#4616) 
* fix:port conflicts in concurrent ci test

* add more unit test on async_llm
 2025-10-28 19:04:24 +08:00
zhouchong dce988824d [Feature] Support AsyncLLM (#4458)
CE Compile Job / ce_job_pre_check (push) Has been cancelled
Details
CE Compile Job / print_ce_job_pre_check_outputs (push) Has been cancelled
Details
CE Compile Job / FD-Clone-Linux (push) Has been cancelled
Details
CE Compile Job / Show Code Archive Output (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8090 (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8689 (push) Has been cancelled
Details
CE Compile Job / CE_UPLOAD (push) Has been cancelled
Details
Deploy GitHub Pages / deploy (push) Has been cancelled
Details 
* add async_llm

* apply review

* update engine config

* Adapt to latest engine.py changes

* add more unit tests

* Increase unit test coverage

---------

Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>
 2025-10-22 15:50:12 +08:00