apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2026-04-23 00:17:25 +08:00
Code Issues Actions 19 Packages Projects Releases Wiki Activity

[Optimization] Optimize ttft for prefill pd (#6680)

Browse Source 
* optimize ttft

* fix

* fix

* fix ci

* fix ci

* fix

* fix bug

* fix

* add comments

* fix ci

* fix

* fix ci

* fix format

* update according to review

* add comment

* fix

* fix format
This commit is contained in:
chenjian
2026-03-30 20:36:23 +08:00
committed by GitHub
parent 05f2d95729
commit 6727df8286
11 changed files with 134 additions and 135 deletions
Download Patch File Download Diff File Expand all files Collapse all files
tests/splitwise/test_internal_adapter_utils.py
+3
View File
@@ -25,6 +25,9 @@ class DummyEngine:
"""Dummy Engine class to simulate the actual Engine for testing."""
class ResourceManager:
def __init__(self):
self.waiting = []
def available_batch(self):
return 4