lizexu123 b0cf2c4b7a [Feature] Support prefill batch inference for pooling models. (#5436) ...

* fix multi-inputs

* fix threshold

* fix threshold

* fix

* support multi-batch

* add tests

* fix test

* test

* fix

2025-12-09 16:21:00 +08:00

..

test_embedding.py

…

test_Ernie4_5_reward_serving.py

[Bug fix] fix pooling models (#5358)

2025-12-04 11:06:30 +08:00

test_Qwen3-Embedding_serving.py

[Feature] Support prefill batch inference for pooling models. (#5436)

2025-12-09 16:21:00 +08:00