SunLei b4b579a7ed Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344) ...

* feat: add OpenAIServing

* feat: add ZmqOpenAIServing & OpenAIServingEmbedding

* feat: Refine the basic ServingEngine class and introduce ServingContext

* fix: codestyle

* fix: request

* fix: pooling_params

* feat: _process_chat_template_kwargs

* feat: support batch request

* feat: pooling_params verify & default parameters

---------

Co-authored-by: sunlei1024 <sunlei1024@example.com>

2025-10-15 19:42:59 +08:00

..

cli

[FastDeploy Cli] Bench Command eval and throughput (#4239)

2025-10-10 16:17:44 +08:00

openai

Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344)

2025-10-15 19:42:59 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

api_server.py

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

chat_utils.py

[Feature] add HTTP GET retry (#3838)

2025-09-08 10:11:14 +08:00

engine_client.py

Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344)

2025-10-15 19:42:59 +08:00

llm.py

Feature：Add support for Pooling Model Embedding and provide an OpenAI-compatible API. (#4344)

2025-10-15 19:42:59 +08:00