mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2026-04-23 00:17:25 +08:00
ophilia-lee
99258e19c8
* benchmark工具支持受限解码场景指定response_format * Update backend_request_func.py output.success判断兼容思考内容超长截断时回复内容为空的情况 * Update benchmark_serving.py 更新benchmark_metrics * 支持Completions接口 * 支持Completions接口 * 支持Completions接口 * [Benchmark]支持Completions接口 * [Benchmark]支持Completions接口 --------- Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
35 lines
2.1 KiB
Markdown
35 lines
2.1 KiB
Markdown
<!-- TemplateReference: https://github.com/PaddlePaddle/FastDeploy/blob/develop/.github/pull_request_template.md -->
|
|
|
|
<!-- Thank you for your contribution! Please follow these guidelines to enhance your pull request. If anything is unclear, submit your PR and reach out to maintainers for assistance. -->
|
|
|
|
## Motivation
|
|
|
|
<!-- Describe the purpose and goals of this pull request. -->
|
|
|
|
> :bulb: If this PR is a Cherry Pick, the PR title needs to follow the format by adding the [Cherry-Pick] label at the very beginning and appending the original PR ID at the end. For example, [Cherry-Pick][CI] Add check trigger and logic(#5191)
|
|
|
|
> :bulb: 如若此PR是Cherry Pick，PR标题需遵循格式，在最开始加上[Cherry-Pick]标签，以及最后面加上原PR ID，例如[Cherry-Pick][CI] Add check trigger and logic(#5191)
|
|
|
|
## Modifications
|
|
|
|
<!-- Detail the changes made in this pull request. -->
|
|
|
|
## Usage or Command
|
|
|
|
<!-- You should provide the usage if this pr is about the new function. -->
|
|
<!-- You should provide the command to run if this pr is about the performance optimization or fixing bug. -->
|
|
|
|
## Accuracy Tests
|
|
|
|
<!-- If this pull request affects model outputs (e.g., changes to the kernel or model forward code), provide accuracy test results. -->
|
|
|
|
## Checklist
|
|
|
|
- [ ] Add at least a tag in the PR title.
|
|
- Tag list: [`[FDConfig]`,`[APIServer]`,`[Engine]`, `[Scheduler]`, `[PD Disaggregation]`, `[Executor]`, `[Graph Optimization]`, `[Speculative Decoding]`, `[RL]`, `[Models]`, `[Quantization]`, `[Loader]`, `[OP]`, `[KVCache]`, `[DataProcessor]`, `[BugFix]`, `[Docs]`, `[CI]`, `[Optimization]`, `[Feature]`, `[Benchmark]`, `[Others]`, `[XPU]`, `[HPU]`, `[GCU]`, `[DCU]`, `[Iluvatar]`, `[Metax]`]
|
|
- You can add new tags based on the PR content, but the semantics must be clear.
|
|
- [ ] Format your code, run `pre-commit` before commit.
|
|
- [ ] Add unit tests. Please write the reason in this PR if no unit tests.
|
|
- [ ] Provide accuracy results.
|
|
- [ ] If the current PR is submitting to the `release` branch, make sure the PR has been submitted to the `develop` branch, then cherry-pick it to the `release` branch with the `[Cherry-Pick]` PR tag.
|