4257 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
freeliuzc	2dc2ba49b5	[Speculative Decoding] Fix multistep MTP in splitewise-prefill mode (#5723)	2025-12-24 02:45:54 -08:00
YuBaoku	e75f93d302	[CI] Refactor RL tests to reuse test_metrics (#5741)	2025-12-24 17:08:40 +08:00
chen	c7ab32d154	check (#5736)	2025-12-24 16:49:20 +08:00
Divano	6b0fba8294	Update run.sh	2025-12-24 15:35:17 +08:00
Nyakku Shigure	11227e00bb	[GraphOptimization] Wrap deep gemm and triton as python op (#5673) ... * [GraphOptimization] Wrap deep gemm and triton as python op * add unitest to _base_test && compatibility * paddle.static.MetaTensor -> "paddle.static.MetaTensor" * mv register_custom_python_op * rename yaml --------- Co-authored-by: DrRyanHuang <zihaohuang@aliyun.com>	2025-12-24 15:23:46 +08:00
bukejiyu	ba4b7afb3a	[Others] Rename tensor_parallel_degree to tensor_model_parallel_size for paddleformers 0.4.1 (#5727)	2025-12-23 23:19:11 -08:00
GoldPancake	a0fed22ddb	[Feature] Add entropy calculation script	2025-12-24 15:00:06 +08:00
xunyoyo	8acdd9f156	[CI] 【Hackathon 9th Sprint No.41】NO.41 功能模块单测补充 -new ... Add splitwise connector tests Co-authored-by: CSWYF3634076 <wangyafeng@baidu.com> Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-12-24 14:05:32 +08:00
YuBaoku	672620cdfe	Revert "[CI] Adapt vl_model baseline changes due to Paddle update (#5576)" (#5732) ... This reverts commit 63fff8df70.	2025-12-24 11:59:27 +08:00
周周周	922a73ddd6	[Others] clean code (#5691)	2025-12-24 11:28:47 +08:00
GoldPancake	23d488c488	[Feature] Entropy calculation support (#5692) ... * support entropy * fix bug --------- Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-12-23 21:19:47 +08:00
bukejiyu	d1c6e57341	[Others] upgrade paddleformer to 0.4.0 (#5599)	2025-12-23 05:08:01 -08:00
ming1753	85db9d5e56	[Others] reschedule preempt task support optional func (#5649) ... * [Others] reschedule preempt task support optional func * fix bug * fix bug	2025-12-23 20:45:52 +08:00
Copilot	5cec66adb8	[Docs] 更新环境变量文档以同步最新代码 (#5713) ... * Initial plan * 更新环境变量文档以匹配最新代码 Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-12-23 19:49:20 +08:00
ophilia-lee	99258e19c8	[Benchmark]支持Completions接口 (#5700) ... * benchmark工具支持受限解码场景指定response_format * Update backend_request_func.py output.success判断兼容思考内容超长截断时回复内容为空的情况 * Update benchmark_serving.py 更新benchmark_metrics * 支持Completions接口 * 支持Completions接口 * 支持Completions接口 * [Benchmark]支持Completions接口 * [Benchmark]支持Completions接口 --------- Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>	2025-12-23 19:46:23 +08:00
ming1753	04c30521dd	[Others] plugin raise error msg (#5675)	2025-12-23 18:56:54 +08:00
kesmeey	f15edbb6ef	[CI]【Hackathon 9th Sprint No.40】功能模块 fastdeploy/entrypoints/openai/api_server.py 单测补充 (#5567) ... * Add tests for openai api_server coverage * update * Update tests for openai api_server * fix bugs * test: disable some api_server lifespan/controller tests for local env * Format test_api_server with black * update * update * test: narrow envs patch in api_server tests to avoid side effects * fix: separate MagicMock creation to avoid missing req argument * fix: patch TRACES_ENABLE env var in api_server tests * fix: use os.environ patch for TRACES_ENABLE * test: use fake fastdeploy.envs in api_server tests * test: pass fake Request into chat/completion routes * test: increase coverage for tracing and scheduler control * fix: set dynamic_load_weight in tracing headers test * ci: add retry and validation for FastDeploy.tar.gz download * ci: fix indentation in _base_test.yml * refactor: simplify test_api_server.py (807->480 lines, ~40% reduction) * fix: restore missing args attributes (revision, etc.) in _build_args * fix: patch sys.argv to prevent SystemExit: 2 in api_server tests * improve coverage * Remove docstring from test_api_server.py Removed unnecessary docstring from test_api_server.py --------- Co-authored-by: CSWYF3634076 <wangyafeng@baidu.com>	2025-12-23 18:06:43 +08:00
Copilot	e9f5397bc9	[Docs] Update parameters documentation with latest code defaults and new parameters (#5709) ... * Initial plan * Update parameters documentation with correct default values and new parameters Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-12-23 17:31:44 +08:00
Divano	c1aa66df02	Revert "[Optim] Remove limitation of number of kvcache blocks (#5612)" (#5702) ... This reverts commit 9da89a374b.	2025-12-23 15:41:33 +08:00
Jiaxin Sui	0bef9b684f	[Metax][CI]fix CI bug (#5698) ... * Update run_ci_metax.sh * Fix pull request branch reference in CI workflow	2025-12-23 14:56:34 +08:00
RuohengMa	2c3c983b96	[XPU] modify speculate_verify (#5522)	2025-12-23 14:50:30 +08:00
MingkunZhang	945a1bc4e2	[Metax] update ci name (#5679) ... * [Metax] update ci name * Update CI_METAX workflow for pull request handling * Update ci_metax.yml * Update CI_METAX workflow for pull request handling * Remove commented-out code in run_ci_metax.sh * Add environment to Jenkins trigger job * Change trigger event from pull_request_target to pull_request * Fix environment name casing in CI workflow * Change environment name from Metax-ci to Metax_ci * Modify CI_METAX workflow for PR targeting and concurrency Updated workflow to use pull_request_target event and added concurrency settings. --------- Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>	2025-12-23 14:00:48 +08:00
bukejiyu	6c36a17369	[Others]Prevent core dumps during Paddle version check (#5657)	2025-12-22 21:57:45 -08:00
Jiang-Jia-Jun	9da89a374b	[Optim] Remove limitation of number of kvcache blocks (#5612) ... * [Optim] Remove limitation of number of kvcache blocks * Update fastdeploy/envs.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update fastdeploy/worker/iluvatar_worker.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Add docs * Update fastdeploy/worker/worker_process.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix ci case --------- Co-authored-by: Jiang-Jia-Jun <jiangjiajun@baidu.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>	2025-12-23 11:18:29 +08:00
ddchenhao66	4a74f5ab9b	[XPU]Set top_p=0.0 by default on XPU to optimize performance (#5686) ... Co-authored-by: ddchenhao66 <dhaochen163.com>	2025-12-23 11:01:01 +08:00
xunyoyo	3aee5c4bf5	[CI] 【Hackathon 9th Sprint No.37】NO.37 功能模块单测补充 (#5059) ... * Add unit tests for TokenProcessor functionality * Add trace stubs for token processor tests * Increase token processor test coverage * Clean up imports in test_token_processor.py Remove unnecessary path manipulation in test file. * Cleanup: Remove unused imports in test_token_processor Removed unused imports from the test file. * Add trace_carrier to task in test cases Added trace_carrier attribute to task in multiple test cases to ensure proper handling of trace information. * Refine token processor tests for safe coverage * Expand postprocess coverage * Add ZMQ logprob parsing test --------- Co-authored-by: CSWYF3634076 <wangyafeng@baidu.com> Co-authored-by: Tao Luo <luotao02@baidu.com>	2025-12-23 10:35:16 +08:00
Jiaxin Sui	f16077a939	[XPU][CI] Xpu ci update (#5690) ... * Enhance run_ci_xpu.sh with caching and prefill options * Update model path and configuration in run_ci_xpu.sh * Add '北朝' keyword to assertion in run_45vl.py * Enhance process termination logic in run_ci_xpu.sh * Set timeout for CI_XPU job to 60 minutes * Remove extra newline in stop_processes function * Update paddlepaddle-xpu installation command Comment out the previous paddlepaddle-xpu installation command and replace it with a specific version installation due to EP parallel error. * Update PaddlePaddle installation command * Remove max_tokens from model response configuration Removed max_tokens parameter from the model response call.	2025-12-23 10:19:39 +08:00
xiaolei373	dfe8ea941c	[log]console log to llm log (#5680)	2025-12-23 10:05:45 +08:00
RAM	131defa122	Revert "Revert "[Feature] Use paddle.compat.enable_torch_proxy in `fastdepl…" (#5606) ... This reverts commit 021399f7c9.	2025-12-22 22:37:51 +08:00
ddchenhao66	a1535c7e7e	[XPU][CI] xpu add ci test for pd + TP2 (#5653) ... Co-authored-by: ddchenhao66 <dhaochen163.com>	2025-12-22 19:27:10 +08:00
Yuanle Liu	8beb0158fa	[BugFix] fix rl signal (#5681)	2025-12-22 00:35:54 -08:00
MingkunZhang	6ed9136a4e	[Metax] update ci yaml (#5674)	2025-12-22 16:00:25 +08:00
YuBaoku	b57deb671d	[CI] Update check_approval.sh	2025-12-22 15:52:04 +08:00
Sunny-bot1	04035e4ebf	support w4afp8 two stage (#5608)	2025-12-22 15:13:05 +08:00
Sunny-bot1	40f3897a4e	support w4afp8 moe offline permute & load (#5613)	2025-12-22 15:12:57 +08:00
ming1753	81384ef29e	[BugFix] fix download feature bug (#5669)	2025-12-22 13:46:39 +08:00
lizexu123	6d323769dd	fix w4afp8 (#5634)	2025-12-22 13:39:41 +08:00
freeliuzc	6eada4929d	[Speculative Decoding]Support multi-step mtp with cudagraph (#5624) ... * support multi-step mtp with cudagraph * fix usage * fix unit test	2025-12-22 11:34:04 +08:00
Yonghua Li	4f830aa505	[RL] provide options for whether shutdown comm group after weights cleared (#5663) ... * [rl] provide options for whether shutdown comm group after weights cleared * [fix] fix args hardcode * [fix] change args type * [fix] add worker process args	2025-12-19 07:06:48 -08:00
YuBaoku	fe55baae47	[CI] Fix unit_test error of unstable execution (#5660) ... * [CI] Fix unit_test error of unstable execution	2025-12-19 22:59:53 +08:00
chen	a32cb54d0b	[BugFix] Fix custom_all_reduce overflow (#5662) ... * check * check * code style	2025-12-19 18:24:21 +08:00
MingkunZhang	46d83be065	[Metax] update ci test (#5652)	2025-12-19 17:25:47 +08:00
xunyoyo	669dfe8dca	[CI] 【Hackathon 9th Sprint No.38】NO.38 功能模块单测补充 (#5060) ... * Add tests for global scheduler functionality This file contains tests for the global scheduler, including request handling, load accounting, and response management. * Enhance global scheduler unit tests * Clean up comments in test_global_scheduler.py Removed unnecessary comments and coverage instructions. * Update tests/scheduler/test_global_scheduler.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update tests/scheduler/test_global_scheduler.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update tests/scheduler/test_global_scheduler.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update tests/scheduler/test_global_scheduler.py Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Translate comments and docstrings to Chinese Updated comments and docstrings in Chinese to enhance clarity for native speakers. * Use monkeypatch for FD_ENABLE_MAX_PREFILL in tests Replaced direct assignment with monkeypatching for FD_ENABLE_MAX_PREFILL in test cases. * Correct test function definitions in test_global_scheduler Fix function definitions and update test cases for scheduler. * Fix typos in global scheduler tests * Translate comments to English in test_global_scheduler.py Updated comments and docstrings in test_global_scheduler.py from Chinese to English for better clarity and consistency. --------- Co-authored-by: CSWYF3634076 <wangyafeng@baidu.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>	2025-12-19 16:28:16 +08:00
kevin	807e404369	[BugFix] fix eb5 mm prefix cache bug (#5638) ... * fix eb5 mm prefix cache bug * update code --------- Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>	2025-12-19 14:57:37 +08:00
RichardWooSJTU	6bd772b93f	fix eplb weight updating (#5529) ... Co-authored-by: Jiang-Jia-Jun <163579578+Jiang-Jia-Jun@users.noreply.github.com>	2025-12-19 14:30:32 +08:00
Yuanle Liu	689f54f671	[RL] Update worker_process.py (#5651)	2025-12-18 20:07:58 -08:00
fmiao2372	a8fce47195	[Intel HPU] enable kv cache scheduler v1 for hpu (#5648) ... * [Intel HPU] enable kv cache scheduler v1 for hpu * fix copilt comments	2025-12-19 12:03:39 +08:00
bukejiyu	fc452c8e29	[RL]Fix RL load_weights (#5642) ... Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>	2025-12-18 19:16:18 -08:00
lizan1999	ec6811f648	support token num = 0 (#5635) ... Co-authored-by: lizan1999 <lizan03@baidu.com> Co-authored-by: cmcamdy <1027740945@qq.com> Co-authored-by: Jiaxin Sui <95567040+plusNew001@users.noreply.github.com>	2025-12-19 10:20:38 +08:00
xunyoyo	d657455616	[CI] 【Hackathon 9th Sprint No.19】NO.19 功能模块单测补充 (#5063) ... * Add pooler unit tests * Refine pooler tests import handling * Refactor pooler tests to use real modules * Clean up test_pooler.py by removing docstring Removed unnecessary docstring and cleaned up code. * Clean up imports in test_pooler.py Removed unnecessary import of sys and related path adjustments. * Update model config and clean up test code * Update test_pooler.py --------- Co-authored-by: CSWYF3634076 <wangyafeng@baidu.com>	2025-12-18 21:32:44 +08:00