4 Commits

Author	SHA1	Message	Date
Bingoo	6b891da02b	[Optimization] enable trtllm_all_reduce fusion kernel in glm model (#6660) ... * enable trtllm_all_reduce fusion kernel in glm model * fix conflict * format update * fix a bug * modify test * modify test * support empty tensor and modify test * fix test_linear config issues * modify test name * add edge test case * modify format * fix conflict * modify default max token num in trtllm_allreduce_fusion * add max token num branch for trtllm_allreduce_fusion * fix format * fix rmsnorm config issue * modify 2025 to 2026 * using compat grard * Lazily import flashinfer.comm and fix test config issue * fix test issues * add flashinfer cache dir clean machine * fix some issues	2026-04-16 14:10:19 +08:00
bukejiyu	14d46181b8	[Loader] add multi-thread model loading (#6877) ... * multi-thread-loader * fix ut	2026-04-09 23:40:15 -07:00
cloudforge1	cefc724607	[CI]【Hackathon 10th Spring No.29】engine unit test (#6771) ... * [CI]【Hackathon 10th Spring No.29】engine unit test Merge with upstream test_engine.py (PR #7083) and add comprehensive coverage for LLMEngine: lifecycle, worker signals, requests, utils, stop_profile, and start error handling. * fix: add deploy_modality to _make_cfg() — Copilot review --------- Co-authored-by: cloudforge1 <cloudforge1@users.noreply.github.com> Co-authored-by: CSWYF3634076 <wangyafeng@baidu.com>	2026-04-09 13:45:59 +08:00
zhouchong	91c832f607	[Feature] Add logging parameters and error output to terminal (#7098)	2026-04-01 13:18:42 +08:00