4 Commits

Author	SHA1	Message	Date
RichardWooSJTU	e39159f3bd	Add switch to apply fine-grained per token quant fp8 (#3192) ... Co-authored-by: yuanxiaolan <yuanxiaolan01@baidu.com>	2025-08-04 19:54:03 -07:00
Jiang-Jia-Jun	05c670e593	[Sync] Update to latest code (#2679) ... * [Sync] Update to latest code * Add new code files * Add new code files * update code * Try to fix build.sh * Try to fix build.sh * Update code * Update requirements.txt * Update code --------- Co-authored-by: Jiang-Jia-Jun <jiangjiajun@baidu.com>	2025-07-03 15:43:53 +08:00
MARD1NO	ac5f860536	use shfl_xor_sync to reduce redundant shfl broadcast	2025-06-30 13:12:21 +08:00
jiangjiajun	684703fd72	[LLM] First commit the llm deployment code	2025-06-09 19:20:15 +08:00