 Yonghua Li
|
7c8c0a3c02
|
[BugFix] replace ftok with custom_ftok in get_output/save_output ops (#6822)
* [BugFix] replace ftok with custom_ftok in get_output/save_output ops
* [Test] add unit test for custom_ftok
* [Chore] create custom_ftok.h
* [Chore] reorganize header file
* [Fix] fix cache messager msg_queue_id+rank_id conflict
|
2026-03-16 14:22:18 +08:00 |
|
|
gongweibao
|
ddb06ff83f
|
init (#6642)
Co-authored-by: gongweibao <gognweibao@baidu.com>
|
2026-03-04 21:55:31 +08:00 |
|
|
chen
|
66a98b44ed
|
ep support logprob (#4089) (#4151)
|
2025-09-19 14:07:31 +08:00 |
|
|
chen
|
d33105baeb
|
[Feature] Online Chat API Support Return logprobs (#2777)
* online chat support logprobs
* check xpu
* check vl_gpu_model_runner and xpu_model_runner
* get_worker() check platform
|
2025-07-10 16:33:40 +08:00 |
|
|
jiangjiajun
|
684703fd72
|
[LLM] First commit the llm deployment code
|
2025-06-09 19:20:15 +08:00 |
|