Sunny-bot1 e45050cae3 [Feature] support top_k_top_p sampling (#2753) ...

* support top_k_top_p sampling

* fix

* add api param

* add api para

* fix

* fix

* fix

* fix

* fix

* fix

* fix

2025-07-09 20:58:58 -07:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

dcu_worker.py

dcu adapter ernie45t (#2756)

2025-07-09 18:56:27 +08:00

eplb.py

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

experts_manager.py

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

forward_meta.py

Clear dead code And supplementary notes (#2757)

2025-07-09 16:17:34 +08:00

gcu_model_runner.py

[Feature] support top_k_top_p sampling (#2753)

2025-07-09 20:58:58 -07:00

gcu_worker.py

[GCU] Support gcu platform (#2702)

2025-07-08 13:00:52 +08:00

gpu_model_runner.py

[Feature] support top_k_top_p sampling (#2753)

2025-07-09 20:58:58 -07:00

gpu_worker.py

Clear dead code And supplementary notes (#2757)

2025-07-09 16:17:34 +08:00

iluvatar_model_runner.py

[Feature] support top_k_top_p sampling (#2753)

2025-07-09 20:58:58 -07:00

iluvatar_worker.py

Adapt for iluvatar gpu (#2684)

2025-07-07 16:53:14 +08:00

model_runner_base.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

output.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

utils.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

vl_gpu_model_runner.py

[SOT] Remove breakgraph in post processing && fix datatype (#2780)

2025-07-10 11:26:00 +08:00

vl_model_runner_base.py

[Feature] support top_k_top_p sampling (#2753)

2025-07-09 20:58:58 -07:00

vl_worker_process.py

[LLM] support multi node deploy (#2708)

2025-07-06 10:33:51 +08:00

worker_base.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

worker_process.py

[BugFix] Fix vocab size error for ernie model (#2785)

2025-07-10 01:05:51 +08:00

xpu_model_runner.py

[Feature] support top_k_top_p sampling (#2753)

2025-07-09 20:58:58 -07:00

xpu_worker.py

fix xpu offline demo garbled output (#2763)

2025-07-09 14:51:20 +08:00