ApplEOFDiscord 6563b8307c [Bug Fix] fix tokenizer oom (#6287) ...

* fix tokenizer oom

* fix unit test

2026-02-03 11:27:11 +08:00

..

ernie4_5_vl_processor

[Bug Fix] fix tokenizer oom (#6287)

2026-02-03 11:27:11 +08:00

paddleocr_vl_processor

[Models] Add Qwen3-VL Model Support (#5763)

2025-12-29 17:39:33 +08:00

qwen3_vl_processor

[Models] Add Qwen3-VL Moe Model Support (#5913)

2026-01-08 11:36:42 +08:00

qwen_vl_processor

[Models] Qwen3VL and Qwen3VL-Moe CUDA graph Support (#5962)

2026-01-09 17:09:02 +08:00

v1

[Optimization] The pre- and post-processing pipeline do not perform dict conversion (#5494)

2026-01-22 00:50:52 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

ernie4_5_processor.py

bug fix tool_calls (#6166)

2026-01-23 10:49:27 +08:00

ernie4_5_tokenizer.py

delete ernie4_5_vl_tokenizer (#3631)

2025-08-27 20:36:02 +08:00

mm_data_processor.py

[Models] Add Qwen3-VL Model Support (#5763)

2025-12-29 17:39:33 +08:00

preprocess.py

[Optimization] The pre- and post-processing pipeline do not perform dict conversion (#5494)

2026-01-22 00:50:52 +08:00

text_processor.py

bug fix tool_calls (#6166)

2026-01-23 10:49:27 +08:00

tokenzier_client.py

[BugFix] fix decode time sleep bug (#5461)

2025-12-10 15:48:48 +08:00

utils.py

[Feature] support stop_token_ids (#5399)

2025-12-09 17:49:12 +08:00