luukunn b9f8873367 [Optimization]Merge Text processor (#7030) ...

* merge text processor

* update

* fix unit test

* merge messages2ids

* fix unit test

* 删除重复代码

* remove redundant code

* delete code

* fix unit test

2026-03-30 15:02:35 +08:00

..

ernie4_5_vl_processor

[Optimization]Merge Text processor (#7030)

2026-03-30 15:02:35 +08:00

image_processors

[Optimization] Deduplicate shared image/video utilities across VL processors (#6988)

2026-03-26 09:49:33 +08:00

paddleocr_vl_processor

[Optimization] Deduplicate shared image/video utilities across VL processors (#6988)

2026-03-26 09:49:33 +08:00

qwen3_vl_processor

[Optimization] Deduplicate shared image/video utilities across VL processors (#6988)

2026-03-26 09:49:33 +08:00

qwen_vl_processor

[Optimization] Deduplicate shared image/video utilities across VL processors (#6988)

2026-03-26 09:49:33 +08:00

v1

[Bugfix] Align thinking_budget behavior with ERNIE reasoning flow (#6934)

2026-03-23 14:15:55 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

base_processor.py

[Optimization]Merge Text processor (#7030)

2026-03-30 15:02:35 +08:00

ernie4_5_processor.py

[Optimization]Merge Text processor (#7030)

2026-03-30 15:02:35 +08:00

ernie4_5_tokenizer.py

[Others]update paddleformer 1.0.0 (#6496)

2026-03-11 15:06:29 +08:00

mm_data_processor.py

[Feature] consider multimodal model when dummy run (#6045)

2026-02-09 17:49:55 +08:00

preprocess.py

[Optimization]Merge Text processor (#7030)

2026-03-30 15:02:35 +08:00

text_processor.py

[Optimization]Merge Text processor (#7030)

2026-03-30 15:02:35 +08:00

tokenzier_client.py

[BugFix][Optimization] Replace silent failures with catchable exceptions and informative error messages (#6533)

2026-03-16 21:32:43 +08:00

utils.py

[BugFix][DataProcessor] Add validate_model_path to fail fast on bad model path or unreachable network (#6713)

2026-03-08 12:36:32 +08:00

video_utils.py

[Optimization] Deduplicate shared image/video utilities across VL processors (#6988)

2026-03-26 09:49:33 +08:00