【DataProcessor】add options thinking_mode (#4735)

* add thinking_mode

* add thinking_mode

* add thinking_mode

* add thinking_mode

* add thinking_mode

* add thinking_mode

* add unit test
This commit is contained in:
luukunn
2025-11-03 14:30:07 +08:00
committed by GitHub
parent 377f3bf5f2
commit 7b35488779
5 changed files with 215 additions and 6 deletions
@@ -147,6 +147,7 @@ class DataProcessor:
"user": "User: ",
"bot": "Assistant: ",
"assistant": "Assistant: ",
"tool": "Tool: ",
}
def _build_token_type_mapping(self) -> Dict[Any, int]: