SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[doctest] Fixes (#35863)

Browse Source 
doctest fixes
This commit is contained in:
Steven Liu
2025-01-26 15:26:38 -08:00
committed by GitHub
parent fc269f77da
commit f11f57c925
15 changed files with 76 additions and 76 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/en/chat_templating.md
View File

@@ -39,7 +39,7 @@ Let's make this concrete with a quick example using the `mistralai/Mistral-7B-In
... ]
>>> tokenizer.apply_chat_template(chat, tokenize=False)
"<s>[INST] Hello, how are you? [/INST]I'm doing great. How can I help you today?</s> [INST] I'd like to show off how chat templating works! [/INST]"
"<s> [INST] Hello, how are you? [/INST] I'm doing great. How can I help you today?</s> [INST] I'd like to show off how chat templating works! [/INST]"
```
Notice how the tokenizer has added the control tokens [INST] and [/INST] to indicate the start and end of