SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Fixed typo (#18921)

Browse Source 
Fixed typo itmes --> items
This commit is contained in:
Tobias Nusser
2022-09-12 21:03:48 +02:00
committed by GitHub
parent 1182b945a6
commit 4c2e983f44
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/en/preprocessing.mdx
View File

@@ -54,7 +54,7 @@ Then pass your sentence to the tokenizer:
'attention_mask': [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]} 'attention_mask': [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]}
``` ```
The tokenizer returns a dictionary with three important itmes: The tokenizer returns a dictionary with three important items:
* [input_ids](glossary#input-ids) are the indices corresponding to each token in the sentence. * [input_ids](glossary#input-ids) are the indices corresponding to each token in the sentence.
* [attention_mask](glossary#attention-mask) indicates whether a token should be attended to or not. * [attention_mask](glossary#attention-mask) indicates whether a token should be attended to or not.