A few fixes in the documentation (#10033)

This commit is contained in:
Sylvain Gugger
2021-02-08 05:02:01 -05:00
committed by GitHub
parent 04fd783cc5
commit 45aaf5f7ab
6 changed files with 12 additions and 17 deletions

View File

@@ -2056,7 +2056,7 @@ class PreTrainedTokenizerBase(SpecialTokensMixin):
Whether or not to add the special tokens associated with the corresponding model.
kwargs (additional keyword arguments, `optional`):
Will be passed to the underlying model specific encode method. See details in
:meth:`~transformers.PreTrainedTokenizer.__call__`
:meth:`~transformers.PreTrainedTokenizerBase.__call__`
Returns:
:obj:`List[str]`: The list of tokens.