SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[doc prepare_seq2seq_batch] fix docs (#8013)

Browse Source
This commit is contained in:
Suraj Patil
2020-10-25 01:03:47 +05:30
committed by GitHub
parent 00602f7840
commit 38f6739cd6
2 changed files with 3 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/tokenization_bart.py
View File

@@ -122,7 +122,7 @@ class BartTokenizer(RobertaTokenizer):
- **attention_mask** -- List of indices specifying which tokens should be attended to by the model. - **attention_mask** -- List of indices specifying which tokens should be attended to by the model.
- **labels** -- List of token ids for tgt_texts - **labels** -- List of token ids for tgt_texts
The full set of keys ``[input_ids, attention_mask, decoder_input_ids, decoder_attention_mask]``, The full set of keys ``[input_ids, attention_mask, labels]``,
will only be returned if tgt_texts is passed. Otherwise, input_ids, attention_mask will be the only keys. will only be returned if tgt_texts is passed. Otherwise, input_ids, attention_mask will be the only keys.
""" """
kwargs.pop("src_lang", None) kwargs.pop("src_lang", None)

6
src/transformers/tokenization_utils_base.py
View File

@@ -1364,11 +1364,9 @@ PREPARE_SEQ2SEQ_BATCH_DOCSTRING = """
- **input_ids** -- List of token ids to be fed to the encoder. - **input_ids** -- List of token ids to be fed to the encoder.
- **attention_mask** -- List of indices specifying which tokens should be attended to by the model. - **attention_mask** -- List of indices specifying which tokens should be attended to by the model.
- **decoder_input_ids** -- List of token ids to be fed to the decoder. - **labels** -- List of token ids for tgt_texts.
- **decoder_attention_mask** -- List of indices specifying which tokens should be attended to by the decoder.
This does not include causal mask, which is built by the model.
The full set of keys ``[input_ids, attention_mask, decoder_input_ids, decoder_attention_mask]``, The full set of keys ``[input_ids, attention_mask, labels]``,
will only be returned if tgt_texts is passed. Otherwise, input_ids, attention_mask will be the only keys. will only be returned if tgt_texts is passed. Otherwise, input_ids, attention_mask will be the only keys.
""" """