SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Update modeling.py

Browse Source
This commit is contained in:
wlhgtc
2018-12-22 20:26:05 +08:00
committed by GitHub
parent 8da280ebbe
commit e626eecc25
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
pytorch_pretrained_bert/modeling.py
View File

@@ -728,7 +728,7 @@ class BertForMaskedLM(PreTrainedBertModel):
is only computed for the labels set in [0, ..., vocab_size] is only computed for the labels set in [0, ..., vocab_size]
Outputs: Outputs:
if `masked_lm_labels` is `None`: if `masked_lm_labels` is not `None`:
Outputs the masked language modeling loss. Outputs the masked language modeling loss.
if `masked_lm_labels` is `None`: if `masked_lm_labels` is `None`:
Outputs the masked language modeling logits of shape [batch_size, sequence_length, vocab_size]. Outputs the masked language modeling logits of shape [batch_size, sequence_length, vocab_size].