SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Update README.md (#8050)

Browse Source 
--wwm cant be used as an argument given run_language_modeling.py and should be changed to --whole_word_mask
This commit is contained in:
mohammadreza-Banaei73
2020-10-26 17:00:18 +01:00
committed by GitHub
parent fbcddb8544
commit 098ddc2244
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
examples/language-modeling/README.md
View File

@@ -60,7 +60,7 @@ python run_language_modeling.py \
--do_eval \ --do_eval \
--eval_data_file=$TEST_FILE \ --eval_data_file=$TEST_FILE \
--mlm \ --mlm \
--wwm --whole_word_mask
``` ```
For Chinese models, it's same with English model with only --mlm`. If using whole-word masking, we need to generate a reference files, case it's char level. For Chinese models, it's same with English model with only --mlm`. If using whole-word masking, we need to generate a reference files, case it's char level.
@@ -107,7 +107,7 @@ python run_language_modeling.py \
--eval_data_file=$TEST_FILE \ --eval_data_file=$TEST_FILE \
--mlm \ --mlm \
--line_by_line \ --line_by_line \
--wwm --whole_word_mask
``` ```
### XLNet and permutation language modeling ### XLNet and permutation language modeling