Update README.md (#8635)
This commit is contained in:
@@ -90,7 +90,7 @@ selected tokens (which may be part of words), they mask randomly selected words
|
|||||||
to that word). This technique has been refined for Chinese in [this paper](https://arxiv.org/abs/1906.08101).
|
to that word). This technique has been refined for Chinese in [this paper](https://arxiv.org/abs/1906.08101).
|
||||||
|
|
||||||
To fine-tune a model using whole word masking, use the following script:
|
To fine-tune a model using whole word masking, use the following script:
|
||||||
|
```bash
|
||||||
python run_mlm_wwm.py \
|
python run_mlm_wwm.py \
|
||||||
--model_name_or_path roberta-base \
|
--model_name_or_path roberta-base \
|
||||||
--dataset_name wikitext \
|
--dataset_name wikitext \
|
||||||
|
|||||||
Reference in New Issue
Block a user