SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[doc] Fix broken links + remove crazy big notebook

Browse Source
This commit is contained in:
Julien Chaumond
2020-05-07 18:44:18 -04:00
parent 66113bd626
commit c99fe0386b
40 changed files with 52 additions and 52 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/language-modeling/README.md
View File

@@ -1,7 +1,7 @@
## Language model training
Based on the script [`run_language_modeling.py`](https://github.com/huggingface/transformers/blob/master/examples/run_language_modeling.py).
Based on the script [`run_language_modeling.py`](https://github.com/huggingface/transformers/blob/master/examples/language-modeling/run_language_modeling.py).
Fine-tuning (or training from scratch) the library models for language modeling on a text dataset for GPT, GPT-2, BERT and RoBERTa (DistilBERT
to be added soon). GPT and GPT-2 are fine-tuned using a causal language modeling (CLM) loss while BERT and RoBERTa