SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Adding performer fine-tuning research exampke (#9239)

Browse Source 
* added run_mlm_performer.py research example

* make styke

* make styke

* Added a README !
This commit is contained in:
Teven
2020-12-21 21:19:41 +01:00
committed by GitHub
parent 9a12b9696f
commit 4eef5889ac
6 changed files with 1925 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/research_projects/performer/full_script.sh Executable file
View File

@@ -0,0 +1 @@
TOKENIZERS_PARALLELISM=true python run_mlm_performer.py --output_dir experiments --dataset_name wikipedia --dataset_config_name 20200501.en --model_name_or_path bert-large-cased --tokenizer_name bert-large-cased --do_train --overwrite_output_dir --per_device_train_batch_size 4 --learning_rate 5e-4 --warmup_steps 100 --num_train_epochs 3 --performer