SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Patrick von Platen
2021-08-08 17:11:19 +02:00
committed by GitHub
parent 7390d9de63
commit 24cbf6bc5a
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/research_projects/wav2vec2/README.md
View File

@@ -193,7 +193,7 @@ It is recommended to pre-train Wav2Vec2 with Trainer + Deepspeed (please refer t
Here is an example of how you can use DeepSpeed ZeRO-2 to pretrain a small Wav2Vec2 model: Here is an example of how you can use DeepSpeed ZeRO-2 to pretrain a small Wav2Vec2 model:
``` ```
PYTHONPATH=../../../src deepspeed --num_gpus 2 run_pretrain.py \ PYTHONPATH=../../../src deepspeed --num_gpus 4 run_pretrain.py \
--output_dir="./wav2vec2-base-libri-100h" \ --output_dir="./wav2vec2-base-libri-100h" \
--num_train_epochs="3" \ --num_train_epochs="3" \
--per_device_train_batch_size="32" \ --per_device_train_batch_size="32" \