From 24cbf6bc5a0b6a9bb5afdda6bb1a329ac980fa4b Mon Sep 17 00:00:00 2001 From: Patrick von Platen Date: Sun, 8 Aug 2021 17:11:19 +0200 Subject: [PATCH] Update README.md --- examples/research_projects/wav2vec2/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/examples/research_projects/wav2vec2/README.md b/examples/research_projects/wav2vec2/README.md index 238ee6f629..ba3b344089 100644 --- a/examples/research_projects/wav2vec2/README.md +++ b/examples/research_projects/wav2vec2/README.md @@ -193,7 +193,7 @@ It is recommended to pre-train Wav2Vec2 with Trainer + Deepspeed (please refer t Here is an example of how you can use DeepSpeed ZeRO-2 to pretrain a small Wav2Vec2 model: ``` -PYTHONPATH=../../../src deepspeed --num_gpus 2 run_pretrain.py \ +PYTHONPATH=../../../src deepspeed --num_gpus 4 run_pretrain.py \ --output_dir="./wav2vec2-base-libri-100h" \ --num_train_epochs="3" \ --per_device_train_batch_size="32" \