SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Variable Correction for Consistency in Distillation Example (#11444)

Browse Source 
As the error comes from the inconsistency of variable meaning number of gpus in parser and its actual usage in the train.py script, 'gpus' and 'n_gpu' respectively,  the correction makes the example work
This commit is contained in:
Jaimeen Ahn
2021-04-27 02:30:48 +09:00
committed by GitHub
parent 1d30ec95c7
commit 0661abc545
2 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/research_projects/distillation/README.md
View File

@@ -163,7 +163,7 @@ python -m torch.distributed.launch \
--master_port $MASTER_PORT \ --master_port $MASTER_PORT \
train.py \ train.py \
--force \ --force \
--gpus $WORLD_SIZE \ --n_gpu $WORLD_SIZE \
--student_type distilbert \ --student_type distilbert \
--student_config training_configs/distilbert-base-uncased.json \ --student_config training_configs/distilbert-base-uncased.json \
--teacher_type bert \ --teacher_type bert \

2
examples/research_projects/distillation/train.py
View File

@@ -210,7 +210,7 @@ def main():
help="For fp16: Apex AMP optimization level selected in ['O0', 'O1', 'O2', and 'O3']." help="For fp16: Apex AMP optimization level selected in ['O0', 'O1', 'O2', and 'O3']."
"See details at https://nvidia.github.io/apex/amp.html", "See details at https://nvidia.github.io/apex/amp.html",
) )
parser.add_argument("--gpus", type=int, default=1, help="Number of GPUs in the node.") parser.add_argument("--n_gpu", type=int, default=1, help="Number of GPUs in the node.")
parser.add_argument("--local_rank", type=int, default=-1, help="Distributed training - Local rank") parser.add_argument("--local_rank", type=int, default=-1, help="Distributed training - Local rank")
parser.add_argument("--seed", type=int, default=56, help="Random seed") parser.add_argument("--seed", type=int, default=56, help="Random seed")