Minor fix.

This commit is contained in:
Daniel Khashabi
2018-12-14 14:10:36 -05:00
committed by GitHub
parent 8809eb6c93
commit 8b1b93947f

View File

@@ -517,8 +517,7 @@ python ./run_squad.py \
--doc_stride 128 \ --doc_stride 128 \
--output_dir $OUTPUT_DIR \ --output_dir $OUTPUT_DIR \
--train_batch_size 24 \ --train_batch_size 24 \
--gradient_accumulation_steps 2 \ --gradient_accumulation_steps 2
--optimize_on_cpu
``` ```
If you have a recent GPU (starting from NVIDIA Volta series), you should try **16-bit fine-tuning** (FP16). If you have a recent GPU (starting from NVIDIA Volta series), you should try **16-bit fine-tuning** (FP16).