From d92a7f7721f56e668338dd0c4ec89a1b8e3108f1 Mon Sep 17 00:00:00 2001 From: Thomas Wolf Date: Wed, 7 Nov 2018 23:37:55 +0100 Subject: [PATCH] Removing note on run_squad.py example --- README.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/README.md b/README.md index efa3c2c283..0316696ec3 100644 --- a/README.md +++ b/README.md @@ -194,5 +194,3 @@ python run_squad.py \ --doc_stride 128 \ --output_dir ../debug_squad/ ``` - -There is currently a bug in the `run_squad.py` script that we are investigating. The reported numbers are very low (F1 of 41.8 and exact match of 21.7) even though the correct answer is usually in the n-best predictions. We are investigating that right now on the develop branch, follow [this issue](https://github.com/huggingface/pytorch-pretrained-BERT/issues/3) for more updates.