SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Updating run_squad information in readme

Browse Source
This commit is contained in:
Thomas Wolf
2018-11-06 08:53:01 +01:00
committed by GitHub
parent 79e1b95e75
commit 1a5bbd83dc
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -194,3 +194,5 @@ python run_squad.py \
--doc_stride 128 \ --doc_stride 128 \
--output_dir ../debug_squad/ --output_dir ../debug_squad/
``` ```
There is currently a bug in the `run_squad.py` script that we are investigating. The reported numbers are very low (F1 of 41.8 and exact match of 21.7) even though the correct answer is usually in the n-best predictions. We are investigating that right now on the develop branch, follow [this issue](https://github.com/huggingface/pytorch-pretrained-BERT/issues/3) for more updates.