SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Manuel Romero
2020-03-10 22:53:32 +01:00
committed by Julien Chaumond
parent 1b9e765b21
commit 601e424750
1 changed files with 2 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

17
model_cards/mrm8488/bert-multi-uncased-finetuned-xquadv1/README.md
View File

@@ -3,9 +3,9 @@ language: multilingual
thumbnail:
---
# BERT (base-multilingual-uncased) fine-tuned on XQuAD
# BERT (base-multilingual-uncased) fine-tuned for multilingual Q&A
This model was created by [Google](https://github.com/google-research/bert/blob/master/multilingual.md) and fine-tuned on [XQuAD](https://github.com/deepmind/xquad) for multilingual (`11 different languages`) **Q&A** downstream task.
This model was created by [Google](https://github.com/google-research/bert/blob/master/multilingual.md) and fine-tuned on [XQuAD](https://github.com/deepmind/xquad) like data for multilingual (`11 different languages`) **Q&A** downstream task.
## Details of the language model('bert-base-multilingual-uncased')
@@ -77,19 +77,6 @@ As **XQuAD** is just an evaluation dataset, I used `Data augmentation techniques
The model was trained on a Tesla P100 GPU and 25GB of RAM.
The script for fine tuning can be found [here](https://github.com/huggingface/transformers/blob/master/examples/distillation/run_squad_w_distillation.py)
## Results:
| Metric | # Value |
| --------- | ----------- |
| **Exact** | **93.03** |
| **F1** | **94.62** |
## Comparison:
| Model | Exact | F1 score |
| --------- | ----------- | ------- |
| [bert-multi-cased-finetuned-xquadv1](https://huggingface.co/mrm8488/bert-multi-cased-finetuned-xquadv1) | 91.43 | 94.14 |
|bert-multi-uncased-finetuned-xquadv1 | **93.03** | **94.62**
## Model in action