Add MobileBert (#4901)

* Add MobileBert

* Quality + Conversion script

* style

* Update src/transformers/modeling_mobilebert.py

* Links to S3

* Style

* TFMobileBert

Slight fixes to the pytorch MobileBert
Style

* MobileBertForMaskedLM (PT + TF)

* MobileBertForNextSentencePrediction (PT + TF)

* MobileFor{MultipleChoice, TokenClassification} (PT + TF)


ss

* Tests + Auto

* Doc

* Tests

* Addressing @sgugger's comments

* Adressing @patrickvonplaten's comments

* Style

* Style

* Integration test

* style

* Model card

Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
This commit is contained in:
Vasily Shamporov
2020-06-19 23:38:36 +03:00
committed by GitHub
parent f45e873910
commit 9a3f91088c
15 changed files with 4452 additions and 0 deletions

View File

@@ -184,3 +184,4 @@ conversion utilities for the following models:
model_doc/marian
model_doc/longformer
model_doc/retribert
model_doc/mobilebert