Files
HuggingFace_transformer/model_cards
Dat Quoc Nguyen af2322c7a0 Add new pre-trained models BERTweet and PhoBERT (#6129)
* Add BERTweet and PhoBERT models

* Update modeling_auto.py

Re-add `bart` to LM_MAPPING

* Update tokenization_auto.py

Re-add `from .configuration_mobilebert import MobileBertConfig`
not sure why it's replaced by `from transformers.configuration_mobilebert import MobileBertConfig`

* Add BERTweet and PhoBERT to pretrained_models.rst

* Update tokenization_auto.py

Remove BertweetTokenizer and PhobertTokenizer out of tokenization_auto.py (they are currently not supported by AutoTokenizer.

* Update BertweetTokenizer - without nltk

* Update model card for BERTweet

* PhoBERT - with Auto mode - without import fastBPE

* PhoBERT - with Auto mode - without import fastBPE

* BERTweet - with Auto mode - without import fastBPE

* Add PhoBERT and BERTweet to TF modeling auto

* Improve Docstrings for PhobertTokenizer and BertweetTokenizer

* Update PhoBERT and BERTweet model cards

* Fixed a merge conflict in tokenization_auto

* Used black to reformat BERTweet- and PhoBERT-related files

* Used isort to reformat BERTweet- and PhoBERT-related files

* Reformatted BERTweet- and PhoBERT-related files based on flake8

* Updated test files

* Updated test files

* Updated tf test files

* Updated tf test files

* Updated tf test files

* Updated tf test files

* Update commits from huggingface

* Delete unnecessary files

* Add tokenizers to auto and init files

* Add test files for tokenizers

* Revised model cards

* Update save_vocabulary function in BertweetTokenizer and PhobertTokenizer and test files

* Revised test files

* Update orders of Phobert and Bertweet tokenizers in auto tokenization file
2020-09-18 13:16:43 -04:00
..
2020-06-24 04:40:50 -04:00
2020-09-07 07:31:22 -04:00
2020-07-21 12:54:29 -04:00
2020-06-24 04:42:46 -04:00
2020-08-04 17:44:14 -04:00
2020-02-19 10:51:16 -05:00
2020-09-01 17:09:10 -04:00
2020-03-11 12:37:00 -04:00
2020-09-18 16:52:00 +02:00
2020-08-17 16:24:10 -04:00
2020-09-10 17:05:50 +02:00
2020-06-12 09:03:13 -04:00
2020-07-15 17:50:46 -04:00
2020-07-16 03:50:47 -04:00
2020-09-18 12:09:24 +02:00
2020-07-21 13:28:22 -04:00
2020-08-26 23:16:06 +02:00
2020-04-24 10:24:28 -04:00
2020-02-05 15:26:28 -05:00
2020-09-11 15:21:05 -04:00
2020-09-18 03:24:30 -04:00
2020-07-16 11:03:05 +08:00
2020-04-28 16:42:15 -04:00
2020-06-22 17:24:27 -04:00
2020-09-01 17:59:15 -04:00
2020-08-28 12:12:28 +08:00
2020-09-18 03:19:45 -04:00
2020-03-25 16:40:03 -04:00
2020-07-20 11:40:33 -04:00
2020-07-22 11:38:37 -04:00
2020-08-21 18:11:18 +02:00
2020-07-22 11:38:37 -04:00
2020-07-22 11:38:37 -04:00
2020-07-22 11:38:37 -04:00