Lysandre Debut d5d7d88612 ELECTRA (#3257) ...

* Electra wip

* helpers

* Electra wip

* Electra v1

* ELECTRA may be saved/loaded

* Generator & Discriminator

* Embedding size instead of halving the hidden size

* ELECTRA Tokenizer

* Revert BERT helpers

* ELECTRA Conversion script

* Archive maps

* PyTorch tests

* Start fixing tests

* Tests pass

* Same configuration for both models

* Compatible with base + large

* Simplification + weight tying

* Archives

* Auto + Renaming to standard names

* ELECTRA is uncased

* Tests

* Slight API changes

* Update tests

* wip

* ElectraForTokenClassification

* temp

* Simpler arch + tests

Removed ElectraForPreTraining which will be in a script

* Conversion script

* Auto model

* Update links to S3

* Split ElectraForPreTraining and ElectraForTokenClassification

* Actually test PreTraining model

* Remove num_labels from configuration

* wip

* wip

* From discriminator and generator to electra

* Slight API changes

* Better naming

* TensorFlow ELECTRA tests

* Accurate conversion script

* Added to conversion script

* Fast ELECTRA tokenizer

* Style

* Add ELECTRA to README

* Modeling Pytorch Doc + Real style

* TF Docs

* Docs

* Correct links

* Correct model intialized

* random fixes

* style

* Addressing Patrick's and Sam's comments

* Correct links in docs

2020-04-03 14:10:54 -04:00

..

fixtures

AutoConfig + other Auto classes honor model_type

2020-01-11 02:46:17 +00:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_activations.py

get_activation('relu') provides a simple mapping from strings i… (#2807)

2020-02-13 08:28:33 -05:00

test_configuration_auto.py

Map configs to models and tokenizers

2020-01-13 23:11:44 +00:00

test_configuration_common.py

Pass kwargs to configuration (#3147)

2020-03-05 17:16:57 -05:00

test_doc_samples.py

make style

2020-03-04 20:18:07 -05:00

test_hf_api.py

[model upload] Support for organizations

2020-03-09 17:33:57 -04:00

test_model_card.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_albert.py

Added test for AlbertForTokenClassification

2020-02-27 12:24:20 +01:00

test_modeling_auto.py

Add missing token classification for XLM (#3277)

2020-03-26 10:22:13 -04:00

test_modeling_bart.py

[bart-tiny-random] Put a 5MB model on S3 to allow faster exampl… (#3488)

2020-03-30 12:28:27 -04:00

test_modeling_bert.py

BERT decoder: Fix causal mask dtype.

2020-02-11 15:19:22 -05:00

test_modeling_camembert.py

Add camembert integration tests (#3375)

2020-03-24 10:18:37 +01:00

test_modeling_common.py

[Generate] Add bad words list argument to the generate function (#3367)

2020-03-31 18:42:31 +02:00

test_modeling_ctrl.py

test ctrl

2020-03-09 13:58:01 +00:00

test_modeling_distilbert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_electra.py

ELECTRA (#3257)

2020-04-03 14:10:54 -04:00

test_modeling_flaubert.py

Correct slow test

2020-02-04 18:05:35 -05:00

test_modeling_gpt2.py

Clean special token init in modeling_....py (#3264)

2020-03-20 21:41:04 +01:00

test_modeling_openai.py

updated all tests

2020-03-08 15:29:10 +01:00

test_modeling_roberta.py

[ci] Re-run integration ground truth from fairseq

2020-03-03 15:31:40 -05:00

test_modeling_t5.py

[T5, Testst] Add extensive hard-coded integration tests and make sure PT and TF give equal results (#3550)

2020-04-01 18:01:33 +02:00

test_modeling_tf_albert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_tf_auto.py

Add AutoModelForPreTraining

2020-01-27 14:27:07 -05:00

test_modeling_tf_bert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_tf_camembert.py

Add camembert integration tests (#3375)

2020-03-24 10:18:37 +01:00

test_modeling_tf_common.py

[T5, TF 2.2] change tf t5 argument naming (#3547)

2020-04-01 22:04:20 +02:00

test_modeling_tf_ctrl.py

test ctrl

2020-03-09 13:58:01 +00:00

test_modeling_tf_distilbert.py

Definitive HeisenDistilBug fix

2020-01-27 12:09:58 -05:00

test_modeling_tf_electra.py

ELECTRA (#3257)

2020-04-03 14:10:54 -04:00

test_modeling_tf_gpt2.py

Clean special token init in modeling_....py (#3264)

2020-03-20 21:41:04 +01:00

test_modeling_tf_openai_gpt.py

fixed all tests, still need to check ctrl tf and pt and xlm tf

2020-03-08 21:45:55 +01:00

test_modeling_tf_roberta.py

[ci] Re-run integration ground truth from fairseq

2020-03-03 15:31:40 -05:00

test_modeling_tf_t5.py

[T5, TF 2.2] change tf t5 argument naming (#3547)

2020-04-01 22:04:20 +02:00

test_modeling_tf_transfo_xl.py

Clean special token init in modeling_....py (#3264)

2020-03-20 21:41:04 +01:00

test_modeling_tf_xlm.py

fix typo in test xlm tf

2020-03-09 11:34:31 +01:00

test_modeling_tf_xlnet.py

fixed all tests, still need to check ctrl tf and pt and xlm tf

2020-03-08 21:45:55 +01:00

test_modeling_transfo_xl.py

Clean special token init in modeling_....py (#3264)

2020-03-20 21:41:04 +01:00

test_modeling_xlm_roberta.py

[ci] Re-run integration ground truth from fairseq

2020-03-03 15:31:40 -05:00

test_modeling_xlm.py

Add missing token classification for XLM (#3277)

2020-03-26 10:22:13 -04:00

test_modeling_xlnet.py

fix xlnet & transfotests

2020-03-08 16:25:03 +01:00

test_optimization_tf.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_optimization.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_pipelines.py

Adds translation pipeline (#3419)

2020-03-26 13:50:58 +01:00

test_tokenization_albert.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_auto.py

Test correct tokenizers after default switch (#3003)

2020-02-24 18:45:53 -05:00

test_tokenization_bert_japanese.py

BertJapaneseTokenizer accept options for mecab (#3566)

2020-04-03 11:12:19 -04:00

test_tokenization_bert.py

Fix BasicTokenizer to respect never_split parameters (#2557)

2020-01-17 14:57:56 -05:00

test_tokenization_common.py

Skipping outputs (#3116)

2020-03-09 13:48:58 -04:00

test_tokenization_ctrl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_distilbert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_tokenization_fast.py

Fix for fast tokenizers save_pretrained compatibility with Python. (#2933)

2020-02-24 18:20:42 -05:00

test_tokenization_gpt2.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_openai.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_roberta.py

Preserve spaces in GPT-2 tokenizers (#2778)

2020-02-13 13:29:43 -05:00

test_tokenization_t5.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_transfo_xl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_utils.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_tokenization_xlm_roberta.py

XLM-R Tokenizer now passes common tests + Integration tests (#3198)

2020-03-18 09:52:49 -04:00

test_tokenization_xlm.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_xlnet.py

💄 super

2020-01-15 18:33:50 -05:00

utils.py

TF GPU CI (#3085)

2020-03-02 15:45:25 -05:00