Patrick von Platen bbf26c4e61 Support T5 Generation (#3228) ...

* fix conflicts

* update bart max length test

* correct spelling mistakes

* implemented model specific encode function

* fix merge conflicts

* better naming

* save intermediate state -> need to rethink strucuture a bit

* leave tf problem as it is for now

* current version

* add layers.pop

* remove ipdb

* make style

* clean return cut decoding

* remove ipdbs

* Fix restoring layers in the decoders that doesnt exists.

* push good intermediate solution for now

* fix conflicts

* always good to refuse to merge conflicts when rebasing

* fix small bug

* improve function calls

* remove unused file

* add correct scope behavior for t5_generate

Co-authored-by: Morgan Funtowicz <funtowiczmo@gmail.com>

2020-03-19 23:18:23 +01:00

..

fixtures

AutoConfig + other Auto classes honor model_type

2020-01-11 02:46:17 +00:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_activations.py

get_activation('relu') provides a simple mapping from strings i… (#2807)

2020-02-13 08:28:33 -05:00

test_configuration_auto.py

Map configs to models and tokenizers

2020-01-13 23:11:44 +00:00

test_configuration_common.py

Pass kwargs to configuration (#3147)

2020-03-05 17:16:57 -05:00

test_doc_samples.py

make style

2020-03-04 20:18:07 -05:00

test_hf_api.py

[model upload] Support for organizations

2020-03-09 17:33:57 -04:00

test_model_card.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_albert.py

Added test for AlbertForTokenClassification

2020-02-27 12:24:20 +01:00

test_modeling_auto.py

Flaubert auto tokenizer + tests

2020-01-31 14:16:52 -05:00

test_modeling_bart.py

Support T5 Generation (#3228)

2020-03-19 23:18:23 +01:00

test_modeling_bert.py

BERT decoder: Fix causal mask dtype.

2020-02-11 15:19:22 -05:00

test_modeling_common.py

Support T5 Generation (#3228)

2020-03-19 23:18:23 +01:00

test_modeling_ctrl.py

test ctrl

2020-03-09 13:58:01 +00:00

test_modeling_distilbert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_flaubert.py

Correct slow test

2020-02-04 18:05:35 -05:00

test_modeling_gpt2.py

fix typo in test gpt2

2020-03-08 15:35:08 +01:00

test_modeling_openai.py

updated all tests

2020-03-08 15:29:10 +01:00

test_modeling_roberta.py

[ci] Re-run integration ground truth from fairseq

2020-03-03 15:31:40 -05:00

test_modeling_t5.py

Support T5 Generation (#3228)

2020-03-19 23:18:23 +01:00

test_modeling_tf_albert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_tf_auto.py

Add AutoModelForPreTraining

2020-01-27 14:27:07 -05:00

test_modeling_tf_bert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_tf_common.py

Support T5 Generation (#3228)

2020-03-19 23:18:23 +01:00

test_modeling_tf_ctrl.py

test ctrl

2020-03-09 13:58:01 +00:00

test_modeling_tf_distilbert.py

Definitive HeisenDistilBug fix

2020-01-27 12:09:58 -05:00

test_modeling_tf_gpt2.py

fixed all tests, still need to check ctrl tf and pt and xlm tf

2020-03-08 21:45:55 +01:00

test_modeling_tf_openai_gpt.py

fixed all tests, still need to check ctrl tf and pt and xlm tf

2020-03-08 21:45:55 +01:00

test_modeling_tf_roberta.py

[ci] Re-run integration ground truth from fairseq

2020-03-03 15:31:40 -05:00

test_modeling_tf_t5.py

Support T5 Generation (#3228)

2020-03-19 23:18:23 +01:00

test_modeling_tf_transfo_xl.py

Adding LM Head to Transfo-XL and first step to fixing problem with Adaptive Embeddings in TransfoXL (#3286)

2020-03-18 09:24:27 -04:00

test_modeling_tf_xlm.py

fix typo in test xlm tf

2020-03-09 11:34:31 +01:00

test_modeling_tf_xlnet.py

fixed all tests, still need to check ctrl tf and pt and xlm tf

2020-03-08 21:45:55 +01:00

test_modeling_transfo_xl.py

Adding LM Head to Transfo-XL and first step to fixing problem with Adaptive Embeddings in TransfoXL (#3286)

2020-03-18 09:24:27 -04:00

test_modeling_xlm_roberta.py

[ci] Re-run integration ground truth from fairseq

2020-03-03 15:31:40 -05:00

test_modeling_xlm.py

fixed all tests, still need to check ctrl tf and pt and xlm tf

2020-03-08 21:45:55 +01:00

test_modeling_xlnet.py

fix xlnet & transfotests

2020-03-08 16:25:03 +01:00

test_optimization_tf.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_optimization.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_pipelines.py

Add Summarization to Pipelines (#3128)

2020-03-17 18:04:21 -04:00

test_tokenization_albert.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_auto.py

Test correct tokenizers after default switch (#3003)

2020-02-24 18:45:53 -05:00

test_tokenization_bert_japanese.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_bert.py

Fix BasicTokenizer to respect never_split parameters (#2557)

2020-01-17 14:57:56 -05:00

test_tokenization_common.py

Skipping outputs (#3116)

2020-03-09 13:48:58 -04:00

test_tokenization_ctrl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_distilbert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_tokenization_fast.py

Fix for fast tokenizers save_pretrained compatibility with Python. (#2933)

2020-02-24 18:20:42 -05:00

test_tokenization_gpt2.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_openai.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_roberta.py

Preserve spaces in GPT-2 tokenizers (#2778)

2020-02-13 13:29:43 -05:00

test_tokenization_t5.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_transfo_xl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_utils.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_tokenization_xlm_roberta.py

XLM-R Tokenizer now passes common tests + Integration tests (#3198)

2020-03-18 09:52:49 -04:00

test_tokenization_xlm.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_xlnet.py

💄 super

2020-01-15 18:33:50 -05:00

utils.py

TF GPU CI (#3085)

2020-03-02 15:45:25 -05:00