Patrick von Platen 4134100363 Add generate() functionality to TF 2.0 (#3063) ...

* add first copy past test to tf 2 generate

* add tf top_k_top_p_filter fn

* add generate function for TF

* add generate function for TF

* implemented generate for all models expect transfoXL

* implemented generate for all models expect transfoXL

* implemented generate for all models expect transfoXL

* make style

* change permission of test file to correct ones

* delete ipdb

* delete ipdb

* fix bug and finish simple gpt2 integration test

* clean test file

* clean test file

* make style

* make style

* make style

* make style

* change import style

* change import style

* make style

* make style

* add decorators

* add decorators

* fix tf ctrl bug dim => axis in TF

* make style

* make style

* refactored test file

* refactored test file

* take out test_torch_tf_conversion if nothing is defined

* take out test_torch_tf_conversion if nothing is defined

* remove useless files

* remove useless files

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* fix conflicts

* solve conflicts

* solve conflicts

* fix conflicts

* fix conflicts

* merge conflicts

* delete ipdb

* exposed top_k_top_p_filtering fns

* delete weirdly created w! file

* add comment to test tf common modeling

* fix conflicts

* fix conflicts

* make style

* merge conflicts

* make style

* change tf.tensor.shape to shape_list(tensor)

2020-03-03 09:42:15 -05:00

..

fixtures

AutoConfig + other Auto classes honor model_type

2020-01-11 02:46:17 +00:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_activations.py

get_activation('relu') provides a simple mapping from strings i… (#2807)

2020-02-13 08:28:33 -05:00

test_configuration_auto.py

Map configs to models and tokenizers

2020-01-13 23:11:44 +00:00

test_configuration_common.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_doc_samples.py

Rename test_examples to test_doc_samples

2020-01-30 10:07:22 -05:00

test_hf_api.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_model_card.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_albert.py

Added test for AlbertForTokenClassification

2020-02-27 12:24:20 +01:00

test_modeling_auto.py

Flaubert auto tokenizer + tests

2020-01-31 14:16:52 -05:00

test_modeling_bart.py

Bart-CNN (#3059)

2020-03-02 10:35:53 -05:00

test_modeling_bert.py

BERT decoder: Fix causal mask dtype.

2020-02-11 15:19:22 -05:00

test_modeling_common.py

Add generate() functionality to TF 2.0 (#3063)

2020-03-03 09:42:15 -05:00

test_modeling_ctrl.py

Add slow generate tests for pretrained lm models (#2909)

2020-02-24 11:51:57 -05:00

test_modeling_distilbert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_flaubert.py

Correct slow test

2020-02-04 18:05:35 -05:00

test_modeling_gpt2.py

Add generate() functionality to TF 2.0 (#3063)

2020-03-03 09:42:15 -05:00

test_modeling_openai.py

Add slow generate tests for pretrained lm models (#2909)

2020-02-24 11:51:57 -05:00

test_modeling_roberta.py

New BartModel (#2745)

2020-02-20 18:11:13 -05:00

test_modeling_t5.py

Fix (non-slow) tests on GPU (torch) (#3024)

2020-02-26 11:59:25 -05:00

test_modeling_tf_albert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_tf_auto.py

Add AutoModelForPreTraining

2020-01-27 14:27:07 -05:00

test_modeling_tf_bert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_tf_common.py

Add generate() functionality to TF 2.0 (#3063)

2020-03-03 09:42:15 -05:00

test_modeling_tf_ctrl.py

Add generate() functionality to TF 2.0 (#3063)

2020-03-03 09:42:15 -05:00

test_modeling_tf_distilbert.py

Definitive HeisenDistilBug fix

2020-01-27 12:09:58 -05:00

test_modeling_tf_gpt2.py

Add generate() functionality to TF 2.0 (#3063)

2020-03-03 09:42:15 -05:00

test_modeling_tf_openai_gpt.py

Add generate() functionality to TF 2.0 (#3063)

2020-03-03 09:42:15 -05:00

test_modeling_tf_roberta.py

RoBERTa TensorFlow Tests

2020-02-04 18:05:35 -05:00

test_modeling_tf_t5.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_tf_transfo_xl.py

Add generate() functionality to TF 2.0 (#3063)

2020-03-03 09:42:15 -05:00

test_modeling_tf_xlm.py

Add generate() functionality to TF 2.0 (#3063)

2020-03-03 09:42:15 -05:00

test_modeling_tf_xlnet.py

Add generate() functionality to TF 2.0 (#3063)

2020-03-03 09:42:15 -05:00

test_modeling_transfo_xl.py

Add slow generate tests for pretrained lm models (#2909)

2020-02-24 11:51:57 -05:00

test_modeling_xlm_roberta.py

Add integration tests for xlm roberta modelling and xlm roberta tokenzier (#3014)

2020-02-25 16:51:25 -05:00

test_modeling_xlm.py

Add slow generate tests for pretrained lm models (#2909)

2020-02-24 11:51:57 -05:00

test_modeling_xlnet.py

Add slow generate tests for pretrained lm models (#2909)

2020-02-24 11:51:57 -05:00

test_optimization_tf.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_optimization.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_pipelines.py

Pipeline doc (#3055)

2020-03-02 14:07:10 -05:00

test_tokenization_albert.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_auto.py

Test correct tokenizers after default switch (#3003)

2020-02-24 18:45:53 -05:00

test_tokenization_bert_japanese.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_bert.py

Fix BasicTokenizer to respect never_split parameters (#2557)

2020-01-17 14:57:56 -05:00

test_tokenization_common.py

Force pad_token_id to be set before padding for standard tokenizer (#3035)

2020-03-02 10:53:55 -05:00

test_tokenization_ctrl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_distilbert.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_tokenization_fast.py

Fix for fast tokenizers save_pretrained compatibility with Python. (#2933)

2020-02-24 18:20:42 -05:00

test_tokenization_gpt2.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_openai.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_roberta.py

Preserve spaces in GPT-2 tokenizers (#2778)

2020-02-13 13:29:43 -05:00

test_tokenization_t5.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_transfo_xl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_utils.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_tokenization_xlm_roberta.py

Add integration tests for xlm roberta modelling and xlm roberta tokenzier (#3014)

2020-02-25 16:51:25 -05:00

test_tokenization_xlm.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_xlnet.py

💄 super

2020-01-15 18:33:50 -05:00

utils.py

TF GPU CI (#3085)

2020-03-02 15:45:25 -05:00