Funtowicz Morgan 0a6cbea0a5 Rewritten batch support in pipelines. (#4154) ...

* Rewritten batch support in pipelines.

Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Fix imports sorting 🔧

Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Set pad_to_max_length=True by default on Pipeline.

* Set pad_to_max_length=False for generation pipelines.

Most of generation models doesn't have padding token.

* Address @joeddav review comment: Uniformized *args.

Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

* Address @joeddav review comment: Uniformized *args (second).

Signed-off-by: Morgan Funtowicz <morgan@huggingface.co>

2020-05-07 09:52:40 -04:00

..

fixtures

AutoConfig + other Auto classes honor model_type

2020-01-11 02:46:17 +00:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_activations.py

Reformer (#3351)

2020-05-07 10:17:01 +02:00

test_configuration_auto.py

Map configs to models and tokenizers

2020-01-13 23:11:44 +00:00

test_configuration_common.py

Pass kwargs to configuration (#3147)

2020-03-05 17:16:57 -05:00

test_doc_samples.py

make style

2020-03-04 20:18:07 -05:00

test_hf_api.py

[cli] {login, upload, s3} display more helpful error messages

2020-04-30 12:51:06 -04:00

test_hf_argparser.py

Trainer (#3800)

2020-04-21 20:11:56 -04:00

test_model_card.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_albert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_auto.py

Add missing token classification for XLM (#3277)

2020-03-26 10:22:13 -04:00

test_modeling_bart.py

[testing] add timeout_decorator (#3543)

2020-05-01 09:05:47 -04:00

test_modeling_bert.py

[EncoderDecoder Tests] Improve tests (#4046)

2020-05-04 02:18:36 +02:00

test_modeling_camembert.py

Add camembert integration tests (#3375)

2020-03-24 10:18:37 +01:00

test_modeling_common.py

Reformer (#3351)

2020-05-07 10:17:01 +02:00

test_modeling_ctrl.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_distilbert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_electra.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_encoder_decoder.py

[EncoderDecoder Tests] Improve tests (#4046)

2020-05-04 02:18:36 +02:00

test_modeling_flaubert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_gpt2.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_marian.py

MarianMTModel.from_pretrained('Helsinki-NLP/opus-marian-en-de') (#3908)

2020-04-28 18:22:37 -04:00

test_modeling_openai.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_reformer.py

Reformer (#3351)

2020-05-07 10:17:01 +02:00

test_modeling_roberta.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_t5.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_albert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_auto.py

Add AutoModelForPreTraining

2020-01-27 14:27:07 -05:00

test_modeling_tf_bert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_camembert.py

Add camembert integration tests (#3375)

2020-03-24 10:18:37 +01:00

test_modeling_tf_common.py

[Config, Caching] Remove output_past everywhere and replace by use_cache argument (#3734)

2020-04-14 14:40:28 -04:00

test_modeling_tf_ctrl.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_distilbert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_electra.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_gpt2.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_openai_gpt.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_roberta.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_t5.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_transfo_xl.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_xlm.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_xlnet.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_transfo_xl.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_xlm_roberta.py

[ci] Re-run integration ground truth from fairseq

2020-03-03 15:31:40 -05:00

test_modeling_xlm.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_xlnet.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_optimization_tf.py

TF version of the trainer (#4017)

2020-05-06 12:56:52 -04:00

test_optimization.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_pipelines.py

Rewritten batch support in pipelines. (#4154)

2020-05-07 09:52:40 -04:00

test_tokenization_albert.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_auto.py

Test correct tokenizers after default switch (#3003)

2020-02-24 18:45:53 -05:00

test_tokenization_bert_japanese.py

BertJapaneseTokenizer accept options for mecab (#3566)

2020-04-03 11:12:19 -04:00

test_tokenization_bert.py

Tokenizers v3.0.0 (#3185)

2020-04-07 00:29:15 +02:00

test_tokenization_common.py

[tests] Light cleanup of tempfile in tests/

2020-04-30 22:30:15 -04:00

test_tokenization_ctrl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_distilbert.py

Updating the TensorFlow models to work as expected with tokenizers v3.0.0 (#3684)

2020-04-08 16:22:44 -04:00

test_tokenization_fast.py

Cleanup fast tokenizers integration (#3706)

2020-04-18 13:43:57 +02:00

test_tokenization_gpt2.py

Tokenizers v3.0.0 (#3185)

2020-04-07 00:29:15 +02:00

test_tokenization_openai.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_roberta.py

Preserve spaces in GPT-2 tokenizers (#2778)

2020-02-13 13:29:43 -05:00

test_tokenization_t5.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_transfo_xl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_utils.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_tokenization_xlm_roberta.py

XLM-R Tokenizer now passes common tests + Integration tests (#3198)

2020-03-18 09:52:49 -04:00

test_tokenization_xlm.py

XLM tokenizer should encode with bos token (#3791)

2020-04-17 11:28:55 -04:00

test_tokenization_xlnet.py

💄 super

2020-01-15 18:33:50 -05:00

test_trainer.py

Trainer (#3800)

2020-04-21 20:11:56 -04:00

utils.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00