HuggingFace_transformer

Files

Sylvain Gugger edfd82f5ff Change model outputs types to self-document outputs (#5438 )

* [WIP] Proposal for model outputs

* All Bert models

* Make CI green maybe?

* Fix ONNX test

* Isolate ModelOutput from pt and tf

* Formatting

* Add Electra models

* Auto-generate docstrings from outputs

* Add TF outputs

* Add some BERT models

* Revert TF side

* Remove last traces of TF changes

* Fail with a clear error message

* Add Albert and work through Bart

* Add CTRL and DistilBert

* Formatting

* Progress on Bart

* Renames and finish Bart

* Formatting

* Fix last test

* Add DPR

* Finish Electra and add FlauBERT

* Add GPT2

* Add Longformer

* Add MMBT

* Add MobileBert

* Add GPT

* Formatting

* Add Reformer

* Add Roberta

* Add T5

* Add Transformer XL

* Fix test

* Add XLM + fix XLMForTokenClassification

* Style + XLMRoberta

* Add XLNet

* Formatting

* Add doc of return_tuple arg

2020-07-10 11:36:53 -04:00

fixtures

BIG Reorganize examples (#4213 )

2020-05-07 13:48:44 -04:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_activations.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_benchmark_tf.py

[Benchmark] Add benchmarks for TF Training (#5594 )

2020-07-08 12:11:09 +02:00

test_benchmark.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_configuration_auto.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_configuration_common.py

Pass kwargs to configuration (#3147 )

2020-03-05 17:16:57 -05:00

test_doc_samples.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_hf_api.py

[cli] {login, upload, s3} display more helpful error messages

2020-04-30 12:51:06 -04:00

test_hf_argparser.py

[Benchmark] Memory benchmark utils (#4198 )

2020-05-27 23:22:16 +02:00

test_model_card.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_albert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_auto.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_bart.py

Add mbart-large-cc25, support translation finetuning (#5129 )

2020-07-07 13:23:01 -04:00

test_modeling_bert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_camembert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_common.py

Change model outputs types to self-document outputs (#5438 )

2020-07-10 11:36:53 -04:00

test_modeling_ctrl.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_distilbert.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395 )

2020-07-07 18:15:53 +02:00

test_modeling_dpr.py

Fix tests imports dpr (#5576 )

2020-07-07 16:35:12 +02:00

test_modeling_electra.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_encoder_decoder.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_flaubert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_gpt2.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_longformer.py

[Longformer] Major Refactor (#5219 )

2020-07-01 17:43:32 +02:00

test_modeling_marian.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_mbart.py

Add mbart-large-cc25, support translation finetuning (#5129 )

2020-07-07 13:23:01 -04:00

test_modeling_mobilebert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_openai.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_reformer.py

[Reformer] Adapt Reformer MaskedLM Attn mask (#5560 )

2020-07-07 10:48:06 +02:00

test_modeling_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_t5.py

Change model outputs types to self-document outputs (#5438 )

2020-07-10 11:36:53 -04:00

test_modeling_tf_albert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_auto.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395 )

2020-07-07 18:15:53 +02:00

test_modeling_tf_bert.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395 )

2020-07-07 18:15:53 +02:00

test_modeling_tf_camembert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_common.py

Change model outputs types to self-document outputs (#5438 )

2020-07-10 11:36:53 -04:00

test_modeling_tf_ctrl.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_distilbert.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395 )

2020-07-07 18:15:53 +02:00

test_modeling_tf_electra.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_flaubert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_gpt2.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_mobilebert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_openai_gpt.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_t5.py

[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395 )

2020-07-07 18:15:53 +02:00

test_modeling_tf_transfo_xl.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_xlm_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_xlm.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_tf_xlnet.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_transfo_xl.py

Changed expected_output_ids in TransfoXL generation test (#5462 )

2020-07-02 11:56:44 +02:00

test_modeling_xlm_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_modeling_xlm.py

Change model outputs types to self-document outputs (#5438 )

2020-07-10 11:36:53 -04:00

test_modeling_xlnet.py

Change model outputs types to self-document outputs (#5438 )

2020-07-10 11:36:53 -04:00

test_onnx.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_optimization_tf.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_optimization.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_pipelines.py

Fix Inconsistent NER Grouping (Pipeline) (#4987 )

2020-07-08 16:18:17 -04:00

test_tokenization_albert.py

[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510 )

2020-06-15 17:12:51 -04:00

test_tokenization_auto.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_tokenization_bert_japanese.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_tokenization_bert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_tokenization_common.py

Add mbart-large-cc25, support translation finetuning (#5129 )

2020-07-07 13:23:01 -04:00

test_tokenization_ctrl.py

[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510 )

2020-06-15 17:12:51 -04:00

test_tokenization_distilbert.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_tokenization_dpr.py

Fix tests imports dpr (#5576 )

2020-07-07 16:35:12 +02:00

test_tokenization_fast.py

Various tokenizers fixes (#5558 )

2020-07-06 18:27:53 -04:00

test_tokenization_gpt2.py

[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510 )

2020-06-15 17:12:51 -04:00

test_tokenization_marian.py

[fix] Marian tests import (#5442 )

2020-07-01 11:42:22 -04:00

test_tokenization_mbart.py

Add mbart-large-cc25, support translation finetuning (#5129 )

2020-07-07 13:23:01 -04:00

test_tokenization_openai.py

[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510 )

2020-06-15 17:12:51 -04:00

test_tokenization_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_tokenization_t5.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_tokenization_transfo_xl.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_tokenization_utils.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_tokenization_xlm_roberta.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_tokenization_xlm.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_tokenization_xlnet.py

Move tests/utils.py -> transformers/testing_utils.py (#5350 )

2020-07-01 10:31:17 -04:00

test_trainer_distributed.py

[Tokenization] Fix #5181 - make #5155 more explicit - move back the default logging level in tests to WARNING (#5252 )

2020-06-25 17:24:28 +02:00

test_trainer.py

Added data collator for permutation (XLNet) language modeling and related calls (#5522 )

2020-07-07 10:17:37 +02:00