SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
4dc65591b5c61d75c3ef3a2a883bf1433e08fc45
HuggingFace_transformer/tests
History
Patrick von Platen 4dc65591b5 [Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395) 
* add first version of clm tf

* make style

* add more tests for bert

* update tf clm loss

* fix tests

* correct tf ner script

* add mlm loss

* delete bogus file

* clean tf auto model + add tests

* finish adding clm loss everywhere

* fix training in distilbert

* fix flake8

* save intermediate

* fix tf t5 naming

* remove prints

* finish up

* up

* fix tf gpt2

* fix new test utils import

* fix flake8

* keep backward compatibility

* Update src/transformers/modeling_tf_albert.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_auto.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_electra.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_roberta.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_mobilebert.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_auto.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_bert.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/modeling_tf_distilbert.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* apply sylvains suggestions

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2020-07-07 18:15:53 +02:00
..
fixtures
BIG Reorganize examples (#4213)
2020-05-07 13:48:44 -04:00
__init__.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_activations.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_benchmark_tf.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_benchmark.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_configuration_auto.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_configuration_common.py
Pass kwargs to configuration (#3147)
2020-03-05 17:16:57 -05:00
test_doc_samples.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_hf_api.py
[cli] {login, upload, s3} display more helpful error messages
2020-04-30 12:51:06 -04:00
test_hf_argparser.py
[Benchmark] Memory benchmark utils (#4198)
2020-05-27 23:22:16 +02:00
test_model_card.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_albert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_auto.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_bart.py
[Bart] enable test_torchscript, update test_tie_weights (#5457)
2020-07-07 10:06:48 -04:00
test_modeling_bert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_camembert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_common.py
[Bart] enable test_torchscript, update test_tie_weights (#5457)
2020-07-07 10:06:48 -04:00
test_modeling_ctrl.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_distilbert.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
test_modeling_dpr.py
Fix tests imports dpr (#5576)
2020-07-07 16:35:12 +02:00
test_modeling_electra.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_encoder_decoder.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_flaubert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_gpt2.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_longformer.py
[Longformer] Major Refactor (#5219)
2020-07-01 17:43:32 +02:00
test_modeling_marian.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_mobilebert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_openai.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_reformer.py
[Reformer] Adapt Reformer MaskedLM Attn mask (#5560)
2020-07-07 10:48:06 +02:00
test_modeling_roberta.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_t5.py
Make T5 compatible with ONNX (#5518)
2020-07-07 11:32:29 +02:00
test_modeling_tf_albert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_auto.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
test_modeling_tf_bert.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
test_modeling_tf_camembert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_common.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
test_modeling_tf_ctrl.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_distilbert.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
test_modeling_tf_electra.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_flaubert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_gpt2.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_mobilebert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_openai_gpt.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_roberta.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_t5.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
test_modeling_tf_transfo_xl.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_xlm_roberta.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_xlm.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_tf_xlnet.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_transfo_xl.py
Changed expected_output_ids in TransfoXL generation test (#5462)
2020-07-02 11:56:44 +02:00
test_modeling_xlm_roberta.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_xlm.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_modeling_xlnet.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_onnx.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_optimization_tf.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_optimization.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_pipelines.py
Raises PipelineException on FillMaskPipeline when there are != 1 mask_token in the input (#5389)
2020-07-01 17:27:47 +02:00
test_tokenization_albert.py
[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)
2020-06-15 17:12:51 -04:00
test_tokenization_auto.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_bert_japanese.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_bert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_common.py
Various tokenizers fixes (#5558)
2020-07-06 18:27:53 -04:00
test_tokenization_ctrl.py
[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)
2020-06-15 17:12:51 -04:00
test_tokenization_distilbert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_dpr.py
Fix tests imports dpr (#5576)
2020-07-07 16:35:12 +02:00
test_tokenization_fast.py
Various tokenizers fixes (#5558)
2020-07-06 18:27:53 -04:00
test_tokenization_gpt2.py
[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)
2020-06-15 17:12:51 -04:00
test_tokenization_marian.py
[fix] Marian tests import (#5442)
2020-07-01 11:42:22 -04:00
test_tokenization_openai.py
[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)
2020-06-15 17:12:51 -04:00
test_tokenization_roberta.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_t5.py
[cleanup] test_tokenization_common.py (#4390)
2020-05-19 10:46:55 -04:00
test_tokenization_transfo_xl.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_utils.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_xlm_roberta.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_xlm.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_xlnet.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_trainer_distributed.py
[Tokenization] Fix #5181 - make #5155 more explicit - move back the default logging level in tests to WARNING (#5252)
2020-06-25 17:24:28 +02:00
test_trainer.py
Added data collator for permutation (XLNet) language modeling and related calls (#5522)
2020-07-07 10:17:37 +02:00