HuggingFace_transformer/tests at 96f57c9ccb6363623005fb3f05166dfd7acb3f53 - HuggingFace_transformer - Gitea: Git with SSUM

SUMIN/HuggingFace_transformer

Files

History

Patrick von Platen 96f57c9ccb [Benchmark] Memory benchmark utils (#4198 )

* improve memory benchmarking

* correct typo

* fix current memory

* check torch memory allocated

* better pytorch function

* add total cached gpu memory

* add total gpu required

* improve torch gpu usage

* update memory usage

* finalize memory tracing

* save intermediate benchmark class

* fix conflict

* improve benchmark

* improve benchmark

* finalize

* make style

* improve benchmarking

* correct typo

* make train function more flexible

* fix csv save

* better repr of bytes

* better print

* fix __repr__ bug

* finish plot script

* rename plot file

* delete csv and small improvements

* fix in plot

* fix in plot

* correct usage of timeit

* remove redundant line

* remove redundant line

* fix bug

* add hf parser tests

* add versioning and platform info

* make style

* add gpu information

* ensure backward compatibility

* finish adding all tests

* Update src/transformers/benchmark/benchmark_args.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Update src/transformers/benchmark/benchmark_args_utils.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* delete csv files

* fix isort ordering

* add out of memory handling

* add better train memory handling

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

2020-05-27 23:22:16 +02:00

..

BIG Reorganize examples (#4213 )

2020-05-07 13:48:44 -04:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_activations.py

Reformer (#3351 )

2020-05-07 10:17:01 +02:00

test_benchmark.py

[Benchmark] Memory benchmark utils (#4198 )

2020-05-27 23:22:16 +02:00

test_configuration_auto.py

Map configs to models and tokenizers

2020-01-13 23:11:44 +00:00

test_configuration_common.py

Pass kwargs to configuration (#3147 )

2020-03-05 17:16:57 -05:00

test_doc_samples.py

make style

2020-03-04 20:18:07 -05:00

test_hf_api.py

[cli] {login, upload, s3} display more helpful error messages

2020-04-30 12:51:06 -04:00

test_hf_argparser.py

[Benchmark] Memory benchmark utils (#4198 )

2020-05-27 23:22:16 +02:00

test_model_card.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_modeling_albert.py

Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057 )

2020-05-07 19:44:51 -04:00

test_modeling_auto.py

Fix slow gpu tests lysandre (#4487 )

2020-05-20 11:59:45 -04:00

test_modeling_bart.py

[ci] fix 3 remaining slow GPU failures (#4584 )

2020-05-25 19:20:50 -04:00

test_modeling_bert.py

[EncoderDecoder Tests] Improve tests (#4046 )

2020-05-04 02:18:36 +02:00

test_modeling_camembert.py

Fix slow gpu tests lysandre (#4487 )

2020-05-20 11:59:45 -04:00

test_modeling_common.py

Fix nn.DataParallel compatibility in PyTorch 1.5 (#4300 )

2020-05-18 20:34:50 -04:00

test_modeling_ctrl.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_distilbert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_electra.py

added functionality for electra classification head (#4257 )

2020-05-22 09:48:21 -04:00

test_modeling_encoder_decoder.py

[Tests, GPU, SLOW] fix a bunch of GPU hardcoded tests in Pytorch (#4468 )

2020-05-19 21:35:04 +02:00

test_modeling_flaubert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_gpt2.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_longformer.py

LongformerForSequenceClassification (#4580 )

2020-05-27 22:30:00 +02:00

test_modeling_marian.py

[MarianTokenizer] implement save_vocabulary and other common methods (#4389 )

2020-05-19 19:45:49 -04:00

test_modeling_openai.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_reformer.py

Fix nn.DataParallel compatibility in PyTorch 1.5 (#4300 )

2020-05-18 20:34:50 -04:00

test_modeling_roberta.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_t5.py

[Tests, GPU, SLOW] fix a bunch of GPU hardcoded tests in Pytorch (#4468 )

2020-05-19 21:35:04 +02:00

test_modeling_tf_albert.py

Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057 )

2020-05-07 19:44:51 -04:00

test_modeling_tf_auto.py

Add AutoModelForPreTraining

2020-01-27 14:27:07 -05:00

test_modeling_tf_bert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_camembert.py

Add camembert integration tests (#3375 )

2020-03-24 10:18:37 +01:00

test_modeling_tf_common.py

[Config, Caching] Remove output_past everywhere and replace by use_cache argument (#3734 )

2020-04-14 14:40:28 -04:00

test_modeling_tf_ctrl.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_tf_distilbert.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_electra.py

[ci] fix 3 remaining slow GPU failures (#4584 )

2020-05-25 19:20:50 -04:00

test_modeling_tf_gpt2.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_tf_openai_gpt.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_tf_roberta.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_t5.py

[ci] Load pretrained models into the default (long-lived) cache

2020-04-30 22:30:15 -04:00

test_modeling_tf_transfo_xl.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_tf_xlm.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_tf_xlnet.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_transfo_xl.py

[Tests, GPU, SLOW] fix a bunch of GPU hardcoded tests in Pytorch (#4468 )

2020-05-19 21:35:04 +02:00

test_modeling_xlm_roberta.py

[ci] Re-run integration ground truth from fairseq

2020-03-03 15:31:40 -05:00

test_modeling_xlm.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_modeling_xlnet.py

[testing] LanguageModelGenerationTests require_tf or require_torch (#4616 )

2020-05-27 09:10:26 -04:00

test_onnx.py

Tag onnx export tests as slow (#4432 )

2020-05-18 09:24:41 -04:00

test_optimization_tf.py

TF version of the trainer (#4017 )

2020-05-06 12:56:52 -04:00

test_optimization.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_pipelines.py

[test_pipelines] Mark tests > 10s @slow, small speedups (#4421 )

2020-05-18 12:23:21 -04:00

test_tokenization_albert.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_tokenization_auto.py

Test correct tokenizers after default switch (#3003 )

2020-02-24 18:45:53 -05:00

test_tokenization_bert_japanese.py

[ci] Close #4481

2020-05-20 18:27:42 -04:00

test_tokenization_bert.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_tokenization_common.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_tokenization_ctrl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_distilbert.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_tokenization_fast.py

Fix convert_token_type_ids_from_sequences for fast tokenizers (#4503 )

2020-05-22 12:45:10 -04:00

test_tokenization_gpt2.py

Tokenizers v3.0.0 (#3185 )

2020-04-07 00:29:15 +02:00

test_tokenization_marian.py

[MarianTokenizer] implement save_vocabulary and other common methods (#4389 )

2020-05-19 19:45:49 -04:00

test_tokenization_openai.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_tokenization_roberta.py

Fix slow gpu tests lysandre (#4487 )

2020-05-20 11:59:45 -04:00

test_tokenization_t5.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_tokenization_transfo_xl.py

💄 super

2020-01-15 18:33:50 -05:00

test_tokenization_utils.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_tokenization_xlm_roberta.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_tokenization_xlm.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_tokenization_xlnet.py

[cleanup] test_tokenization_common.py (#4390 )

2020-05-19 10:46:55 -04:00

test_trainer_distributed.py

Update test_trainer_distributed.py

2020-05-20 18:26:51 -04:00

test_trainer.py

Adds predict stage for glue tasks, and generate result files which can be submitted to gluebenchmark.com (#4463 )

2020-05-21 09:17:44 -04:00

utils.py

Fix nn.DataParallel compatibility in PyTorch 1.5 (#4300 )

2020-05-18 20:34:50 -04:00