SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
48c6c6139fbb2881ef16ac5d8afb6287467bf66e
HuggingFace_transformer/tests
History
Masatoshi Suzuki 48c6c6139f Support additional dictionaries for BERT Japanese tokenizers (#6515) 
* Update BERT Japanese tokenizers

* Update CircleCI config to download unidic

* Specify to use the latest dictionary packages
2020-08-17 12:00:23 +08:00
..
fixtures
BIG Reorganize examples (#4213)
2020-05-07 13:48:44 -04:00
__init__.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
conftest.py
enable easy checkout switch (#5645)
2020-07-31 04:34:46 -04:00
test_activations.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_benchmark_tf.py
[Benchmark] Add benchmarks for TF Training (#5594)
2020-07-08 12:11:09 +02:00
test_benchmark.py
typos (#6162)
2020-07-30 17:18:27 -04:00
test_configuration_auto.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_configuration_common.py
Pass kwargs to configuration (#3147)
2020-03-05 17:16:57 -05:00
test_doc_samples.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_hf_api.py
[cli] {login, upload, s3} display more helpful error messages
2020-04-30 12:51:06 -04:00
test_hf_argparser.py
parse arguments from dict (#4869)
2020-07-31 04:44:23 -04:00
test_model_card.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_albert.py
cleanup torch unittests (#6196)
2020-08-04 02:42:56 -04:00
test_modeling_auto.py
[Fix] position_ids tests again (#6100)
2020-07-28 18:29:35 -04:00
test_modeling_bart.py
PegasusForConditionalGeneration (torch version) (#6340)
2020-08-11 14:31:23 -04:00
test_modeling_bert.py
[EncoderDecoder] Add encoder-decoder for roberta/ vanilla longformer (#6411)
2020-08-12 18:23:30 +02:00
test_modeling_camembert.py
Model output test (#6155)
2020-07-31 09:44:37 -04:00
test_modeling_common.py
Test model outputs equivalence (#6445)
2020-08-13 11:59:35 -04:00
test_modeling_ctrl.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_distilbert.py
cleanup torch unittests (#6196)
2020-08-04 02:42:56 -04:00
test_modeling_dpr.py
cleanup torch unittests (#6196)
2020-08-04 02:42:56 -04:00
test_modeling_electra.py
Add a script to check all models are tested and documented (#6298)
2020-08-07 09:18:37 -04:00
test_modeling_encoder_decoder.py
[EncoderDecoder] Add Cross Attention for GPT2 (#6415)
2020-08-14 09:43:29 +02:00
test_modeling_flaubert.py
cleanup torch unittests (#6196)
2020-08-04 02:42:56 -04:00
test_modeling_gpt2.py
[EncoderDecoder] Add Cross Attention for GPT2 (#6415)
2020-08-14 09:43:29 +02:00
test_modeling_longformer.py
TF Longformer (#5764)
2020-08-10 23:25:06 +02:00
test_modeling_marian.py
rename prepare_translation_batch -> prepare_seq2seq_batch (#6103)
2020-08-11 15:57:07 -04:00
test_modeling_mbart.py
MBartForConditionalGeneration (#6441)
2020-08-14 03:21:16 -04:00
test_modeling_mobilebert.py
cleanup torch unittests (#6196)
2020-08-04 02:42:56 -04:00
test_modeling_openai.py
cleanup torch unittests (#6196)
2020-08-04 02:42:56 -04:00
test_modeling_pegasus.py
PegasusForConditionalGeneration (torch version) (#6340)
2020-08-11 14:31:23 -04:00
test_modeling_reformer.py
Feed forward chunking (#6024)
2020-08-11 03:12:45 -04:00
test_modeling_roberta.py
[EncoderDecoder] Add encoder-decoder for roberta/ vanilla longformer (#6411)
2020-08-12 18:23:30 +02:00
test_modeling_t5.py
Test model outputs equivalence (#6445)
2020-08-13 11:59:35 -04:00
test_modeling_tf_albert.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_auto.py
[Almost all TF models] TF clean up: add missing CLM / MLM loss; fix T5 naming and keras compile (#5395)
2020-07-07 18:15:53 +02:00
test_modeling_tf_bert.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_camembert.py
Tf model outputs (#6247)
2020-08-05 11:34:39 -04:00
test_modeling_tf_common.py
Test model outputs equivalence (#6445)
2020-08-13 11:59:35 -04:00
test_modeling_tf_ctrl.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_distilbert.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_electra.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_flaubert.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_gpt2.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_longformer.py
TF Longformer (#5764)
2020-08-10 23:25:06 +02:00
test_modeling_tf_mobilebert.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_openai.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_roberta.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_t5.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_transfo_xl.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_xlm_roberta.py
Tf model outputs (#6247)
2020-08-05 11:34:39 -04:00
test_modeling_tf_xlm.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_tf_xlnet.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_transfo_xl.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_modeling_xlm_roberta.py
Model output test (#6155)
2020-07-31 09:44:37 -04:00
test_modeling_xlm.py
cleanup torch unittests (#6196)
2020-08-04 02:42:56 -04:00
test_modeling_xlnet.py
cleanup tf unittests: part 2 (#6260)
2020-08-13 04:29:06 -04:00
test_onnx.py
Added capability to quantize a model while exporting through ONNX. (#6089)
2020-07-29 13:21:29 +02:00
test_optimization_tf.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_optimization.py
lr_schedulers: add get_polynomial_decay_schedule_with_warmup (#6361)
2020-08-11 17:56:41 -04:00
test_pipelines.py
add targets arg to fill-mask pipeline (#6239)
2020-08-12 12:48:29 -04:00
test_tokenization_albert.py
[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)
2020-06-15 17:12:51 -04:00
test_tokenization_auto.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_bert_japanese.py
Support additional dictionaries for BERT Japanese tokenizers (#6515)
2020-08-17 12:00:23 +08:00
test_tokenization_bert.py
Add strip_accents to basic BertTokenizer. (#6280)
2020-08-06 18:52:28 +08:00
test_tokenization_common.py
rename prepare_translation_batch -> prepare_seq2seq_batch (#6103)
2020-08-11 15:57:07 -04:00
test_tokenization_ctrl.py
[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)
2020-06-15 17:12:51 -04:00
test_tokenization_distilbert.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_dpr.py
Fix tests imports dpr (#5576)
2020-07-07 16:35:12 +02:00
test_tokenization_fast.py
Various tokenizers fixes (#5558)
2020-07-06 18:27:53 -04:00
test_tokenization_gpt2.py
[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)
2020-06-15 17:12:51 -04:00
test_tokenization_marian.py
rename prepare_translation_batch -> prepare_seq2seq_batch (#6103)
2020-08-11 15:57:07 -04:00
test_tokenization_mbart.py
rename prepare_translation_batch -> prepare_seq2seq_batch (#6103)
2020-08-11 15:57:07 -04:00
test_tokenization_openai.py
[HUGE] Refactoring tokenizers backend - padding - truncation - pre-tokenized pipeline - fast tokenizers - tests (#4510)
2020-06-15 17:12:51 -04:00
test_tokenization_pegasus.py
PegasusForConditionalGeneration (torch version) (#6340)
2020-08-11 14:31:23 -04:00
test_tokenization_roberta.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_t5.py
[cleanup] test_tokenization_common.py (#4390)
2020-05-19 10:46:55 -04:00
test_tokenization_transfo_xl.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_utils.py
Fixes to make life easier with the nlp library (#6423)
2020-08-12 08:00:56 -04:00
test_tokenization_xlm_roberta.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_xlm.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_tokenization_xlnet.py
Move tests/utils.py -> transformers/testing_utils.py (#5350)
2020-07-01 10:31:17 -04:00
test_trainer_distributed.py
[Tokenization] Fix #5181 - make #5155 more explicit - move back the default logging level in tests to WARNING (#5252)
2020-06-25 17:24:28 +02:00
test_trainer.py
Trainer support for iterabledataset (#5834)
2020-07-20 09:07:37 -04:00