SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
65a89a89768f5922e51cdc7d49990d731e3f2c03
HuggingFace_transformer/tests
History
Mark Neumann 65a89a8976 Fix BasicTokenizer to respect never_split parameters (#2557) 
* add failing test

* fix call to _run_split_on_punc

* format with black
2020-01-17 14:57:56 -05:00
..
fixtures
AutoConfig + other Auto classes honor model_type
2020-01-11 02:46:17 +00:00
__init__.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_configuration_auto.py
Map configs to models and tokenizers
2020-01-13 23:11:44 +00:00
test_configuration_common.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_hf_api.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_model_card.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_albert.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_auto.py
More AutoConfig tests
2020-01-11 03:43:57 +00:00
test_modeling_bert.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_common.py
Fix failing torchscript test for xlnet
2020-01-15 20:22:21 -05:00
test_modeling_ctrl.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_distilbert.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_encoder_decoder.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_gpt2.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_openai.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_roberta.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_t5.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_albert.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_auto.py
More AutoConfig tests
2020-01-11 03:43:57 +00:00
test_modeling_tf_bert.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_common.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_ctrl.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_distilbert.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_gpt2.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_openai_gpt.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_roberta.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_t5.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_transfo_xl.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_xlm.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_tf_xlnet.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_transfo_xl.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_xlm.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_xlnet.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_optimization_tf.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_optimization.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_pipelines.py
Graduate sst-2 to a canonical one
2020-01-15 16:28:50 +00:00
test_tokenization_albert.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_auto.py
Tokenizer.from_pretrained: fetch all possible files remotely
2020-01-16 16:47:19 -05:00
test_tokenization_bert_japanese.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_bert.py
Fix BasicTokenizer to respect never_split parameters (#2557)
2020-01-17 14:57:56 -05:00
test_tokenization_common.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_tokenization_ctrl.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_distilbert.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_tokenization_gpt2.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_openai.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_roberta.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_t5.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_transfo_xl.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_utils.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_tokenization_xlm.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_xlnet.py
💄 super
2020-01-15 18:33:50 -05:00
utils.py
More AutoConfig tests
2020-01-11 03:43:57 +00:00