SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
18d233d52588b4e08dc785fbfecd77529e9effa6
HuggingFace_transformer/tests
History
Lorenzo Ampil 18d233d525 Allow the creation of "entity groups" for NerPipeline #3548 (#3957) 
* Add index to be returned by NerPipeline to allow for the creation of

* Add entity groups

* Convert entity list to dict

* Add entity to entity_group_disagg atfter updating entity gorups

* Change 'group' parameter to 'grouped_entities'

* Add unit tests for grouped NER pipeline case

* Correct variable name typo for NER_FINETUNED_MODELS

* Sync grouped tests to recent test updates
2020-05-17 09:25:17 +02:00
..
fixtures
BIG Reorganize examples (#4213)
2020-05-07 13:48:44 -04:00
__init__.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_activations.py
Reformer (#3351)
2020-05-07 10:17:01 +02:00
test_configuration_auto.py
Map configs to models and tokenizers
2020-01-13 23:11:44 +00:00
test_configuration_common.py
Pass kwargs to configuration (#3147)
2020-03-05 17:16:57 -05:00
test_doc_samples.py
make style
2020-03-04 20:18:07 -05:00
test_hf_api.py
[cli] {login, upload, s3} display more helpful error messages
2020-04-30 12:51:06 -04:00
test_hf_argparser.py
Trainer (#3800)
2020-04-21 20:11:56 -04:00
test_model_card.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_modeling_albert.py
Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057)
2020-05-07 19:44:51 -04:00
test_modeling_auto.py
Add missing token classification for XLM (#3277)
2020-03-26 10:22:13 -04:00
test_modeling_bart.py
Fix BART tests on GPU (#4298)
2020-05-12 09:11:50 -04:00
test_modeling_bert.py
[EncoderDecoder Tests] Improve tests (#4046)
2020-05-04 02:18:36 +02:00
test_modeling_camembert.py
Add camembert integration tests (#3375)
2020-03-24 10:18:37 +01:00
test_modeling_common.py
Reformer (#3351)
2020-05-07 10:17:01 +02:00
test_modeling_ctrl.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_distilbert.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_electra.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_encoder_decoder.py
[EncoderDecoder Tests] Improve tests (#4046)
2020-05-04 02:18:36 +02:00
test_modeling_flaubert.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_gpt2.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_marian.py
[Marian Fixes] prevent predicting pad_token_id before softmax, support language codes, name multilingual models (#4290)
2020-05-13 17:29:41 -04:00
test_modeling_openai.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_reformer.py
Reformer (#3351)
2020-05-07 10:17:01 +02:00
test_modeling_roberta.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_t5.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_albert.py
Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057)
2020-05-07 19:44:51 -04:00
test_modeling_tf_auto.py
Add AutoModelForPreTraining
2020-01-27 14:27:07 -05:00
test_modeling_tf_bert.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_camembert.py
Add camembert integration tests (#3375)
2020-03-24 10:18:37 +01:00
test_modeling_tf_common.py
[Config, Caching] Remove output_past everywhere and replace by use_cache argument (#3734)
2020-04-14 14:40:28 -04:00
test_modeling_tf_ctrl.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_distilbert.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_electra.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_gpt2.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_openai_gpt.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_roberta.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_t5.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_transfo_xl.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_xlm.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_tf_xlnet.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_transfo_xl.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_xlm_roberta.py
[ci] Re-run integration ground truth from fairseq
2020-03-03 15:31:40 -05:00
test_modeling_xlm.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_modeling_xlnet.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00
test_onnx.py
Conversion script to export transformers models to ONNX IR. (#4253)
2020-05-14 16:35:52 -04:00
test_optimization_tf.py
TF version of the trainer (#4017)
2020-05-06 12:56:52 -04:00
test_optimization.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_pipelines.py
Allow the creation of "entity groups" for NerPipeline #3548 (#3957)
2020-05-17 09:25:17 +02:00
test_tokenization_albert.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_auto.py
Test correct tokenizers after default switch (#3003)
2020-02-24 18:45:53 -05:00
test_tokenization_bert_japanese.py
BertJapaneseTokenizer accept options for mecab (#3566)
2020-04-03 11:12:19 -04:00
test_tokenization_bert.py
Tokenizers v3.0.0 (#3185)
2020-04-07 00:29:15 +02:00
test_tokenization_common.py
Fix: unpin flake8 and fix cs errors (#4367)
2020-05-14 13:14:26 -04:00
test_tokenization_ctrl.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_distilbert.py
Updating the TensorFlow models to work as expected with tokenizers v3.0.0 (#3684)
2020-04-08 16:22:44 -04:00
test_tokenization_fast.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
test_tokenization_gpt2.py
Tokenizers v3.0.0 (#3185)
2020-04-07 00:29:15 +02:00
test_tokenization_openai.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_roberta.py
Preserve spaces in GPT-2 tokenizers (#2778)
2020-02-13 13:29:43 -05:00
test_tokenization_t5.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_transfo_xl.py
💄 super
2020-01-15 18:33:50 -05:00
test_tokenization_utils.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_tokenization_xlm_roberta.py
XLM-R Tokenizer now passes common tests + Integration tests (#3198)
2020-03-18 09:52:49 -04:00
test_tokenization_xlm.py
XLM tokenizer should encode with bos token (#3791)
2020-04-17 11:28:55 -04:00
test_tokenization_xlnet.py
💄 super
2020-01-15 18:33:50 -05:00
test_trainer.py
(v2) Improvements to the wandb integration (#4324)
2020-05-12 21:52:01 -04:00
utils.py
[ci] Load pretrained models into the default (long-lived) cache
2020-04-30 22:30:15 -04:00