SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
408b2d2bd08f667cf4154730cc323c4e49657eed
HuggingFace_transformer/tests
History
NielsRogge 408b2d2bd0 Add TrOCR + VisionEncoderDecoderModel (#13874) 
* First draft

* Update self-attention of RoBERTa as proposition

* Improve conversion script

* Add TrOCR decoder-only model

* More improvements

* Make forward pass with pretrained weights work

* More improvements

* Some more improvements

* More improvements

* Make conversion work

* Clean up print statements

* Add documentation, processor

* Add test files

* Small improvements

* Some more improvements

* Make fix-copies, improve docs

* Make all vision encoder decoder model tests pass

* Make conversion script support other models

* Update URL for OCR image

* Update conversion script

* Fix style & quality

* Add support for the large-printed model

* Fix some issues

* Add print statement for debugging

* Add print statements for debugging

* Make possible fix for sinusoidal embedding

* Further debugging

* Potential fix v2

* Add more print statements for debugging

* Add more print statements for debugging

* Deubg more

* Comment out print statements

* Make conversion of large printed model possible, address review comments

* Make it possible to convert the stage1 checkpoints

* Clean up code, apply suggestions from code review

* Apply suggestions from code review, use Microsoft models in tests

* Rename encoder_hidden_size to cross_attention_hidden_size

* Improve docs
2021-10-13 10:28:56 +02:00
..
deepspeed
Use DS callable API to allow hf_scheduler + ds_optimizer (#13216)
2021-08-30 10:01:06 -07:00
extended
[trainer] sanity checks for save_steps=0|None and logging_steps=0 (#12796)
2021-07-20 09:05:26 -07:00
fixtures
[AutoTokenizer] Allow creation of tokenizers by tokenizer type (#13668)
2021-09-22 00:29:38 +02:00
sagemaker
SageMaker: Fix sagemaker DDP & metric logs (#13181)
2021-08-23 10:18:07 +02:00
__init__.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
conftest.py
Only test the files impacted by changes in the diff (#12644)
2021-07-14 10:56:55 -04:00
test_activations_tf.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_activations.py
Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027)
2021-06-08 13:58:38 +01:00
test_benchmark_tf.py
Fix from_pretrained with corrupted state_dict (#12939)
2021-08-04 11:48:39 +02:00
test_benchmark.py
Fix from_pretrained with corrupted state_dict (#12939)
2021-08-04 11:48:39 +02:00
test_cli.py
Replace assert with unittest assertions (#13957)
2021-10-11 10:21:46 -04:00
test_configuration_auto.py
Typo "UNKWOWN" -> "UNKNOWN" (#13675)
2021-09-21 09:11:26 -04:00
test_configuration_common.py
Update model configs - Allow setters for common properties (#13026)
2021-09-06 16:30:13 +02:00
test_data_collator.py
TF/Numpy variants for all DataCollator classes (#13105)
2021-08-31 13:06:48 +01:00
test_doc_samples.py
Fix ignore list behavior in doctests (#8213)
2020-11-02 08:47:37 -05:00
test_feature_extraction_auto.py
[AutoFeatureExtractor] Fix loading of local folders if config.json exists (#13166)
2021-08-18 16:18:13 +02:00
test_feature_extraction_beit.py
Add BEiT (#12994)
2021-08-04 18:29:23 +02:00
test_feature_extraction_clip.py
CLIP (#11445)
2021-05-12 13:48:15 +05:30
test_feature_extraction_common.py
Add DETR (#11653)
2021-06-09 11:51:13 -04:00
test_feature_extraction_deit.py
Add DETR (#11653)
2021-06-09 11:51:13 -04:00
test_feature_extraction_detr.py
Rename detr targets to labels (#12280)
2021-06-29 03:07:46 -04:00
test_feature_extraction_layoutlmv2.py
Add LayoutLMv2 + LayoutXLM (#12604)
2021-08-30 12:35:42 +02:00
test_feature_extraction_speech_to_text.py
[Wav2Vec2FeatureExtractor] Fix extractor.pad() dtype backwards compatibility (#13693)
2021-09-22 11:02:54 +02:00
test_feature_extraction_vit.py
Add DETR (#11653)
2021-06-09 11:51:13 -04:00
test_feature_extraction_wav2vec2.py
[Wav2Vec2FeatureExtractor] Fix extractor.pad() dtype backwards compatibility (#13693)
2021-09-22 11:02:54 +02:00
test_file_utils.py
Typo "UNKWOWN" -> "UNKNOWN" (#13675)
2021-09-21 09:11:26 -04:00
test_flax_auto.py
[ci, flax] non-existing models are unlikely to pass tests (#10409)
2021-02-26 12:35:36 +03:00
test_generation_beam_search.py
Remove max length beam scorer (#11378)
2021-04-27 00:28:40 +02:00
test_generation_flax_logits_process.py
[Flax] Add Beam Search (#12131)
2021-06-16 09:43:54 +01:00
test_generation_flax_utils.py
[Flax Generation] Correct inconsistencies PyTorch/Flax (#12662)
2021-07-13 18:53:30 +01:00
test_generation_logits_process.py
[style] consistent nn. and nn.functional: part 3 tests (#12155)
2021-06-14 12:18:22 -07:00
test_generation_stopping_criteria.py
Adding new argument max_new_tokens for generate. (#11476)
2021-05-27 14:22:58 +02:00
test_generation_utils.py
[Generation] Fix max_new_tokens (#13919)
2021-10-08 17:28:18 +02:00
test_hf_argparser.py
Update no_* argument (HfArgumentParser) (#13865)
2021-10-04 16:28:52 -04:00
test_image_utils.py
Add center_crop to ImageFeatureExtractoMixin (#11066)
2021-04-05 15:28:51 -04:00
test_logging.py
fix: The 'warn' method is deprecated (#11105)
2021-04-07 09:20:06 -04:00
test_model_card.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_model_output.py
Fix ModelOutput instantiation form dictionaries (#13067)
2021-08-10 12:20:04 +02:00
test_modeling_albert.py
Initial support for symbolic tracing with torch.fx allowing dynamic axes (#13579)
2021-10-05 14:19:47 +02:00
test_modeling_auto.py
Typo "UNKWOWN" -> "UNKNOWN" (#13675)
2021-09-21 09:11:26 -04:00
test_modeling_bart.py
Moving question_answering tests to the new testing scheme. Had to tweak a little some ModelTesterConfig for pipelines. (#13277)
2021-08-26 12:37:55 +02:00
test_modeling_beit.py
Make gradient_checkpointing a training argument (#13657)
2021-09-22 07:51:38 -04:00
test_modeling_bert_generation.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_bert.py
Initial support for symbolic tracing with torch.fx allowing dynamic axes (#13579)
2021-10-05 14:19:47 +02:00
test_modeling_big_bird.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_bigbird_pegasus.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_blenderbot_small.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_blenderbot.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_bort.py
ADD BORT (#9813)
2021-01-27 21:25:11 +03:00
test_modeling_camembert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_canine.py
Replace nielsr by google namespace in tests (#12453)
2021-08-04 03:29:34 -04:00
test_modeling_clip.py
[CLIP] fix logit_scale init (#13436)
2021-09-08 14:21:13 +05:30
test_modeling_common.py
[Gradient checkpoining] Correct disabling find_unused_parameters in Trainer when gradient checkpointing is enabled (#13961)
2021-10-11 15:34:01 +02:00
test_modeling_convbert.py
Fix torchscript tests (#13701)
2021-09-22 19:02:54 -04:00
test_modeling_ctrl.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_deberta_v2.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_deberta.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_deit.py
Make gradient_checkpointing a training argument (#13657)
2021-09-22 07:51:38 -04:00
test_modeling_detr.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_distilbert.py
Initial support for symbolic tracing with torch.fx allowing dynamic axes (#13579)
2021-10-05 14:19:47 +02:00
test_modeling_dpr.py
[DPR] Correct init (#13796)
2021-09-30 18:55:20 +02:00
test_modeling_electra.py
Initial support for symbolic tracing with torch.fx allowing dynamic axes (#13579)
2021-10-05 14:19:47 +02:00
test_modeling_encoder_decoder.py
up (#13448)
2021-09-06 16:09:24 +02:00
test_modeling_flaubert.py
Fix torchscript tests (#13701)
2021-09-22 19:02:54 -04:00
test_modeling_flax_albert.py
albert flax (#13294)
2021-08-30 17:29:27 +02:00
test_modeling_flax_bart.py
[Flax] Correct all return tensors to numpy (#13307)
2021-08-27 17:38:34 +02:00
test_modeling_flax_beit.py
finish (#13743)
2021-09-25 21:20:21 +02:00
test_modeling_flax_bert.py
Add support for multiple models for one config in auto classes (#11150)
2021-04-08 18:41:36 -04:00
test_modeling_flax_big_bird.py
[Flax/JAX] Run jitted tests at every commit (#13090)
2021-08-12 14:49:46 +02:00
test_modeling_flax_clip.py
[Flax/JAX] Run jitted tests at every commit (#13090)
2021-08-12 14:49:46 +02:00
test_modeling_flax_common.py
[Flax/JAX] Run jitted tests at every commit (#13090)
2021-08-12 14:49:46 +02:00
test_modeling_flax_distilbert.py
distilbert-flax (#13324)
2021-08-30 14:16:18 +02:00
test_modeling_flax_electra.py
[Flax] Add Electra models (#11426)
2021-05-04 20:56:09 +02:00
test_modeling_flax_encoder_decoder.py
Make Flax GPT2 working with cross attention (#13008)
2021-08-23 17:57:29 +02:00
test_modeling_flax_gpt2.py
Make gradient_checkpointing a training argument (#13657)
2021-09-22 07:51:38 -04:00
test_modeling_flax_gpt_neo.py
Make gradient_checkpointing a training argument (#13657)
2021-09-22 07:51:38 -04:00
test_modeling_flax_marian.py
[Flax Generation] Correct inconsistencies PyTorch/Flax (#12662)
2021-07-13 18:53:30 +01:00
test_modeling_flax_mbart.py
[Flax] Add FlaxMBart (#12236)
2021-07-07 12:20:38 +05:30
test_modeling_flax_mt5.py
Add require flax to test (#13260)
2021-08-25 12:56:25 -04:00
test_modeling_flax_pegasus.py
[Flax] Addition of FlaxPegasus (#13420)
2021-09-14 17:15:19 +02:00
test_modeling_flax_roberta.py
[FlaxRoberta] Add FlaxRobertaModels & adapt run_mlm_flax.py (#11470)
2021-05-04 19:57:59 +02:00
test_modeling_flax_t5.py
[Flax] Correct pt to flax conversion if from base to head (#13006)
2021-08-05 18:38:50 +02:00
test_modeling_flax_vit.py
[Flax/JAX] Run jitted tests at every commit (#13090)
2021-08-12 14:49:46 +02:00
test_modeling_flax_wav2vec2.py
up (#13688)
2021-09-22 00:28:43 +02:00
test_modeling_fnet.py
Add FNet (#13045)
2021-09-20 13:24:30 +02:00
test_modeling_fsmt.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_funnel.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_gpt2.py
Add Mistral GPT-2 Stability Tweaks (#13573)
2021-10-04 07:37:09 -04:00
test_modeling_gpt_neo.py
Make gradient_checkpointing a training argument (#13657)
2021-09-22 07:51:38 -04:00
test_modeling_gptj.py
skip gptj slow generate tests for now (#13809)
2021-09-30 15:44:33 -04:00
test_modeling_hubert.py
[Speech Examples] Add pytorch speech pretraining (#13877)
2021-10-12 00:46:32 +02:00
test_modeling_ibert.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_layoutlm.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_layoutlmv2.py
Add LayoutLMv2 + LayoutXLM (#12604)
2021-08-30 12:35:42 +02:00
test_modeling_led.py
Fix incorrect output shapes for TF/PT LED (#13882)
2021-10-07 17:30:15 +01:00
test_modeling_longformer.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_luke.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_lxmert.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_m2m_100.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_marian.py
Rely on huggingface_hub for common tools (#13100)
2021-08-12 14:59:02 +02:00
test_modeling_mbart.py
Improving pipeline tests (#12784)
2021-07-22 15:19:35 +02:00
test_modeling_megatron_bert.py
Initial support for symbolic tracing with torch.fx allowing dynamic axes (#13579)
2021-10-05 14:19:47 +02:00
test_modeling_megatron_gpt2.py
Skip test while the model is not available (#12740)
2021-07-15 09:14:12 -04:00
test_modeling_mobilebert.py
Initial support for symbolic tracing with torch.fx allowing dynamic axes (#13579)
2021-10-05 14:19:47 +02:00
test_modeling_mpnet.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_mt5.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_openai.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_pegasus.py
[Pretrained Model] Add resize_position_embeddings (#13559)
2021-09-15 19:03:56 +02:00
test_modeling_prophetnet.py
Skip ProphetNet test (#12462)
2021-08-04 18:24:54 +02:00
test_modeling_rag.py
correct (#13304)
2021-08-30 06:02:08 -04:00
test_modeling_reformer.py
Fixing question-answering with long contexts (#13873)
2021-10-05 16:08:58 +02:00
test_modeling_rembert.py
Add RemBERT model code to huggingface (#10692)
2021-07-24 11:31:42 -04:00
test_modeling_roberta.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_roformer.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_speech_encoder_decoder.py
Fix scheduled tests for SpeechEncoderDecoderModel (#13422)
2021-09-06 14:55:13 +02:00
test_modeling_speech_to_text_2.py
Add SpeechEncoderDecoder & Speech2Text2 (#13186)
2021-09-01 13:33:31 +02:00
test_modeling_speech_to_text.py
[SequenceFeatureExtractor] Rewrite padding logic from pure python to numpy (#13650)
2021-09-21 17:10:13 +03:00
test_modeling_splinter.py
Add splinter (#12955)
2021-08-17 08:29:01 -04:00
test_modeling_squeezebert.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_t5.py
Moving feature-extraction pipeline to new testing scheme (#12843)
2021-07-29 19:35:55 +02:00
test_modeling_tapas.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_tf_albert.py
Add support for multiple models for one config in auto classes (#11150)
2021-04-08 18:41:36 -04:00
test_modeling_tf_auto.py
Typo "UNKWOWN" -> "UNKNOWN" (#13675)
2021-09-21 09:11:26 -04:00
test_modeling_tf_bart.py
TF BART models - Add cross_attentions to model output and fix cross-attention head masking (#10699)
2021-04-26 14:16:21 +02:00
test_modeling_tf_bert.py
Add TFEncoderDecoderModel + Add cross-attention to some TF models (#13222)
2021-10-13 00:10:34 +02:00
test_modeling_tf_blenderbot_small.py
TF BART models - Add cross_attentions to model output and fix cross-attention head masking (#10699)
2021-04-26 14:16:21 +02:00
test_modeling_tf_blenderbot.py
TF BART models - Add cross_attentions to model output and fix cross-attention head masking (#10699)
2021-04-26 14:16:21 +02:00
test_modeling_tf_bort.py
ADD BORT (#9813)
2021-01-27 21:25:11 +03:00
test_modeling_tf_camembert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_tf_common.py
Add TFEncoderDecoderModel + Add cross-attention to some TF models (#13222)
2021-10-13 00:10:34 +02:00
test_modeling_tf_convbert.py
ConvBERT fix torch <> tf weights conversion (#10314)
2021-02-24 14:55:34 +03:00
test_modeling_tf_ctrl.py
Make TF CTRL compliant with XLA and AMP (#10209)
2021-02-17 18:54:15 +01:00
test_modeling_tf_deberta_v2.py
Deberta_v2 tf (#13120)
2021-08-31 06:32:47 -04:00
test_modeling_tf_deberta.py
Deberta tf (#12972)
2021-08-12 05:01:26 -04:00
test_modeling_tf_distilbert.py
Check TF ops for ONNX compliance (#10025)
2021-02-15 07:55:10 -05:00
test_modeling_tf_dpr.py
Check TF ops for ONNX compliance (#10025)
2021-02-15 07:55:10 -05:00
test_modeling_tf_electra.py
Check TF ops for ONNX compliance (#10025)
2021-02-15 07:55:10 -05:00
test_modeling_tf_encoder_decoder.py
Add TFEncoderDecoderModel + Add cross-attention to some TF models (#13222)
2021-10-13 00:10:34 +02:00
test_modeling_tf_flaubert.py
Making TF XLM-like models XLA and AMP compliant (#10211)
2021-02-17 18:02:48 +01:00
test_modeling_tf_funnel.py
Skip Funnel test
2021-05-05 12:38:01 +02:00
test_modeling_tf_gpt2.py
Making TF GPT2 compliant with XLA and AMP (#10230)
2021-02-18 09:36:01 +01:00
test_modeling_tf_hubert.py
Fix integration tests for TFWav2Vec2 and TFHubert
2021-09-08 19:51:51 +03:00
test_modeling_tf_layoutlm.py
Layout lm tf 2 (#10636)
2021-03-25 12:32:38 -04:00
test_modeling_tf_led.py
Fix usage of head masks by TF encoder-decoder models' generate() function (#11775)
2021-05-26 14:02:44 +01:00
test_modeling_tf_longformer.py
Making TF Longformer-like models compliant with AMP (#10233)
2021-02-22 15:41:56 +01:00
test_modeling_tf_lxmert.py
implementing tflxmertmodel integration test (#12497)
2021-07-06 11:44:47 -04:00
test_modeling_tf_marian.py
Skip TestMarian_MT_EN (#12649)
2021-07-12 09:11:32 -04:00
test_modeling_tf_mbart.py
TF BART models - Add cross_attentions to model output and fix cross-attention head masking (#10699)
2021-04-26 14:16:21 +02:00
test_modeling_tf_mobilebert.py
Making TF MobileBert model compliant with AMP (#10259)
2021-02-19 06:55:25 -05:00
test_modeling_tf_mpnet.py
Making TF MPNet model compliant with XLA (#10260)
2021-02-19 06:56:41 -05:00
test_modeling_tf_mt5.py
Adjust loss difference (#10669)
2021-03-12 09:09:46 +03:00
test_modeling_tf_openai.py
Making TF OpenAI GPT model compliant with AMP and XLA (#10261)
2021-02-19 09:33:25 -05:00
test_modeling_tf_pegasus.py
Moving feature-extraction pipeline to new testing scheme (#12843)
2021-07-29 19:35:55 +02:00
test_modeling_tf_pytorch.py
Typo "UNKWOWN" -> "UNKNOWN" (#13675)
2021-09-21 09:11:26 -04:00
test_modeling_tf_rag.py
make rag tests smaller (#10679)
2021-03-15 10:07:12 +03:00
test_modeling_tf_rembert.py
Add TFEncoderDecoderModel + Add cross-attention to some TF models (#13222)
2021-10-13 00:10:34 +02:00
test_modeling_tf_roberta.py
Add TFEncoderDecoderModel + Add cross-attention to some TF models (#13222)
2021-10-13 00:10:34 +02:00
test_modeling_tf_roformer.py
Add new model RoFormer (use rotary position embedding ) (#11684)
2021-05-20 08:00:34 -04:00
test_modeling_tf_t5.py
ByT5 model (#11971)
2021-06-01 19:07:37 +01:00
test_modeling_tf_transfo_xl.py
Fix transfo xl integration test (#12652)
2021-07-12 11:51:35 -04:00
test_modeling_tf_wav2vec2.py
Fix integration tests for TFWav2Vec2 and TFHubert
2021-09-08 19:51:51 +03:00
test_modeling_tf_xlm_roberta.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_tf_xlm.py
Making TF XLM-like models XLA and AMP compliant (#10211)
2021-02-17 18:02:48 +01:00
test_modeling_tf_xlnet.py
Check TF ops for ONNX compliance (#10025)
2021-02-15 07:55:10 -05:00
test_modeling_transfo_xl.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_trocr.py
Add TrOCR + VisionEncoderDecoderModel (#13874)
2021-10-13 10:28:56 +02:00
test_modeling_vision_encoder_decoder.py
Add TrOCR + VisionEncoderDecoderModel (#13874)
2021-10-13 10:28:56 +02:00
test_modeling_visual_bert.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_vit.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_wav2vec2.py
[Wav2Vec2] Make sure tensors are always bool for mask_indices (#13977)
2021-10-12 18:17:06 +02:00
test_modeling_xlm_prophetnet.py
Ci test tf super slow (#8007)
2020-10-30 10:25:48 -04:00
test_modeling_xlm_roberta.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_xlm.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_modeling_xlnet.py
Expose get_config() on ModelTesters (#12812)
2021-07-21 04:13:11 -04:00
test_offline.py
offline mode for firewalled envs (part 2) (#10569)
2021-03-08 08:52:20 -08:00
test_onnx_v2.py
Layoutlm onnx support (Issue #13300) (#13562)
2021-09-21 15:39:37 -04:00
test_onnx.py
Fixed: Better names for nlp variables in pipelines' tests and docs. (#11752)
2021-05-18 09:47:28 -04:00
test_optimization_tf.py
Use stable functions (#9369)
2021-01-05 03:58:26 -05:00
test_optimization.py
[style] consistent nn. and nn.functional: part 3 tests (#12155)
2021-06-14 12:18:22 -07:00
test_pipelines_audio_classification.py
Enabling automatic loading of tokenizer with pipeline for (#13376)
2021-09-02 05:37:42 -04:00
test_pipelines_automatic_speech_recognition.py
[SequenceFeatureExtractor] Rewrite padding logic from pure python to numpy (#13650)
2021-09-21 17:10:13 +03:00
test_pipelines_common.py
[Large PR] Entire rework of pipelines. (#13308)
2021-09-10 14:47:48 +02:00
test_pipelines_conversational.py
[Large PR] Entire rework of pipelines. (#13308)
2021-09-10 14:47:48 +02:00
test_pipelines_feature_extraction.py
Updated tiny distilbert models (#13631)
2021-09-17 15:35:34 -04:00
test_pipelines_fill_mask.py
fixing BC in fill-mask (wasn't tested in theses test suites (#13540)
2021-09-13 12:48:54 +02:00
test_pipelines_image_classification.py
Move image-classification pipeline to new testing (#13272)
2021-08-26 05:52:49 -04:00
test_pipelines_image_segmentation.py
Specify im-seg mask greyscole mode (#13974)
2021-10-12 16:26:18 +02:00
test_pipelines_object_detection.py
[Large PR] Entire rework of pipelines. (#13308)
2021-09-10 14:47:48 +02:00
test_pipelines_question_answering.py
Fixing question-answering with long contexts (#13873)
2021-10-05 16:08:58 +02:00
test_pipelines_summarization.py
Moving summarization pipeline to new testing format. (#13279)
2021-08-26 14:47:11 +02:00
test_pipelines_table_question_answering.py
Moving table-question-answering pipeline to new testing. (#13280)
2021-08-26 09:09:57 -04:00
test_pipelines_text2text_generation.py
Moving text2text-generation to new pipeline testing mecanism. (#13281)
2021-08-26 16:09:48 +02:00
test_pipelines_text_classification.py
Hotfixing master tests. (#13282)
2021-08-26 10:09:53 -04:00
test_pipelines_text_generation.py
Fixing empty prompts for text-generation when BOS exists. (#13859)
2021-10-05 13:46:10 +02:00
test_pipelines_token_classification.py
Fixing GPU for token-classification in a better way. (#13856)
2021-10-05 22:44:31 -04:00
test_pipelines_translation.py
[Large PR] Entire rework of pipelines. (#13308)
2021-09-10 14:47:48 +02:00
test_pipelines_zero_shot.py
Fixing Backward compatiblity for zero-shot (#13855)
2021-10-05 23:06:47 -04:00
test_processor_clip.py
CLIP (#11445)
2021-05-12 13:48:15 +05:30
test_processor_layoutlmv2.py
Add LayoutLMv2 + LayoutXLM (#12604)
2021-08-30 12:35:42 +02:00
test_processor_speech_to_text.py
Auto feature extractor (#11097)
2021-04-06 19:20:08 -04:00
test_processor_wav2vec2.py
Change how "additional_special_tokens" argument in the ".from_pretrained" method of the tokenizer is taken into account (#13056)
2021-08-23 14:35:18 +02:00
test_retrieval_rag.py
RAG-2nd2end-revamp (#11893)
2021-06-01 07:32:26 +01:00
test_sequence_feature_extraction_common.py
[SequenceFeatureExtractor] Rewrite padding logic from pure python to numpy (#13650)
2021-09-21 17:10:13 +03:00
test_skip_decorators.py
[testing] rename skip targets + docs (#7863)
2020-10-20 04:39:13 -04:00
test_tokenization_albert.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_tokenization_auto.py
[AutoTokenizer] Allow creation of tokenizers by tokenizer type (#13668)
2021-09-22 00:29:38 +02:00
test_tokenization_bart.py
Enforce string-formatting with f-strings (#10980)
2021-03-31 10:00:27 -04:00
test_tokenization_barthez.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_tokenization_bert_generation.py
Feature to use the PreTrainedTokenizerFast class as a stand-alone tokenizer (#11810)
2021-06-14 11:58:44 +02:00
test_tokenization_bert_japanese.py
Add tokenizers class mismatch detection between cls and checkpoint (#12619)
2021-07-17 15:52:21 +02:00
test_tokenization_bert.py
Enforce string-formatting with f-strings (#10980)
2021-03-31 10:00:27 -04:00
test_tokenization_bertweet.py
Feature to use the PreTrainedTokenizerFast class as a stand-alone tokenizer (#11810)
2021-06-14 11:58:44 +02:00
test_tokenization_big_bird.py
Patch BigBird tokenization test (#12653)
2021-07-13 02:53:06 -04:00
test_tokenization_blenderbot.py
[PyTorch Bart] Split Bart into different models (#9343)
2021-01-05 22:00:05 +01:00
test_tokenization_byt5.py
Fixing by correctly raising UnicodeDecodeError. (#13449)
2021-09-07 16:45:45 +02:00
test_tokenization_camembert.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_tokenization_canine.py
Fix special tokens not correctly tokenized (#13489)
2021-09-17 10:28:28 -04:00
test_tokenization_clip.py
Feature to use the PreTrainedTokenizerFast class as a stand-alone tokenizer (#11810)
2021-06-14 11:58:44 +02:00
test_tokenization_common.py
Honor existing attention mask in tokenzier.pad (#13926)
2021-10-11 09:12:09 -04:00
test_tokenization_cpm.py
Add a special tokenizer for CPM model (#11068)
2021-04-10 02:07:47 +08:00
test_tokenization_ctrl.py
Refactor prepare_seq2seq_batch (#9524)
2021-01-12 18:19:38 -05:00
test_tokenization_deberta_v2.py
fix deberta 2 tokenizer integration test (#12017)
2021-06-07 04:55:55 -04:00
test_tokenization_deberta.py
Implement Fast Tokenization for Deberta (#11387)
2021-04-30 08:08:15 -04:00
test_tokenization_distilbert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_dpr.py
[Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659)
2020-10-18 20:51:24 +02:00
test_tokenization_fast.py
Add versioning system to fast tokenizer files (#12713)
2021-07-21 08:24:36 -04:00
test_tokenization_fnet.py
up (#13729)
2021-09-24 08:57:49 -04:00
test_tokenization_fsmt.py
Feature to use the PreTrainedTokenizerFast class as a stand-alone tokenizer (#11810)
2021-06-14 11:58:44 +02:00
test_tokenization_funnel.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_tokenization_gpt2.py
Enforce string-formatting with f-strings (#10980)
2021-03-31 10:00:27 -04:00
test_tokenization_herbert.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_tokenization_layoutlm.py
make style (#11442)
2021-04-26 13:50:34 +02:00
test_tokenization_layoutlmv2.py
Add LayoutLMv2 + LayoutXLM (#12604)
2021-08-30 12:35:42 +02:00
test_tokenization_luke.py
Overwrite get_clean_sequence as this was causing a bottleneck (#13183)
2021-08-23 03:41:35 -04:00
test_tokenization_lxmert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_m2m_100.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_tokenization_marian.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_tokenization_mbart50.py
Fixing mbart50 with return_tensors argument too. (#13301)
2021-08-27 17:22:06 +02:00
test_tokenization_mbart.py
Moving translation pipeline to new testing scheme. (#13297)
2021-08-27 12:26:17 +02:00
test_tokenization_mpnet.py
[MPNet] Add slow to fast tokenizer converter (#9233)
2020-12-21 15:41:34 +01:00
test_tokenization_openai.py
Enforce string-formatting with f-strings (#10980)
2021-03-31 10:00:27 -04:00
test_tokenization_pegasus.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_tokenization_phobert.py
Feature to use the PreTrainedTokenizerFast class as a stand-alone tokenizer (#11810)
2021-06-14 11:58:44 +02:00
test_tokenization_prophetnet.py
Deprecate prepare_seq2seq_batch (#10287)
2021-02-22 12:36:16 -05:00
test_tokenization_rag.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_reformer.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_tokenization_roberta.py
Enforce string-formatting with f-strings (#10980)
2021-03-31 10:00:27 -04:00
test_tokenization_roformer.py
[RoFormer] Fix some issues (#12397)
2021-07-06 03:31:57 -04:00
test_tokenization_small_blenderbot.py
Feature to use the PreTrainedTokenizerFast class as a stand-alone tokenizer (#11810)
2021-06-14 11:58:44 +02:00
test_tokenization_speech_to_text_2.py
up (#13536)
2021-09-13 11:30:10 +02:00
test_tokenization_speech_to_text.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_tokenization_squeezebert.py
[Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659)
2020-10-18 20:51:24 +02:00
test_tokenization_t5.py
Change how "additional_special_tokens" argument in the ".from_pretrained" method of the tokenizer is taken into account (#13056)
2021-08-23 14:35:18 +02:00
test_tokenization_tapas.py
Add min and max question length options to TapasTokenizer (#12803)
2021-08-23 03:44:42 -04:00
test_tokenization_transfo_xl.py
Refactor prepare_seq2seq_batch (#9524)
2021-01-12 18:19:38 -05:00
test_tokenization_utils.py
Patch recursive import (#11812)
2021-05-21 06:50:01 -04:00
test_tokenization_wav2vec2.py
**encode_plus() shouldn't run for W2V2CTC (#12655)
2021-07-13 06:31:56 -04:00
test_tokenization_xlm_prophetnet.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_tokenization_xlm_roberta.py
XLMR tokenizer is fully picklable (#13577)
2021-09-16 16:30:05 -04:00
test_tokenization_xlm.py
make style (#11442)
2021-04-26 13:50:34 +02:00
test_tokenization_xlnet.py
Add regression tests for slow sentencepiece tokenizers. (#11737)
2021-06-01 09:24:39 -04:00
test_trainer_callback.py
Proper import for unittest.mock.patch (#13085)
2021-08-12 11:23:00 +02:00
test_trainer_distributed.py
Update namespaces inside torch.utils.data to the latest. (#13167)
2021-08-19 14:29:51 +02:00
test_trainer_seq2seq.py
fix bert2bert test (#10063)
2021-02-08 16:04:28 +03:00
test_trainer_tpu.py
Update namespaces inside torch.utils.data to the latest. (#13167)
2021-08-19 14:29:51 +02:00
test_trainer_utils.py
Allow dataset to be an optional argument for (Distributed)LengthGroupedSampler (#13820)
2021-10-05 09:04:39 -04:00
test_trainer.py
Add SigOpt HPO to transformers trainer api (#13572)
2021-09-23 17:01:51 +02:00
test_utils_check_copies.py
Enable readme link synchronization (#13785)
2021-09-29 11:18:59 -04:00
test_versions_utils.py
rm require_version_examples (#12088)
2021-06-09 11:02:52 -07:00