SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
14042d560ff85a0749610d81669faa0409e6e73b
HuggingFace_transformer/tests
History
Julien Plu 14042d560f New TF embeddings (cleaner and faster) (#9418) 
* Create new embeddings + add to BERT

* Add Albert

* Add DistilBert

* Add Albert + Electra + Funnel

* Add Longformer + Lxmert

* Add last models

* Apply style

* Update the template

* Remove unused imports

* Rename attribute

* Import embeddings in their own model file

* Replace word_embeddings per weight

* fix naming

* Fix Albert

* Fix Albert

* Fix Longformer

* Fix Lxmert Mobilebert and MPNet

* Fix copy

* Fix template

* Update the get weights function

* Update src/transformers/modeling_tf_utils.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update src/transformers/models/electra/modeling_tf_electra.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* address Sylvain's comments

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2021-01-20 12:08:12 +01:00
..
fixtures
New run_seq2seq script (#9605)
2021-01-19 15:22:17 -05:00
__init__.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
conftest.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_activations_tf.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_activations.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_benchmark_tf.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_benchmark.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_cli.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_configuration_auto.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_configuration_common.py
[PretrainedConfig] Fix save pretrained config for edge case (#7943)
2020-10-22 15:39:01 +02:00
test_data_collator.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_doc_samples.py
Fix ignore list behavior in doctests (#8213)
2020-11-02 08:47:37 -05:00
test_file_utils.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_flax_auto.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_generation_beam_search.py
Add flags to return scores, hidden states and / or attention weights in GenerationMixin (#9150)
2021-01-06 17:11:42 +01:00
test_generation_logits_process.py
Diverse beam search 2 (#9006)
2020-12-09 15:00:37 +01:00
test_generation_utils.py
[GenerationOutputs] Fix GenerationOutputs Tests (#9443)
2021-01-06 19:37:02 +01:00
test_hf_api.py
transformers-cli: LFS multipart uploads (> 5GB) (#8663)
2020-12-07 16:38:39 -05:00
test_hf_argparser.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_logging.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_model_card.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
test_model_output.py
Add tests and fix various bugs in ModelOutput (#7073)
2020-09-11 12:01:33 -04:00
test_modeling_albert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_auto.py
LayoutLM Config (#9539)
2021-01-12 10:03:50 -05:00
test_modeling_bart.py
fix test (#9669)
2021-01-19 09:06:24 +01:00
test_modeling_bert_generation.py
Add caching mechanism to BERT, RoBERTa (#9183)
2020-12-23 23:01:32 +05:30
test_modeling_bert.py
Add caching mechanism to BERT, RoBERTa (#9183)
2020-12-23 23:01:32 +05:30
test_modeling_blenderbot_small.py
fix test (#9669)
2021-01-19 09:06:24 +01:00
test_modeling_blenderbot.py
fix test (#9669)
2021-01-19 09:06:24 +01:00
test_modeling_camembert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_common.py
fix test (#9669)
2021-01-19 09:06:24 +01:00
test_modeling_ctrl.py
Ctrl for sequence classification (#8812)
2020-12-01 09:49:27 +01:00
test_modeling_deberta.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_modeling_distilbert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_dpr.py
Fix DPRReaderTokenizer's attention_mask (#9663)
2021-01-19 05:43:11 -05:00
test_modeling_electra.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_encoder_decoder.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_modeling_flaubert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_flax_bert.py
[Flax] Align FlaxBertForMaskedLM with BertForMaskedLM, implement from_pretrained, init (#9054)
2020-12-16 13:03:32 +01:00
test_modeling_flax_common.py
[Flax] Align FlaxBertForMaskedLM with BertForMaskedLM, implement from_pretrained, init (#9054)
2020-12-16 13:03:32 +01:00
test_modeling_flax_roberta.py
[Flax] Align FlaxBertForMaskedLM with BertForMaskedLM, implement from_pretrained, init (#9054)
2020-12-16 13:03:32 +01:00
test_modeling_fsmt.py
[PyTorch] Refactor Resize Token Embeddings (#8880)
2020-12-02 19:19:50 +01:00
test_modeling_funnel.py
Switch return_dict to True by default. (#8530)
2020-11-16 11:43:00 -05:00
test_modeling_gpt2.py
Update past_key_values in GPT-2 (#9596)
2021-01-19 16:00:15 +01:00
test_modeling_layoutlm.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_modeling_led.py
[LED Test] fix common inputs pt for flaky pt-tf led test (#9459)
2021-01-07 12:29:03 +01:00
test_modeling_longformer.py
LED (#9278)
2021-01-05 13:14:30 +01:00
test_modeling_lxmert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_marian.py
fix test (#9669)
2021-01-19 09:06:24 +01:00
test_modeling_mbart.py
fix test (#9669)
2021-01-19 09:06:24 +01:00
test_modeling_mobilebert.py
Removed unused encoder_hidden_states and encoder_attention_mask (#8972)
2020-12-08 12:04:34 -05:00
test_modeling_mpnet.py
Add MP Net 2 (#9004)
2020-12-09 10:32:43 -05:00
test_modeling_mt5.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_openai.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_pegasus.py
fix test (#9669)
2021-01-19 09:06:24 +01:00
test_modeling_prophetnet.py
Make ProphetNetModel really compatible with EncoderDecoder (#9033)
2020-12-11 16:59:54 +01:00
test_modeling_rag.py
Proposed Fix : [RagSequenceForGeneration] generate "without" input_ids (#9220)
2020-12-24 13:38:00 +01:00
test_modeling_reformer.py
Add flags to return scores, hidden states and / or attention weights in GenerationMixin (#9150)
2021-01-06 17:11:42 +01:00
test_modeling_roberta.py
Add caching mechanism to BERT, RoBERTa (#9183)
2020-12-23 23:01:32 +05:30
test_modeling_squeezebert.py
Switch return_dict to True by default. (#8530)
2020-11-16 11:43:00 -05:00
test_modeling_t5.py
[EncoderDecoder] Make tests more aggressive (#9256)
2020-12-22 17:00:04 +01:00
test_modeling_tapas.py
Remove tolerance + drop_rows_to_fit by default (#9507)
2021-01-11 08:02:41 -05:00
test_modeling_tf_albert.py
Full rework of the TF input/output embeddings and bias resizing (#9193)
2021-01-11 06:27:28 -05:00
test_modeling_tf_auto.py
Optional layers (#8961)
2020-12-08 09:14:09 -05:00
test_modeling_tf_bart.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_modeling_tf_bert.py
Full rework of the TF input/output embeddings and bias resizing (#9193)
2021-01-11 06:27:28 -05:00
test_modeling_tf_blenderbot_small.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_modeling_tf_blenderbot.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_modeling_tf_camembert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_tf_common.py
New TF embeddings (cleaner and faster) (#9418)
2021-01-20 12:08:12 +01:00
test_modeling_tf_ctrl.py
Full rework of the TF input/output embeddings and bias resizing (#9193)
2021-01-11 06:27:28 -05:00
test_modeling_tf_distilbert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_tf_dpr.py
New serving (#9419)
2021-01-07 11:48:49 +01:00
test_modeling_tf_electra.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_tf_flaubert.py
Switch return_dict to True by default. (#8530)
2020-11-16 11:43:00 -05:00
test_modeling_tf_funnel.py
New serving (#9419)
2021-01-07 11:48:49 +01:00
test_modeling_tf_gpt2.py
Full rework of the TF input/output embeddings and bias resizing (#9193)
2021-01-11 06:27:28 -05:00
test_modeling_tf_led.py
fix tf led pt test (#9513)
2021-01-11 14:14:48 +01:00
test_modeling_tf_longformer.py
New serving (#9419)
2021-01-07 11:48:49 +01:00
test_modeling_tf_lxmert.py
Full rework of the TF input/output embeddings and bias resizing (#9193)
2021-01-11 06:27:28 -05:00
test_modeling_tf_marian.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_modeling_tf_mbart.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_modeling_tf_mobilebert.py
Full rework of the TF input/output embeddings and bias resizing (#9193)
2021-01-11 06:27:28 -05:00
test_modeling_tf_mpnet.py
Add MP Net 2 (#9004)
2020-12-09 10:32:43 -05:00
test_modeling_tf_mt5.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_tf_openai.py
Full rework of the TF input/output embeddings and bias resizing (#9193)
2021-01-11 06:27:28 -05:00
test_modeling_tf_pegasus.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_modeling_tf_pytorch.py
Optional layers (#8961)
2020-12-08 09:14:09 -05:00
test_modeling_tf_roberta.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_tf_t5.py
Full rework of the TF input/output embeddings and bias resizing (#9193)
2021-01-11 06:27:28 -05:00
test_modeling_tf_transfo_xl.py
Full rework of the TF input/output embeddings and bias resizing (#9193)
2021-01-11 06:27:28 -05:00
test_modeling_tf_xlm_roberta.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_tf_xlm.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_tf_xlnet.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_transfo_xl.py
Add flags to return scores, hidden states and / or attention weights in GenerationMixin (#9150)
2021-01-06 17:11:42 +01:00
test_modeling_xlm_prophetnet.py
Ci test tf super slow (#8007)
2020-10-30 10:25:48 -04:00
test_modeling_xlm_roberta.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_modeling_xlm.py
Add flags to return scores, hidden states and / or attention weights in GenerationMixin (#9150)
2021-01-06 17:11:42 +01:00
test_modeling_xlnet.py
Add flags to return scores, hidden states and / or attention weights in GenerationMixin (#9150)
2021-01-06 17:11:42 +01:00
test_onnx.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_optimization_tf.py
Use stable functions (#9369)
2021-01-05 03:58:26 -05:00
test_optimization.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_pipelines_common.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_pipelines_conversational.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_pipelines_feature_extraction.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_pipelines_fill_mask.py
topk -> top_k (#9541)
2021-01-12 16:21:29 -05:00
test_pipelines_ner.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_pipelines_question_answering.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_pipelines_sentiment_analysis.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_pipelines_summarization.py
Enable TruncationStrategy override for pipelines (#9432)
2021-01-11 09:23:28 -05:00
test_pipelines_table_question_answering.py
TableQuestionAnsweringPipeline (#9145)
2020-12-16 12:31:50 -05:00
test_pipelines_text2text_generation.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_pipelines_text_generation.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_pipelines_translation.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_pipelines_zero_shot.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_retrieval_rag.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_skip_decorators.py
[testing] rename skip targets + docs (#7863)
2020-10-20 04:39:13 -04:00
test_tokenization_albert.py
[Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659)
2020-10-18 20:51:24 +02:00
test_tokenization_auto.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_bart.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_barthez.py
Add barthez model (#8393)
2020-11-27 12:31:42 -05:00
test_tokenization_bert_generation.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_bert_japanese.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_bert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_bertweet.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_tokenization_blenderbot.py
[PyTorch Bart] Split Bart into different models (#9343)
2021-01-05 22:00:05 +01:00
test_tokenization_camembert.py
Fast transformers import part 1 (#9441)
2021-01-06 12:17:24 -05:00
test_tokenization_common.py
BatchEncoding.to with device with tests (#9584)
2021-01-14 07:57:58 -05:00
test_tokenization_ctrl.py
Refactor prepare_seq2seq_batch (#9524)
2021-01-12 18:19:38 -05:00
test_tokenization_deberta.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_distilbert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_dpr.py
[Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659)
2020-10-18 20:51:24 +02:00
test_tokenization_fsmt.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_funnel.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_tokenization_gpt2.py
Refactor prepare_seq2seq_batch (#9524)
2021-01-12 18:19:38 -05:00
test_tokenization_herbert.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_tokenization_layoutlm.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_lxmert.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_marian.py
Fast transformers import part 1 (#9441)
2021-01-06 12:17:24 -05:00
test_tokenization_mbart.py
Fast transformers import part 1 (#9441)
2021-01-06 12:17:24 -05:00
test_tokenization_mpnet.py
[MPNet] Add slow to fast tokenizer converter (#9233)
2020-12-21 15:41:34 +01:00
test_tokenization_openai.py
Refactor prepare_seq2seq_batch (#9524)
2021-01-12 18:19:38 -05:00
test_tokenization_pegasus.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_phobert.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_tokenization_prophetnet.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_tokenization_rag.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_reformer.py
Refactor prepare_seq2seq_batch (#9524)
2021-01-12 18:19:38 -05:00
test_tokenization_roberta.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_small_blenderbot.py
[PyTorch Bart] Split Bart into different models (#9343)
2021-01-05 22:00:05 +01:00
test_tokenization_squeezebert.py
[Dependencies|tokenizers] Make both SentencePiece and Tokenizers optional dependencies (#7659)
2020-10-18 20:51:24 +02:00
test_tokenization_t5.py
Fast transformers import part 1 (#9441)
2021-01-06 12:17:24 -05:00
test_tokenization_tapas.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_tokenization_transfo_xl.py
Refactor prepare_seq2seq_batch (#9524)
2021-01-12 18:19:38 -05:00
test_tokenization_utils.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_xlm_prophetnet.py
Reorganize repo (#8580)
2020-11-16 21:43:42 -05:00
test_tokenization_xlm_roberta.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_xlm.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_tokenization_xlnet.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_trainer_callback.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_trainer_distributed.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_trainer_seq2seq.py
Fix slow tests v4.2.0 (#9561)
2021-01-13 09:55:48 -05:00
test_trainer_tpu.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_trainer_utils.py
Upstream (and rename) sortish sampler (#9574)
2021-01-14 10:38:14 -05:00
test_trainer.py
Fix Trainer with a parallel model (#9578)
2021-01-14 03:23:41 -05:00
test_utils_check_copies.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00
test_versions_utils.py
Copyright (#8970)
2020-12-07 18:36:34 -05:00