SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
e2230ba77bbf68d9966458bbd0c66e15844ba456
HuggingFace_transformer/src/transformers
History
Simon Böhm e2230ba77b Fix BERT example code for NSP and Multiple Choice (#3953) 
Change the example code to use encode_plus since the token_type_id
wasn't being correctly set.
2020-05-29 11:55:55 -04:00
..
benchmark
[Benchmark] Memory benchmark utils (#4198)
2020-05-27 23:22:16 +02:00
commands
Make transformers-cli cross-platform (#4131)
2020-05-26 10:00:51 -04:00
data
Fix two bugs: 1. Index of test data of SST-2. 2. Label index of MNLI data. (#4546)
2020-05-29 11:12:24 -04:00
__init__.py
[Longformer] Multiple choice for longformer (#4645)
2020-05-29 13:46:08 +02:00
activations.py
Allow gpt2 to be exported to valid ONNX (#4244)
2020-05-11 14:55:55 -04:00
configuration_albert.py
[ALBERT] move things around for more consistent naming
2020-03-23 13:58:21 -04:00
configuration_auto.py
Longformer (#4352)
2020-05-19 16:04:43 +02:00
configuration_bart.py
MarianMTModel.from_pretrained('Helsinki-NLP/opus-marian-en-de') (#3908)
2020-04-28 18:22:37 -04:00
configuration_bert.py
CDN urls (#4030)
2020-04-28 20:27:14 -04:00
configuration_camembert.py
[Umberto] model shortcuts (#2661)
2020-01-30 21:05:53 -05:00
configuration_ctrl.py
💄 super
2020-01-15 18:33:50 -05:00
configuration_distilbert.py
[ci] fix 3 remaining slow GPU failures (#4584)
2020-05-25 19:20:50 -04:00
configuration_electra.py
ELECTRA (#3257)
2020-04-03 14:10:54 -04:00
configuration_encoder_decoder.py
add examples to doc (#4045)
2020-04-28 16:33:23 +02:00
configuration_flaubert.py
Clean special token init in modeling_....py (#3264)
2020-03-20 21:41:04 +01:00
configuration_gpt2.py
Clean special token init in modeling_....py (#3264)
2020-03-20 21:41:04 +01:00
configuration_longformer.py
[Longformer] more models + model cards (#4628)
2020-05-28 11:11:05 +02:00
configuration_marian.py
[Marian] documentation and AutoModel support (#4152)
2020-05-10 13:54:57 -04:00
configuration_mmbt.py
Updated Configurations
2020-01-14 14:09:09 +01:00
configuration_openai.py
Documentation (#2989)
2020-02-25 18:43:36 -05:00
configuration_reformer.py
[Reformer] fix reformer num buckets (#4564)
2020-05-25 16:04:45 -04:00
configuration_roberta.py
[skip ci] remove local rank
2020-05-15 17:08:38 -04:00
configuration_t5.py
improve docstring (#4422)
2020-05-18 11:31:35 -04:00
configuration_transfo_xl.py
Clean special token init in modeling_....py (#3264)
2020-03-20 21:41:04 +01:00
configuration_utils.py
Configs: saner num_labels in configs. (#3967)
2020-05-01 11:28:55 -04:00
configuration_xlm_roberta.py
PyTorch CTRL + Style
2020-01-23 09:38:45 -05:00
configuration_xlm.py
Clean special token init in modeling_....py (#3264)
2020-03-20 21:41:04 +01:00
configuration_xlnet.py
Clean special token init in modeling_....py (#3264)
2020-03-20 21:41:04 +01:00
convert_albert_original_tf_checkpoint_to_pytorch.py
Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057)
2020-05-07 19:44:51 -04:00
convert_bart_original_pytorch_checkpoint_to_pytorch.py
Multilingual BART - (#3602)
2020-04-10 11:25:39 -04:00
convert_bert_original_tf_checkpoint_to_pytorch.py
Remove __future__ imports.
2019-12-22 17:47:54 +01:00
convert_bert_pytorch_checkpoint_to_original_tf.py
GPU text generation: mMoved the encoded_prompt to correct device
2020-01-06 15:11:12 +01:00
convert_dialogpt_original_pytorch_checkpoint_to_pytorch.py
[dialogpt] conversion script
2020-03-10 15:09:29 -04:00
convert_electra_original_tf_checkpoint_to_pytorch.py
ELECTRA (#3257)
2020-04-03 14:10:54 -04:00
convert_gpt2_original_tf_checkpoint_to_pytorch.py
Use built-in open().
2019-12-22 18:38:56 +01:00
convert_graph_to_onnx.py
pass on tokenizer to pipeline (#4489)
2020-05-20 22:23:21 +02:00
convert_longformer_original_pytorch_lightning_to_pytorch.py
[Longformer For Question Answering] Conversion script, doc, small fixes (#4593)
2020-05-26 14:58:47 +02:00
convert_marian_to_pytorch.py
Fix: unpin flake8 and fix cs errors (#4367)
2020-05-14 13:14:26 -04:00
convert_openai_original_tf_checkpoint_to_pytorch.py
Use built-in open().
2019-12-22 18:38:56 +01:00
convert_pytorch_checkpoint_to_tf2.py
Add AlbertForPreTraining and TFAlbertForPreTraining models. (#4057)
2020-05-07 19:44:51 -04:00
convert_reformer_trax_checkpoint_to_pytorch.py
[Reformer] Add Enwiki8 Reformer Model - Adapt convert script (#4282)
2020-05-11 16:38:07 +02:00
convert_roberta_original_pytorch_checkpoint_to_pytorch.py
Fix roberta checkpoint conversion script (#3642)
2020-04-07 12:03:23 -04:00
convert_t5_original_tf_checkpoint_to_pytorch.py
Remove __future__ imports.
2019-12-22 17:47:54 +01:00
convert_transfo_xl_original_tf_checkpoint_to_pytorch.py
Use built-in open().
2019-12-22 18:38:56 +01:00
convert_xlm_original_pytorch_checkpoint_to_pytorch.py
Use built-in open().
2019-12-22 18:38:56 +01:00
convert_xlnet_original_tf_checkpoint_to_pytorch.py
Remove __future__ imports.
2019-12-22 17:47:54 +01:00
file_utils.py
[Benchmark] Memory benchmark utils (#4198)
2020-05-27 23:22:16 +02:00
hf_api.py
[model upload] Support for organizations
2020-03-09 17:33:57 -04:00
hf_argparser.py
[Benchmark] Memory benchmark utils (#4198)
2020-05-27 23:22:16 +02:00
modelcard.py
CDN urls (#4030)
2020-04-28 20:27:14 -04:00
modeling_albert.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_auto.py
[Longformer] Multiple choice for longformer (#4645)
2020-05-29 13:46:08 +02:00
modeling_bart.py
[Marian Fixes] prevent predicting pad_token_id before softmax, support language codes, name multilingual models (#4290)
2020-05-13 17:29:41 -04:00
modeling_bert.py
Fix BERT example code for NSP and Multiple Choice (#3953)
2020-05-29 11:55:55 -04:00
modeling_camembert.py
CDN urls (#4030)
2020-04-28 20:27:14 -04:00
modeling_ctrl.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_distilbert.py
Remove hard-coded pad token id in distilbert and albert (#3965)
2020-05-12 08:32:44 -04:00
modeling_electra.py
added functionality for electra classification head (#4257)
2020-05-22 09:48:21 -04:00
modeling_encoder_decoder.py
[ci] fix 3 remaining slow GPU failures (#4584)
2020-05-25 19:20:50 -04:00
modeling_flaubert.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_gpt2.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_longformer.py
[Longformer] Multiple choice for longformer (#4645)
2020-05-29 13:46:08 +02:00
modeling_marian.py
[Marian Fixes] prevent predicting pad_token_id before softmax, support language codes, name multilingual models (#4290)
2020-05-13 17:29:41 -04:00
modeling_mmbt.py
Add nn.Module as superclass (#4533)
2020-05-25 15:29:33 -04:00
modeling_openai.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_reformer.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_roberta.py
[Longformer] Multiple choice for longformer (#4645)
2020-05-29 13:46:08 +02:00
modeling_t5.py
[T5] Fix Cross Attention position bias (#4499)
2020-05-26 08:57:24 -04:00
modeling_tf_albert.py
[Longformer] Multiple choice for longformer (#4645)
2020-05-29 13:46:08 +02:00
modeling_tf_auto.py
Add MultipleChoice to TFTrainer [WIP] (#4270)
2020-05-12 08:48:48 -04:00
modeling_tf_bert.py
Fix BERT example code for NSP and Multiple Choice (#3953)
2020-05-29 11:55:55 -04:00
modeling_tf_camembert.py
Add TF2 version of FlauBERT (#2700)
2020-03-16 09:29:21 -04:00
modeling_tf_ctrl.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_tf_distilbert.py
Fix TF input docstrings to refer to tf.Tensor rather than torch.FloatTensor. (#4051)
2020-04-30 14:28:56 +02:00
modeling_tf_electra.py
Fix TF input docstrings to refer to tf.Tensor rather than torch.FloatTensor. (#4051)
2020-04-30 14:28:56 +02:00
modeling_tf_flaubert.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_tf_gpt2.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_tf_openai.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_tf_pytorch_utils.py
Support T5 Generation (#3228)
2020-03-19 23:18:23 +01:00
modeling_tf_roberta.py
[doc] Fix broken links + remove crazy big notebook
2020-05-07 18:44:18 -04:00
modeling_tf_t5.py
[T5] Fix Cross Attention position bias (#4499)
2020-05-26 08:57:24 -04:00
modeling_tf_transfo_xl_utilities.py
💄 super
2020-01-15 18:33:50 -05:00
modeling_tf_transfo_xl.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_tf_utils.py
fix (#4419)
2020-05-18 15:51:40 +02:00
modeling_tf_xlm_roberta.py
Style
2020-01-29 11:47:49 -05:00
modeling_tf_xlm.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_tf_xlnet.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_transfo_xl_utilities.py
Shift labels internally within TransfoXLLMHeadModel when called with labels (#3716)
2020-04-13 18:11:23 +02:00
modeling_transfo_xl.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_utils.py
Add Type Hints to modeling_utils.py Closes #3911 (#3948)
2020-05-22 19:10:22 -04:00
modeling_xlm_roberta.py
CDN urls (#4030)
2020-04-28 20:27:14 -04:00
modeling_xlm.py
gpt2 typo (#4629)
2020-05-28 16:44:43 -04:00
modeling_xlnet.py
[Longformer] Multiple choice for longformer (#4645)
2020-05-29 13:46:08 +02:00
optimization_tf.py
Correct TF formatting to exclude LayerNorms from weight decay (#4448)
2020-05-20 16:45:59 -04:00
optimization.py
🚨 Remove warning of deprecation (#4477)
2020-05-20 16:48:29 -04:00
pipelines.py
[Summarization Pipeline]: Fix default tokenizer (#4506)
2020-05-22 17:49:45 -04:00
tokenization_albert.py
Fix special token doc (#4292)
2020-05-11 15:05:36 -04:00
tokenization_auto.py
Longformer (#4352)
2020-05-19 16:04:43 +02:00
tokenization_bart.py
[MbartTokenizer] save to sentencepiece.bpe.model (#4335)
2020-05-18 08:54:04 -04:00
tokenization_bert_japanese.py
CDN urls (#4030)
2020-04-28 20:27:14 -04:00
tokenization_bert.py
Fix convert_token_type_ids_from_sequences for fast tokenizers (#4503)
2020-05-22 12:45:10 -04:00
tokenization_camembert.py
Fix special token doc (#4292)
2020-05-11 15:05:36 -04:00
tokenization_ctrl.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_distilbert.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_electra.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_flaubert.py
Documentation (#2989)
2020-02-25 18:43:36 -05:00
tokenization_gpt2.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_longformer.py
[Longformer] more models + model cards (#4628)
2020-05-28 11:11:05 +02:00
tokenization_marian.py
[MarianTokenizer] implement save_vocabulary and other common methods (#4389)
2020-05-19 19:45:49 -04:00
tokenization_openai.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_reformer.py
Reformer (#3351)
2020-05-07 10:17:01 +02:00
tokenization_roberta.py
Fix convert_token_type_ids_from_sequences for fast tokenizers (#4503)
2020-05-22 12:45:10 -04:00
tokenization_t5.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_transfo_xl.py
Cleanup fast tokenizers integration (#3706)
2020-04-18 13:43:57 +02:00
tokenization_utils.py
Fix add_special_tokens on fast tokenizers (#4531)
2020-05-28 10:54:45 -04:00
tokenization_xlm_roberta.py
Fix special token doc (#4292)
2020-05-11 15:05:36 -04:00
tokenization_xlm.py
Fix special token doc (#4292)
2020-05-11 15:05:36 -04:00
tokenization_xlnet.py
Fix special token doc (#4292)
2020-05-11 15:05:36 -04:00
trainer_tf.py
Better None gradients handling in TF Trainer (#4469)
2020-05-20 16:46:21 -04:00
trainer_utils.py
TF version of the trainer (#4017)
2020-05-06 12:56:52 -04:00
trainer.py
per_device instead of per_gpu/error thrown when argument unknown (#4618)
2020-05-27 11:36:55 -04:00
training_args_tf.py
Question Answering for TF trainer (#4320)
2020-05-13 09:22:31 -04:00
training_args.py
per_device instead of per_gpu/error thrown when argument unknown (#4618)
2020-05-27 11:36:55 -04:00