SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
3520be7824ad11ebc05a393fd90ecfdd4203cfdb
HuggingFace_transformer/transformers
History
Rémi Louf 3520be7824 create encoder attention mask from shape of hidden states 
We currently create encoder attention masks (when they're not provided)
based on the shape of the inputs to the encoder. This is obviously
wrong; sequences can be of different lengths. We now create the encoder
attention mask based on the batch_size and sequence_length of the
encoder hidden states.
2019-12-09 11:19:45 +01:00
..
commands
[cli] ls: Tabular formatting
2019-12-04 18:40:52 -05:00
data
fix bug
2019-11-27 11:07:22 -05:00
tests
Remove pytest dependency. (#2093)
2019-12-07 07:46:14 -05:00
__init__.py
Merge pull request #2046 from jplu/tf2-ner-example
2019-12-06 12:12:22 +01:00
__main__.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_albert.py
ALBERT-V2
2019-11-26 13:08:12 -05:00
configuration_auto.py
Add ALBERT to AutoClasses
2019-11-29 11:25:37 -05:00
configuration_bert.py
model: add support for new German BERT models (cased and uncased) from @dbmdz
2019-10-11 10:20:33 +02:00
configuration_camembert.py
[camembert] Upload to s3 + rename script
2019-11-16 00:11:07 -05:00
configuration_ctrl.py
adding TF 2.0 model
2019-10-09 11:07:43 +02:00
configuration_distilbert.py
Merge branch 'master' into distilbert-german
2019-11-27 18:11:49 +01:00
configuration_gpt2.py
GPT-2 XL
2019-11-05 13:31:58 -05:00
configuration_openai.py
Merge branch 'master' into tf2
2019-09-26 12:02:54 +02:00
configuration_roberta.py
Add RoBERTa-based GPT-2 Output Detector from OpenAI
2019-11-06 16:26:31 -05:00
configuration_transfo_xl.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_utils.py
Merge branch 'master' into resumable_http
2019-11-27 17:10:36 +01:00
configuration_xlm.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_xlnet.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_albert_original_tf_checkpoint_to_pytorch.py
ALBERT-V2
2019-11-26 13:08:12 -05:00
convert_bert_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_bert_pytorch_checkpoint_to_original_tf.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_gpt2_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_openai_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_pytorch_checkpoint_to_tf2.py
ALBERT in TF2
2019-11-26 13:08:12 -05:00
convert_roberta_original_pytorch_checkpoint_to_pytorch.py
Fix import error in script to convert faisreq roberta checkpoints
2019-10-14 01:38:57 -07:00
convert_transfo_xl_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_xlm_original_pytorch_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_xlnet_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
file_utils.py
Add support for resumable downloads for HTTP protocol.
2019-10-31 18:25:34 +03:00
hf_api.py
[cli] Uploads: add progress bar (#2078)
2019-12-06 11:56:23 -05:00
modeling_albert.py
Fix ALBERT exports with pretraining + sp classifier; Fix naming for ALBERT TF models
2019-12-02 18:00:19 -05:00
modeling_auto.py
Add ALBERT to AutoClasses
2019-11-29 11:25:37 -05:00
modeling_beam_search.py
resolve PR comments
2019-10-29 17:10:20 +01:00
modeling_bert.py
create encoder attention mask from shape of hidden states
2019-12-09 11:19:45 +01:00
modeling_camembert.py
camembert: add wrapper for CamembertForTokenClassification
2019-11-18 14:14:19 +01:00
modeling_ctrl.py
corrected documentation for past tensor shape for ctrl and gpt2 model
2019-12-06 01:24:22 +01:00
modeling_distilbert.py
Merge branch 'master' into distilbert-german
2019-11-27 18:11:49 +01:00
modeling_encoder_decoder.py
change kwargs processing
2019-10-30 16:27:51 +01:00
modeling_gpt2.py
corrected documentation for past tensor shape for ctrl and gpt2 model
2019-12-06 01:24:22 +01:00
modeling_openai.py
Remove dependency on pytest for running tests (#2055)
2019-12-06 13:57:38 -05:00
modeling_roberta.py
Add RoBERTa-based GPT-2 Output Detector from OpenAI
2019-11-06 16:26:31 -05:00
modeling_tf_albert.py
Fix ALBERT exports with pretraining + sp classifier; Fix naming for ALBERT TF models
2019-12-02 18:00:19 -05:00
modeling_tf_auto.py
Add support for resumable downloads for HTTP protocol.
2019-10-31 18:25:34 +03:00
modeling_tf_bert.py
update all tf.shape and tensor.shape to shape_list
2019-11-29 09:40:50 -05:00
modeling_tf_ctrl.py
corrected documentation for past tensor shape for ctrl and gpt2 model
2019-12-06 01:24:22 +01:00
modeling_tf_distilbert.py
Merge pull request #2046 from jplu/tf2-ner-example
2019-12-06 12:12:22 +01:00
modeling_tf_gpt2.py
corrected documentation for past tensor shape for ctrl and gpt2 model
2019-12-06 01:24:22 +01:00
modeling_tf_openai.py
update all tf.shape and tensor.shape to shape_list
2019-11-29 09:40:50 -05:00
modeling_tf_pytorch_utils.py
Add DialoGPT support for Pytorch->TF
2019-11-09 16:46:19 +00:00
modeling_tf_roberta.py
update all tf.shape and tensor.shape to shape_list
2019-11-29 09:40:50 -05:00
modeling_tf_transfo_xl_utilities.py
update all tf.shape and tensor.shape to shape_list
2019-11-29 09:40:50 -05:00
modeling_tf_transfo_xl.py
update all tf.shape and tensor.shape to shape_list
2019-11-29 09:40:50 -05:00
modeling_tf_utils.py
Merge pull request #1735 from ondewo/tf-do-not-use-gpu-on-import
2019-12-05 11:56:48 +01:00
modeling_tf_xlm.py
[inputs_embeds] All TF models + tests
2019-11-12 11:29:21 -05:00
modeling_tf_xlnet.py
Merge pull request #1870 from alexzubiaga/xlnet-for-token-classification
2019-12-05 09:54:09 +01:00
modeling_transfo_xl_utilities.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_transfo_xl.py
[inputs_embeds] All PyTorch models
2019-11-05 00:39:18 +00:00
modeling_utils.py
Merge pull request #1846 from tamuhey/patch/iss1845
2019-12-04 13:28:39 +01:00
modeling_xlm.py
[inputs_embeds] All PyTorch models
2019-11-05 00:39:18 +00:00
modeling_xlnet.py
Merge pull request #2007 from roskoN/xlnet_attention_fix
2019-12-05 12:32:39 +01:00
optimization_tf.py
Create a NER example similar to the Pytorch one. It takes the same options, and can be run the same way.
2019-12-04 09:43:15 +01:00
optimization.py
Run GLUE and remove LAMB
2019-11-26 13:08:12 -05:00
tokenization_albert.py
Remove dependency on pytest for running tests (#2055)
2019-12-06 13:57:38 -05:00
tokenization_auto.py
Add ALBERT to AutoClasses
2019-11-29 11:25:37 -05:00
tokenization_bert.py
Fix #1784
2019-11-11 10:15:14 -05:00
tokenization_camembert.py
Fixing camembert tokenization
2019-12-05 13:27:58 +01:00
tokenization_ctrl.py
Remove dependency on pytest for running tests (#2055)
2019-12-06 13:57:38 -05:00
tokenization_distilbert.py
Merge branch 'master' into distilbert-german
2019-11-27 18:11:49 +01:00
tokenization_gpt2.py
Remove dependency on pytest for running tests (#2055)
2019-12-06 13:57:38 -05:00
tokenization_openai.py
Remove dependency on pytest for running tests (#2055)
2019-12-06 13:57:38 -05:00
tokenization_roberta.py
Fix #1784
2019-11-11 10:15:14 -05:00
tokenization_transfo_xl.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
tokenization_utils.py
Fix bug which lowercases special tokens
2019-12-06 16:15:53 -05:00
tokenization_xlm.py
Remove dependency on pytest for running tests (#2055)
2019-12-06 13:57:38 -05:00
tokenization_xlnet.py
Remove dependency on pytest for running tests (#2055)
2019-12-06 13:57:38 -05:00