SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
a0dcefa382a541d0fecd634d6d0c3f97cd221faf
HuggingFace_transformer/transformers
History
Rémi Louf a0dcefa382 generalize BertSelfAttention to take separate query, key, value 
There is currently no way to specify the quey, key and value separately
in the Attention module. However, the decoder's "encoder-decoder
attention" layers take the decoder's last output as a query, the
encoder's states as key and value. We thus modify the existing code so
query, key and value can be added separately.

This obviously poses some naming conventions; `BertSelfAttention` is not
a self-attention module anymore. The way the residual is forwarded is
now awkard, etc. We will need to do some refacto once the decoder is
fully implemented.
2019-10-07 17:53:58 +02:00
..
data
Add docstring for processor method
2019-09-27 17:32:28 +02:00
tests
add wireframe for seq2seq model
2019-10-07 12:04:05 +02:00
__init__.py
fix unknown imports (*ForMultipleChoice) in run_multiple_choice
2019-09-29 19:51:01 -04:00
__main__.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_auto.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_bert.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_distilbert.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_gpt2.py
update links to new weights
2019-10-03 10:27:11 -04:00
configuration_openai.py
Merge branch 'master' into tf2
2019-09-26 12:02:54 +02:00
configuration_roberta.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_transfo_xl.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_utils.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_xlm.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
configuration_xlnet.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_bert_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_bert_pytorch_checkpoint_to_original_tf.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_gpt2_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_openai_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_pytorch_checkpoint_to_tf2.py
fix buf in convert_pt_chkpt_to_tf2
2019-10-03 10:27:11 -04:00
convert_roberta_original_pytorch_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_transfo_xl_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_xlm_original_pytorch_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
convert_xlnet_original_tf_checkpoint_to_pytorch.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
file_utils.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_auto.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_bert.py
generalize BertSelfAttention to take separate query, key, value
2019-10-07 17:53:58 +02:00
modeling_distilbert.py
DistillBert Documentation Code Example fixes
2019-10-03 15:51:33 -04:00
modeling_gpt2.py
update links to new weights
2019-10-03 10:27:11 -04:00
modeling_openai.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_roberta.py
fix padding_idx of RoBERTa model
2019-09-27 19:03:55 -04:00
modeling_seq2seq.py
raise exception when class initialized with __init__
2019-10-07 13:00:06 +02:00
modeling_tf_auto.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_tf_bert.py
initialy -> initially
2019-10-02 15:04:18 +00:00
modeling_tf_distilbert.py
DistillBert Documentation Code Example fixes
2019-10-03 15:51:33 -04:00
modeling_tf_gpt2.py
update links to new weights
2019-10-03 10:27:11 -04:00
modeling_tf_openai.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_tf_pytorch_utils.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_tf_roberta.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_tf_transfo_xl_utilities.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_tf_transfo_xl.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_tf_utils.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_tf_xlm.py
initialy -> initially
2019-10-02 15:04:18 +00:00
modeling_tf_xlnet.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_transfo_xl_utilities.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_transfo_xl.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_utils.py
Merge branch 'pooler_end_logits_fp16_fix' of https://github.com/slayton58/pytorch-transformers into pr/1284
2019-10-01 18:17:48 -04:00
modeling_xlm.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
modeling_xlnet.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
optimization.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
tokenization_auto.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
tokenization_bert.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
tokenization_distilbert.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
tokenization_gpt2.py
update links to new weights
2019-10-03 10:27:11 -04:00
tokenization_openai.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
tokenization_roberta.py
Close #1304
2019-09-27 17:02:53 -04:00
tokenization_transfo_xl.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
tokenization_utils.py
Decode documentaton
2019-10-04 14:27:38 -04:00
tokenization_xlm.py
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
tokenization_xlnet.py
Merge branch 'master' into tf2
2019-09-26 12:02:54 +02:00