thomwolf f8aace6bcd update tokenizers to use self.XX_token_id instead of converting self.XX_token

2019-08-30 13:39:52 +02:00

..

tests

python2 doesn't spark joy

2019-08-30 13:22:43 +02:00

__init__.py

Release: 1.1.0

2019-08-15 11:15:08 -04:00

__main__.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_gpt2_checkpoint_to_pytorch.py

adding gpt-2 large

2019-08-21 02:29:34 +02:00

convert_openai_checkpoint_to_pytorch.py

adding gpt-2 large

2019-08-21 02:29:34 +02:00

convert_pytorch_checkpoint_to_tf.py

Merge branch 'master' into auto_models

2019-08-05 19:17:35 +02:00

convert_roberta_checkpoint_to_pytorch.py

Fixup 9d0603148b

2019-08-12 12:28:55 -04:00

convert_tf_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

convert_transfo_xl_checkpoint_to_pytorch.py

adding gpt-2 large

2019-08-21 02:29:34 +02:00

convert_xlm_checkpoint_to_pytorch.py

fix #827

2019-07-23 14:06:43 +02:00

convert_xlnet_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

file_utils.py

adding proxies options for the from_pretrained methods

2019-08-20 16:59:11 +02:00

modeling_auto.py

Order of strings in AutoModel/AutoTokenizer updated.

2019-08-16 09:53:26 -04:00

modeling_bert.py

fix #808

2019-08-20 11:29:26 +02:00

modeling_gpt2.py

fix GPT2DoubleHeadModel docstring

2019-08-30 11:49:23 +02:00

modeling_openai.py

Removed attention_mask from GPT-2 and GPT documentation. Corrected multiple_choice_labels to actual name mc_labels

2019-08-21 14:11:14 -04:00

modeling_roberta.py

fix #808

2019-08-20 11:29:26 +02:00

modeling_transfo_xl_utilities.py

fix #827

2019-07-23 14:06:43 +02:00

modeling_transfo_xl.py

fix #808

2019-08-20 11:29:26 +02:00

modeling_utils.py

adding proxies options for the from_pretrained methods

2019-08-20 16:59:11 +02:00

modeling_xlm.py

fix #1034

2019-08-20 12:20:21 +02:00

modeling_xlnet.py

fix #808

2019-08-20 11:29:26 +02:00

optimization.py

updating schedules for state_dict saving

2019-07-23 15:57:18 +02:00

tokenization_auto.py

Order of strings in AutoModel/AutoTokenizer updated.

2019-08-16 09:53:26 -04:00

tokenization_bert.py

update tokenizers to use self.XX_token_id instead of converting self.XX_token

2019-08-30 13:39:52 +02:00

tokenization_gpt2.py

clean up all byte-level bpe tests

2019-08-30 12:43:08 +02:00

tokenization_openai.py

Update tokenization_openai.py

2019-08-20 14:19:25 +02:00

tokenization_roberta.py

update tokenizers to use self.XX_token_id instead of converting self.XX_token

2019-08-30 13:39:52 +02:00

tokenization_transfo_xl.py

big doc update [WIP]

2019-08-04 12:14:57 +02:00

tokenization_utils.py

more doc on special tokens

2019-08-30 13:36:22 +02:00

tokenization_xlm.py

update tokenizers to use self.XX_token_id instead of converting self.XX_token

2019-08-30 13:39:52 +02:00

tokenization_xlnet.py

update tokenizers to use self.XX_token_id instead of converting self.XX_token

2019-08-30 13:39:52 +02:00