thomwolf 69da972ace added test and debug tokenizer configuration serialization

2019-08-30 17:09:36 +02:00

..

tests

added test and debug tokenizer configuration serialization

2019-08-30 17:09:36 +02:00

__init__.py

Release: 1.1.0

2019-08-15 11:15:08 -04:00

__main__.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_gpt2_checkpoint_to_pytorch.py

adding gpt-2 large

2019-08-21 02:29:34 +02:00

convert_openai_checkpoint_to_pytorch.py

adding gpt-2 large

2019-08-21 02:29:34 +02:00

convert_pytorch_checkpoint_to_tf.py

Merge branch 'master' into auto_models

2019-08-05 19:17:35 +02:00

convert_roberta_checkpoint_to_pytorch.py

Fixup 9d0603148b

2019-08-12 12:28:55 -04:00

convert_tf_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

convert_transfo_xl_checkpoint_to_pytorch.py

adding gpt-2 large

2019-08-21 02:29:34 +02:00

convert_xlm_checkpoint_to_pytorch.py

fix #827

2019-07-23 14:06:43 +02:00

convert_xlnet_checkpoint_to_pytorch.py

Fixed small typo

2019-08-04 16:05:10 +10:00

file_utils.py

adding proxies options for the from_pretrained methods

2019-08-20 16:59:11 +02:00

modeling_auto.py

Order of strings in AutoModel/AutoTokenizer updated.

2019-08-16 09:53:26 -04:00

modeling_bert.py

fix #808

2019-08-20 11:29:26 +02:00

modeling_gpt2.py

adding gpt-2 large

2019-08-21 02:29:34 +02:00

modeling_openai.py

Merge pull request #1057 from huggingface/fixes

2019-08-21 01:54:05 +02:00

modeling_roberta.py

fix #808

2019-08-20 11:29:26 +02:00

modeling_transfo_xl_utilities.py

fix #827

2019-07-23 14:06:43 +02:00

modeling_transfo_xl.py

fix #808

2019-08-20 11:29:26 +02:00

modeling_utils.py

reraise EnvironmentError in from_pretrained functions of Model and Tokenizer

2019-08-22 15:25:40 -07:00

modeling_xlm.py

adding xlm 17 and 100 models and config on aws

2019-08-30 16:28:42 +02:00

modeling_xlnet.py

fix #808

2019-08-20 11:29:26 +02:00

optimization.py

updating schedules for state_dict saving

2019-07-23 15:57:18 +02:00

tokenization_auto.py

Order of strings in AutoModel/AutoTokenizer updated.

2019-08-16 09:53:26 -04:00

tokenization_bert.py

Added option to setup pretrained tokenizer arguments

2019-08-30 15:30:41 +02:00

tokenization_gpt2.py

Add max length

2019-08-21 02:35:01 +02:00

tokenization_openai.py

Update tokenization_openai.py

2019-08-20 14:19:25 +02:00

tokenization_roberta.py

Doc

2019-08-14 14:56:14 -04:00

tokenization_transfo_xl.py

big doc update [WIP]

2019-08-04 12:14:57 +02:00

tokenization_utils.py

added test and debug tokenizer configuration serialization

2019-08-30 17:09:36 +02:00

tokenization_xlm.py

adding 17 and 100 xlm models

2019-08-30 16:26:04 +02:00

tokenization_xlnet.py

Added documentation and changed parameters for special_tokens_sentences_pair.

2019-08-12 15:13:53 -04:00