Yiqing-Zhou 897d0841be read().splitlines() -> readlines() ...

splitlines() does not work as what we expect here for bert-base-chinese because there is a '\u2028' (unicode line seperator) token in vocab file. Value of '\u2028'.splitlines() is ['', ''].
Perhaps we should use readlines() instead.

2019-07-22 20:49:09 +08:00

..

tests

update readme and pretrained model weight files

2019-07-16 15:11:29 +02:00

__init__.py

release version 1.0

2019-07-16 16:10:58 +02:00

__main__.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_gpt2_checkpoint_to_pytorch.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_openai_checkpoint_to_pytorch.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_pytorch_checkpoint_to_tf.py

Merge branch 'xlnet'

2019-07-16 11:51:13 +02:00

convert_tf_checkpoint_to_pytorch.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_transfo_xl_checkpoint_to_pytorch.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_xlm_checkpoint_to_pytorch.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

convert_xlnet_checkpoint_to_pytorch.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00

file_utils.py

import sys twice

2019-07-17 18:12:01 +09:00

modeling_bert.py

adding missing docstring fix #793

2019-07-16 21:35:53 +02:00

modeling_gpt2.py

fix docstrings

2019-07-16 15:31:21 +02:00

modeling_openai.py

fix docstrings

2019-07-16 15:31:21 +02:00

modeling_transfo_xl_utilities.py

updating examples

2019-07-11 12:03:08 +02:00

modeling_transfo_xl.py

fix docstrings

2019-07-16 15:31:21 +02:00

modeling_utils.py

model in evaluation mode by default after from_pretrained

2019-07-16 15:41:57 +02:00

modeling_xlm.py

fix docstrings

2019-07-16 15:31:21 +02:00

modeling_xlnet.py

fix docstrings

2019-07-16 15:31:21 +02:00

optimization.py

clean up optimization

2019-07-15 13:49:07 +02:00

tokenization_bert.py

read().splitlines() -> readlines()

2019-07-22 20:49:09 +08:00

tokenization_gpt2.py

update tokenizer - update squad example for xlnet

2019-07-15 17:30:42 +02:00

tokenization_openai.py

update tokenizer - update squad example for xlnet

2019-07-15 17:30:42 +02:00

tokenization_transfo_xl.py

update readme and pretrained model weight files

2019-07-16 15:11:29 +02:00

tokenization_utils.py

update readme and pretrained model weight files

2019-07-16 15:11:29 +02:00

tokenization_xlm.py

update readme and pretrained model weight files

2019-07-16 15:11:29 +02:00

tokenization_xlnet.py

update conversion scripts and __main__

2019-07-16 09:41:55 +02:00