5 Commits

Author	SHA1	Message	Date
Julien Chaumond	0477b307c7	[camembert] tokenizer: use additional_special_tokens	2019-11-16 00:11:07 -05:00
Julien Chaumond	f9abf73e31	[camembert] realign w/ recent changes	2019-11-16 00:11:07 -05:00
Julien Chaumond	26858f27cb	[camembert] Upload to s3 + rename script	2019-11-16 00:11:07 -05:00
Louis MARTIN	fb6c70a91d	Update tokenization_camembert.py with urls	2019-11-16 00:11:07 -05:00
Louis MARTIN	14b3aa3b3c	Add tokenization_camembert.py	2019-11-16 00:11:07 -05:00