4 Commits

Author	SHA1	Message	Date
Romain Rigaux	7516bcf273	[docs] Fix number of 'ug' occurrences in tokenizer_summary (#6574)	2020-08-18 10:23:25 -04:00
Sylvain Gugger	6028ed92bd	Small docfile fixes (#6328)	2020-08-10 05:37:12 -04:00
Stas Bekman	fa5423b169	doc fixes (#5613)	2020-07-08 19:52:44 -04:00
Sylvain Gugger	6b735a7253	Tokenizer summary (#5467) ... * Work on tokenizer summary * Finish tutorial * Link to it * Apply suggestions from code review Co-authored-by: Anthony MOI <xn1t0x@gmail.com> Co-authored-by: Lysandre Debut <lysandre@huggingface.co> * Add vocab definition Co-authored-by: Anthony MOI <xn1t0x@gmail.com> Co-authored-by: Lysandre Debut <lysandre@huggingface.co>	2020-07-02 17:07:42 -04:00