Lysandre Debut c1c79b0655 NLLB tokenizer (#18126) ...

* NLLB tokenizer

* Apply suggestions from code review - Thanks Stefan!

Co-authored-by: Stefan Schweter <stefan@schweter.it>

* Final touches

* Style :)

* Update docs/source/en/model_doc/nllb.mdx

Co-authored-by: Stefan Schweter <stefan@schweter.it>

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* PR reviews

* Auto models

Co-authored-by: Stefan Schweter <stefan@schweter.it>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

2022-07-18 08:12:34 -04:00

..

en

NLLB tokenizer (#18126)

2022-07-18 08:12:34 -04:00

es

In group_texts function, drop last block if smaller than block_size (#17908)

2022-06-28 08:34:55 -04:00

it

Translation/autoclass (#17615)

2022-06-09 20:56:44 -04:00

pt

Added translation of index.mdx to Portuguese Issue #16824 (#17565)

2022-06-17 20:06:05 -04:00

_config.py

Use doc builder styler (#16412)

2022-03-28 07:45:18 -04:00