Files
HuggingFace_transformer/docs/source
Arthur 00b5887b94 🚨🚨🚨 [NLLB Tokenizer] Fix the prefix tokens 🚨🚨🚨 (#22313)
* fix the prefix tokens

* update fast and test values

* add legacy behaviour

Co-authored-by: sgugger <sylvain.gugger@gmail.com>

* update disclaimer, linkissue PR and behaviral changes

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <hi@lysand.re>

* styling

* make a quote

* quote this time

---------

Co-authored-by: sgugger <sylvain.gugger@gmail.com>
Co-authored-by: Lysandre Debut <hi@lysand.re>
2023-04-04 14:53:06 +02:00
..
2023-03-24 19:45:57 +00:00
2023-04-04 14:53:06 +02:00
2023-03-24 19:45:57 +00:00
2023-03-14 12:08:14 +03:00
2023-03-24 19:45:57 +00:00
2023-04-03 09:17:02 -04:00
2023-03-24 19:45:57 +00:00
2023-03-14 12:08:14 +03:00