davidleonfdez 9f8bfe703c Fix #16660 (tokenizers setters of ids of special tokens) (#16661) ...

* Fix setters of *_token_id properties of SpecialTokensMixin

* Test setters of common tokens ids

* Move to a separate test checks of setters of tokens ids

* Add independent test for ByT5

* Add Canine test

* Test speech to text

2022-04-13 07:49:06 -04:00

200 KiB

Raw Blame History

View Raw