Nicolas Patry d33dc7966a Improve truncation_side (#14947) ...

* Enabling `truncation_side` for Slow and Fast tokenizer.

Co-Authored-by: Niels Rogge <48327001+NielsRogge@users.noreply.github.com>

* Disable failing tests.

* Layout xlm.

* assert -> assertEqual.

Co-authored-by: Niels Rogge <48327001+NielsRogge@users.noreply.github.com>

2022-01-03 16:18:39 +01:00

62 KiB

Raw Blame History

View Raw