Lysandre Debut 21d8b6a33e Testing that batch_encode_plus is the same as encode_plus (#2973) ...

* Testing that encode_plus and batch_encode_plus behave the same way

Spoiler alert: they don't

* Testing rest of arguments in batch_encode_plus

* Test tensor return in batch_encode_plus

* Addressing Sam's comments

* flake8

* Simplified with `num_added_tokens`

2020-02-24 12:09:46 -05:00

29 KiB

Raw Blame History

View Raw