Files
HuggingFace_transformer/tests
Muktan a721a5eefd [Wav2vec2] Fixed tokenization mistakes while adding single-char tokens to tokenizer (#11538)
* Fixed tokenization mistakes while adding single-char tokens to tokenizer

* Added tests and Removed unnecessary comments.

* finalize wav2vec2 tok

* add more aggressive tests

* Apply suggestions from code review

* fix useless import

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
2021-05-03 17:19:12 +02:00
..
2021-04-21 11:11:20 -04:00
2021-04-21 11:11:20 -04:00
2021-04-23 09:17:37 -04:00
2020-12-07 18:36:34 -05:00
2020-12-07 18:36:34 -05:00
2020-12-07 18:36:34 -05:00
2020-12-07 18:36:34 -05:00
2020-12-07 18:36:34 -05:00
2021-04-23 09:17:37 -04:00
2021-01-27 21:25:11 +03:00
2020-12-07 18:36:34 -05:00
2021-04-26 13:50:34 +02:00
2021-04-26 13:50:34 +02:00
2021-05-03 09:07:29 -04:00
2021-04-26 13:50:34 +02:00
2020-12-09 10:32:43 -05:00
2020-12-07 18:36:34 -05:00
2020-12-07 18:36:34 -05:00
2021-04-26 13:50:34 +02:00
2021-01-27 21:25:11 +03:00
2021-04-26 13:50:34 +02:00
2020-12-07 18:36:34 -05:00
2021-03-11 13:38:29 -05:00
2020-12-07 18:36:34 -05:00
2020-12-07 18:36:34 -05:00
2021-03-30 08:51:34 +03:00
2021-04-26 13:50:34 +02:00
2021-05-03 09:07:29 -04:00
2020-12-07 18:36:34 -05:00
2020-12-07 18:36:34 -05:00
2021-04-26 13:50:34 +02:00
2020-12-07 18:36:34 -05:00
2021-04-21 11:11:20 -04:00