SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
d3adb985d1fb97f68acc2e4b8ae54f2bfca05fda
HuggingFace_transformer/tests/test_tokenization_fast.py
Sylvain Gugger 21ca148090 is_pretokenized -> is_split_into_words (#7236) 
* is_pretokenized -> is_split_into_words

* Fix tests
2020-09-22 09:34:35 -04:00

42 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink