SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
28fa014a1fd214ffdbac3fb76ae87a6c71f3f99d
HuggingFace_transformer/tests/test_tokenization_auto.py
Lysandre Debut e09e54fd9d MT5 should have an autotokenizer (#8743) 
* MT5 should have an autotokenizer

* Different configurations should be able to point to same tokenizers
2020-11-24 09:50:25 -05:00

4.9 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink