SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
df1f94eb4a18b1a27d27e32040b60a17410d516e
HuggingFace_transformer/tests/test_tokenization_xlm_roberta.py
Benjamin Davidson e02ed0ee7e XLMR tokenizer is fully picklable (#13577) 
* made tokenizer fully picklable

* remove whitespace

* added testcase
2021-09-16 16:30:05 -04:00

11 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink