SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
b73dd1a0e441e2fc215c013dc4ea2fed65db6c5f
HuggingFace_transformer/tests/test_tokenization_common.py
Patrick von Platen c0135194eb Force pad_token_id to be set before padding for standard tokenizer (#3035) 
* force pad_token_id to be set before padding

* fix tests and forbid padding without having a padding_token_id set
2020-03-02 10:53:55 -05:00

30 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink