SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
d32ce2c8df7053c19061b709465cdcc765e45a15
HuggingFace_transformer/transformers/tokenization_utils.py
Thomas Wolf 5b322a36db Merge pull request #1811 from huggingface/special-tokens 
Fix special tokens addition in decoder #1807
2019-11-14 22:17:24 +01:00

54 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink