Files
HuggingFace_transformer/tests/test_tokenization_bert_japanese.py
Yohei Tamura 8594dd80dd BertJapaneseTokenizer accept options for mecab (#3566)
* BertJapaneseTokenizer accept options for mecab

* black

* fix mecab_option to Option[str]
2020-04-03 11:12:19 -04:00

8.2 KiB