SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Feature/fix slow test in mluke (#14749)

Browse Source 
* make MLukeTokenizerTest fast

* make LukeTokenizerTest fast

* add entry to _toctree.yaml
This commit is contained in:
Ryokan RI
2021-12-22 20:35:59 +09:00
committed by GitHub
parent c94c1b8967
commit 824fd44fc3
6 changed files with 92 additions and 44 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
tests/fixtures/test_entity_vocab.json vendored Normal file
View File

@@ -0,0 +1 @@
{"[MASK]": 0, "[UNK]": 1, "[PAD]": 2, "DUMMY": 3, "DUMMY2": 4, "[MASK2]": 5}