SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Add mLUKE (#14640)

Browse Source 
* implement MLukeTokenizer and LukeForMaskedLM

* update tests

* update docs

* add LukeForMaskedLM to check_repo.py

* update README

* fix test and specify the entity pad id in tokenization_(m)luke

* fix EntityPredictionHeadTransform
This commit is contained in:
Ryokan RI
2021-12-07 14:25:28 +09:00
committed by GitHub
parent 4cdb67caba
commit 30646a0a3c
24 changed files with 3107 additions and 234 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
utils/check_repo.py
View File

@@ -116,6 +116,7 @@ IGNORE_NON_AUTO_CONFIGURED = PRIVATE_MODELS.copy() + [
"DPRReader",
"FlaubertForQuestionAnswering",
"GPT2DoubleHeadsModel",
"LukeForMaskedLM",
"LukeForEntityClassification",
"LukeForEntityPairClassification",
"LukeForEntitySpanClassification",