SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[Longformer For Question Answering] Conversion script, doc, small fixes (#4593)

Browse Source 
* add new longformer for question answering model

* add new config as well

* fix links

* fix links part 2
This commit is contained in:
Patrick von Platen
2020-05-26 14:58:47 +02:00
committed by GitHub
parent a163c9ca5b
commit c589eae2b8
5 changed files with 123 additions and 21 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
src/transformers/tokenization_longformer.py
View File

@@ -24,12 +24,13 @@ logger = logging.getLogger(__name__)
# vocab and merges same as roberta
vocab_url = "https://s3.amazonaws.com/models.huggingface.co/bert/roberta-large-vocab.json"
merges_url = "https://s3.amazonaws.com/models.huggingface.co/bert/roberta-large-merges.txt"
_all_longformer_models = ["longformer-base-4096", "longformer-large-4096"]
_all_longformer_models = ["longformer-base-4096", "longformer-large-4096", "longformer-large-4096-finetuned-triviaqa"]
PRETRAINED_POSITIONAL_EMBEDDINGS_SIZES = {
"longformer-base-4096": 4096,
"longformer-large-4096": 4096,
"longformer-large-4096-finetuned-triviaqa": 4096,
}