SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Model templates encoder only (#8509)

Browse Source 
* Model templates

* TensorFlow

* Remove pooler

* CI

* Tokenizer + Refactoring

* Encoder-Decoder

* Let's go testing

* Encoder-Decoder in TF

* Let's go testing in TF

* Documentation

* README

* Fixes

* Better names

* Style

* Update docs

* Choose to skip either TF or PT

* Code quality fixes

* Add to testing suite

* Update file path

* Cookiecutter path

* Update `transformers` path

* Handle rebasing

* Remove seq2seq from model templates

* Remove s2s config

* Apply Sylvain and Patrick comments

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Last fixes from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
This commit is contained in:
Lysandre Debut
2020-11-13 11:59:30 -05:00
committed by GitHub
parent 42e2d02e44
commit 826f04576f
29 changed files with 3315 additions and 1977 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
templates/adding_a_new_model/tests/tf-encoder-bert-tokenizer.json Normal file
View File

@@ -0,0 +1,10 @@
{
"modelname": "TFEncoderBERT",
"uppercase_modelname": "TF_ENCODER_BERT",
"lowercase_modelname": "tf_encoder_bert",
"camelcase_modelname": "TfEncoderBert",
"authors": "The HuggingFace Team",
"checkpoint_identifier": "brand-new-bert-base-cased",
"tokenizer_type": "Based on BERT",
"generate_tensorflow_and_pytorch": "TensorFlow"
}