SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Remove n_ctx from configs (#14165)

Browse Source 
* Remove n_ctx from configs

* Fix GPTJ and OpenAIGPT, both are acceptable breaking changes as there are no configs such that it breaks

* Remove unecessary n_positions from TFOpenAIGPT
This commit is contained in:
Thomas Wang
2021-10-29 11:50:25 +02:00
committed by GitHub
parent be236361f1
commit 5b45422b58
22 changed files with 30 additions and 56 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
tests/test_modeling_ctrl.py
View File

@@ -114,7 +114,6 @@ class CTRLModelTester:
# hidden_dropout_prob=self.hidden_dropout_prob,
# attention_probs_dropout_prob=self.attention_probs_dropout_prob,
n_positions=self.max_position_embeddings,
n_ctx=self.max_position_embeddings,
# type_vocab_size=self.type_vocab_size,
# initializer_range=self.initializer_range,
pad_token_id=self.pad_token_id,