SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Speed up TF tests by reducing hidden layer counts (#24595)

Browse Source 
* hidden layers, huh, what are they good for (absolutely nothing)

* Some tests break with 1 hidden layer, use 2

* Use 1 hidden layer in a few slow models

* Use num_hidden_layers=2 everywhere

* Slightly higher tol for groupvit

* Slightly higher tol for groupvit
This commit is contained in:
Matt
2023-06-30 16:30:33 +01:00
committed by GitHub
parent 3441ad7d43
commit 134caef31a
47 changed files with 67 additions and 85 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
tests/models/rembert/test_modeling_tf_rembert.py
View File

@@ -54,7 +54,7 @@ class TFRemBertModelTester:
hidden_size=32,
input_embedding_size=18,
output_embedding_size=43,
num_hidden_layers=5,
num_hidden_layers=2,
num_attention_heads=4,
intermediate_size=37,
hidden_act="gelu",
@@ -79,7 +79,7 @@ class TFRemBertModelTester:
self.hidden_size = 32
self.input_embedding_size = input_embedding_size
self.output_embedding_size = output_embedding_size
self.num_hidden_layers = 5
self.num_hidden_layers = 2
self.num_attention_heads = 4
self.intermediate_size = 37
self.hidden_act = "gelu"