SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Add final_layer_norm to OPT model (#17785)

Browse Source 
* Add final_layer_norm to OPT model

* Add JAX and TF version

* Fix Keras name

* Woops

* Allow for non breaking change

* Apply suggestions from code review

* add tests

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
This commit is contained in:
Thomas Wang
2022-06-21 20:26:36 +02:00
committed by GitHub
parent 52404cbad4
commit abc400b06a
8 changed files with 53 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
tests/models/opt/test_modeling_tf_opt.py
View File

@@ -330,10 +330,10 @@ class TFOPTGenerationTest(unittest.TestCase):
model_id = "facebook/opt-125m"
EXPECTED_OUTPUTS = [
"Today is a beautiful day and I want everyone",
"In the city of Rome Canaver Canaver Canaver Canaver",
"Paris is the capital of France and Parisdylib",
"Computers and mobile phones have taken precedence over",
"Today is a beautiful day and I want to",
"In the city of New York, the city",
"Paris is the capital of France and the capital",
"Computers and mobile phones have taken over the",
]
predicted_outputs = []