Add gemma 2 (#31659)

* inital commit * Add doc * protect? * fixup stuffs * update tests * fix build documentation * mmmmmmm config attributes * style * nit * uodate * nit * Fix docs * protect some stuff --------- Co-authored-by: Lysandre <lysandre@huggingface.co>
2024-06-27 17:36:19 +02:00
parent 4aa17d0069
commit 0cf60f13ab
24 changed files with 3057 additions and 69 deletions
--- a/utils/check_config_attributes.py
+++ b/utils/check_config_attributes.py
@@ -41,6 +41,7 @@ SPECIAL_CASES_TO_ALLOW = {
        "expert_layer_offset",
        "expert_layer_period",
    ],
+    "Gemma2Config": ["tie_word_embeddings"],
    # used to compute the property `self.chunk_length`
    "EncodecConfig": ["overlap"],
    # used to compute the property `self.layers_block_type`