More model refactoring! (#35359)

* cohere

* style

* phi3

* style

* small fix

* small fix

* phi3 longrope

* oups

* Update rope (only for phi3 still)

* Update test_modeling_rope_utils.py

* Update modeling_phi3.py

* fix

* fix copies

* style

* Fix copied from bad renaming
This commit is contained in:
Cyril Vallez
2025-01-09 11:09:09 +01:00
committed by GitHub
parent 137965ca7d
commit 965a2fb320
36 changed files with 1253 additions and 1243 deletions

View File

@@ -723,11 +723,7 @@ class AriaPreTrainedModel(PreTrainedModel):
class AriaTextRotaryEmbedding(nn.Module):
def __init__(
self,
config: AriaTextConfig,
device=None,
):
def __init__(self, config: AriaTextConfig, device=None):
super().__init__()
self.rope_kwargs = {}
# BC: "rope_type" was originally "type"