More model refactoring! (#35359)
* cohere * style * phi3 * style * small fix * small fix * phi3 longrope * oups * Update rope (only for phi3 still) * Update test_modeling_rope_utils.py * Update modeling_phi3.py * fix * fix copies * style * Fix copied from bad renaming
This commit is contained in:
@@ -723,11 +723,7 @@ class AriaPreTrainedModel(PreTrainedModel):
|
||||
|
||||
|
||||
class AriaTextRotaryEmbedding(nn.Module):
|
||||
def __init__(
|
||||
self,
|
||||
config: AriaTextConfig,
|
||||
device=None,
|
||||
):
|
||||
def __init__(self, config: AriaTextConfig, device=None):
|
||||
super().__init__()
|
||||
self.rope_kwargs = {}
|
||||
# BC: "rope_type" was originally "type"
|
||||
|
||||
Reference in New Issue
Block a user