SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Better check in initialize_weights (#38382)

Browse Source 
* Update modeling_utils.py

* CIs

* CIs
This commit is contained in:
Cyril Vallez
2025-05-26 16:20:23 +02:00
committed by GitHub
parent eb74cf977b
commit 8b03c8eaf2
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
src/transformers/modeling_utils.py
View File

@@ -2658,7 +2658,7 @@ class PreTrainedModel(nn.Module, ModuleUtilsMixin, PushToHubMixin, PeftAdapterMi
def smart_apply(self, fn): def smart_apply(self, fn):
for module in self.children(): for module in self.children():
# We found a sub-model: recursively dispatch its own init function now! # We found a sub-model: recursively dispatch its own init function now!
if hasattr(module, "_init_weights"): if isinstance(module, PreTrainedModel):
module.smart_apply(module._initialize_weights) module.smart_apply(module._initialize_weights)
else: else:
module.smart_apply(fn) module.smart_apply(fn)