Xuehai Pan 976189a6df Fix initialization for missing parameters in from_pretrained under ZeRO-3 (#28245) ...

* Fix initialization for missing parameters in `from_pretrained` under ZeRO-3

* Test initialization for missing parameters under ZeRO-3

* Add more tests

* Only enable deepspeed context for per-module level parameters

* Enable deepspeed context only once

* Move class definition inside test case body

2024-01-09 14:58:21 +00:00

..

ds_config_zero2.json

[Deepspeed] add support for bf16 mode (#14569)

2022-03-11 17:53:53 -08:00

ds_config_zero3.json

[Deepspeed] add support for bf16 mode (#14569)

2022-03-11 17:53:53 -08:00

test_deepspeed.py

Fix initialization for missing parameters in from_pretrained under ZeRO-3 (#28245)

2024-01-09 14:58:21 +00:00

test_model_zoo.py

Apply ruff flake8-comprehensions (#21694)

2023-02-22 09:14:54 +01:00

vit_feature_extractor.json

missing file (#17164)

2022-05-10 10:19:50 -07:00