Sourab Mangrulkar 6bc517ccd4 deepspeed resume from ckpt fixes and adding support for deepspeed optimizer and HF scheduler (#25863) ...

* Add support for deepspeed optimizer and HF scheduler

* fix bug

* fix the import

* fix issue with deepspeed scheduler saving for hf optim + hf scheduler scenario

* fix loading of hf scheduler when loading deepspeed checkpoint

* fix import of `DeepSpeedSchedulerWrapper`

* add tests

* add the comment and skip the failing tests

* address comment

2023-09-05 22:31:20 +05:30

..

ds_config_zero2.json

[Deepspeed] add support for bf16 mode (#14569)

2022-03-11 17:53:53 -08:00

ds_config_zero3.json

[Deepspeed] add support for bf16 mode (#14569)

2022-03-11 17:53:53 -08:00

test_deepspeed.py

deepspeed resume from ckpt fixes and adding support for deepspeed optimizer and HF scheduler (#25863)

2023-09-05 22:31:20 +05:30

test_model_zoo.py

Apply ruff flake8-comprehensions (#21694)

2023-02-22 09:14:54 +01:00

vit_feature_extractor.json

missing file (#17164)

2022-05-10 10:19:50 -07:00