Use DS callable API to allow hf_scheduler + ds_optimizer (#13216)

* Use DS callable API to allow hf_scheduler + ds_optimizer * Preserve backward-compatibility * Restore backward compatibility * Tweak arg positioning * Tweak arg positioning * bump the required version * Undo indent * Update src/transformers/trainer.py * style Co-authored-by: Stas Bekman <stas@stason.org> Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
2021-08-30 10:01:06 -07:00
parent 35236b870e
commit 42f359d015
5 changed files with 24 additions and 31 deletions
--- a/setup.py
+++ b/setup.py
@@ -91,7 +91,7 @@ _deps = [
    "cookiecutter==1.7.2",
    "dataclasses",
    "datasets",
-    "deepspeed>=0.4.3",
+    "deepspeed>=0.5.1",
    "docutils==0.16.0",
    "fairscale>0.3",
    "faiss-cpu",