[deepspeed] zero inference (#14253)

* [deepspeed] zero inference * only z3 makes sense for inference * fix and style * docs * rework * fix test * Apply suggestions from code review Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * responding to suggestions Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2021-11-23 14:09:15 -08:00
parent 69e16abf98
commit 956a483173
6 changed files with 149 additions and 38 deletions
--- a/setup.py
+++ b/setup.py
@@ -97,7 +97,7 @@ _deps = [
    "cookiecutter==1.7.2",
    "dataclasses",
    "datasets",
-    "deepspeed>=0.5.3",
+    "deepspeed>=0.5.7",
    "docutils==0.16.0",
    "fairscale>0.3",
    "faiss-cpu",