From abca1741cf065749c44ef5d77f6f632c50beb070 Mon Sep 17 00:00:00 2001 From: Hakjin Lee Date: Thu, 15 Sep 2022 08:21:06 +0900 Subject: [PATCH] Fix a broken link for deepspeed ZeRO inference in the docs (#19001) * Fix a broken link for deepspeed ZeRO inference * fix link Co-authored-by: Stas Bekman --- docs/source/en/main_classes/deepspeed.mdx | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/source/en/main_classes/deepspeed.mdx b/docs/source/en/main_classes/deepspeed.mdx index a0d6dcc776..8fb819fee5 100644 --- a/docs/source/en/main_classes/deepspeed.mdx +++ b/docs/source/en/main_classes/deepspeed.mdx @@ -49,7 +49,7 @@ Inference: 1. DeepSpeed ZeRO Inference supports ZeRO stage 3 with ZeRO-Infinity. It uses the same ZeRO protocol as training, but it doesn't use an optimizer and a lr scheduler and only stage 3 is relevant. For more details see: - [deepspeed-zero-inference](#deepspeed-zero-inference). + [zero-inference](#zero-inference). There is also DeepSpeed Inference - this is a totally different technology which uses Tensor Parallelism instead of ZeRO (coming soon). @@ -81,7 +81,7 @@ pip install transformers[deepspeed] or find more details on [the DeepSpeed's GitHub page](https://github.com/microsoft/deepspeed#installation) and [advanced install](https://www.deepspeed.ai/tutorials/advanced-install/). -If you're still struggling with the build, first make sure to read [zero-install-notes](#zero-install-notes). +If you're still struggling with the build, first make sure to read [CUDA Extension Installation Notes](trainer#cuda-extension-installation-notes). If you don't prebuild the extensions and rely on them to be built at run time and you tried all of the above solutions to no avail, the next thing to try is to pre-build the modules before installing them.