SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Fix link to deepspeed config

Browse Source
This commit is contained in:
Sylvain Gugger
2022-01-12 09:32:53 -05:00
parent 6820904454
commit c425d60bb9
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/main_classes/deepspeed.mdx
View File

@@ -1707,13 +1707,13 @@ Work is being done to enable estimating how much memory is needed for a specific
## Non-Trainer Deepspeed Integration ## Non-Trainer Deepspeed Integration
The [`~integrations.HfDeepSpeedConfig`] is used to integrate Deepspeed into the 🤗 Transformers core The [`~deepspeed.HfDeepSpeedConfig`] is used to integrate Deepspeed into the 🤗 Transformers core
functionality, when [`Trainer`] is not used. functionality, when [`Trainer`] is not used.
When using [`Trainer`] everything is automatically taken care of. When using [`Trainer`] everything is automatically taken care of.
When not using [`Trainer`], to efficiently deploy DeepSpeed stage 3, you must instantiate the When not using [`Trainer`], to efficiently deploy DeepSpeed stage 3, you must instantiate the
[`~integrations.HfDeepSpeedConfig`] object before instantiating the model. [`~deepspeed.HfDeepSpeedConfig`] object before instantiating the model.
For example for a pretrained model: For example for a pretrained model: