SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[docs] Fix doc format (#28684)

Browse Source 
* fix hfoptions

* revert changes to other files

* fix
This commit is contained in:
Steven Liu
2024-01-24 11:18:59 -08:00
committed by GitHub
parent 8278b1538e
commit f40b87de0c
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
docs/source/en/deepspeed.md
View File

@@ -956,6 +956,8 @@ engine = deepspeed.initialize(model=model, config_params=ds_config, ...)
</hfoption> </hfoption>
<hfoption id="non-pretrained model"> <hfoption id="non-pretrained model">
[`HfDeepSpeedConfig`] is not required for ZeRO-1 or ZeRO-2.
```py ```py
from transformers.integrations import HfDeepSpeedConfig from transformers.integrations import HfDeepSpeedConfig
from transformers import AutoModel, AutoConfig from transformers import AutoModel, AutoConfig
@@ -969,7 +971,8 @@ model = AutoModel.from_config(config)
engine = deepspeed.initialize(model=model, config_params=ds_config, ...) engine = deepspeed.initialize(model=model, config_params=ds_config, ...)
``` ```
[`HfDeepSpeedConfig`] is not required for ZeRO-1 or ZeRO-2. </hfoption>
</hfoptions>
### Non-Trainer ZeRO Inference ### Non-Trainer ZeRO Inference