SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[docs] fixed links with 404 (#27327)

Browse Source 
* fixed links with 404

* make style
This commit is contained in:
Maria Khalusova
2023-11-06 14:45:03 -05:00
committed by GitHub
parent 1b20e2bb42
commit 9beb2737d7
44 changed files with 88 additions and 77 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/en/perf_train_gpu_many.md
View File

@@ -270,7 +270,7 @@ which is discussed next.
Implementations:
- [DeepSpeed](https://www.deepspeed.ai/features/#the-zero-redundancy-optimizer) ZeRO-DP stages 1+2+3
- [DeepSpeed](https://www.deepspeed.ai/tutorials/zero/) ZeRO-DP stages 1+2+3
- [`Accelerate` integration](https://huggingface.co/docs/accelerate/en/usage_guides/deepspeed)
- [`transformers` integration](main_classes/trainer#trainer-integrations)
@@ -434,7 +434,7 @@ This section is based on the original much more [detailed TP overview](https://g
by [@anton-l](https://github.com/anton-l).
Alternative names:
- DeepSpeed calls it [tensor slicing](https://www.deepspeed.ai/features/#model-parallelism)
- DeepSpeed calls it [tensor slicing](https://www.deepspeed.ai/training/#model-parallelism)
Implementations:
- [Megatron-LM](https://github.com/NVIDIA/Megatron-LM) has an internal implementation, as it's very model-specific