SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Update perf_train_gpu_one.mdx (#19676)

Browse Source
This commit is contained in:
Christopher Akiki
2022-10-17 16:54:35 +02:00
committed by GitHub
parent 0027edf905
commit aa629e7a7c
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/en/perf_train_gpu_one.mdx
View File

@@ -25,7 +25,7 @@ In this section we have a look at a few tricks to reduce the memory footprint an
| DataLoader | Yes | No | | DataLoader | Yes | No |
| DeepSpeed Zero | No | Yes | | DeepSpeed Zero | No | Yes |
A bracket means that it might not be strictly the case but is usually either not a main concern or negligable. Before we start make sure you have installed the following libraries: A bracket means that it might not be strictly the case but is usually either not a main concern or negligible. Before we start make sure you have installed the following libraries:
```bash ```bash
pip install transformers datasets accelerate nvidia-ml-py3 pip install transformers datasets accelerate nvidia-ml-py3
@@ -732,4 +732,4 @@ TrainingArguments(torchdynamo="fx2trt-f16") #enable tensorRT fp16
This feature involves 3 different libraries. To install them, please follow the instructions below: This feature involves 3 different libraries. To install them, please follow the instructions below:
- [Torchdynamo installation](https://github.com/pytorch/torchdynamo#requirements-and-setup) - [Torchdynamo installation](https://github.com/pytorch/torchdynamo#requirements-and-setup)
- [Functorch installation](https://github.com/pytorch/functorch#install) - [Functorch installation](https://github.com/pytorch/functorch#install)
- [Torch-TensorRT(FX) installation](https://github.com/pytorch/TensorRT/blob/master/docsrc/tutorials/getting_started_with_fx_path.rst#installation) - [Torch-TensorRT(FX) installation](https://github.com/pytorch/TensorRT/blob/master/docsrc/tutorials/getting_started_with_fx_path.rst#installation)