SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

TF: purge TFTrainer (#28483)

Browse Source
This commit is contained in:
Joao Gante
2024-01-12 16:56:34 +00:00
committed by GitHub
parent afc45b13ca
commit 4fb3d3a0f6
15 changed files with 233 additions and 1682 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
docs/source/en/main_classes/deepspeed.md
View File

@@ -2049,7 +2049,6 @@ In this case you usually need to raise the value of `initial_scale_power`. Setti
### Notes
- DeepSpeed works with the PyTorch [`Trainer`] but not TF [`TFTrainer`].
- While DeepSpeed has a pip installable PyPI package, it is highly recommended that it gets installed from [source](https://github.com/microsoft/deepspeed#installation) to best match your hardware and also if you need to enable
certain features, like 1-bit Adam, which aren't available in the pypi distribution.
- You don't have to use the [`Trainer`] to use DeepSpeed with 🤗 Transformers - you can use any model