Steven Liu
|
738ec75c90
|
[docs] DeepSpeed (#28542)
* config
* optim
* pre deploy
* deploy
* save weights, memory, troubleshoot, non-Trainer
* done
|
2024-01-24 08:31:28 -08:00 |
|
Joao Gante
|
4fb3d3a0f6
|
TF: purge TFTrainer (#28483)
|
2024-01-12 16:56:34 +00:00 |
|
Dean Wyatte
|
cad9f5c6cc
|
Update docs around mixing hf scheduler with deepspeed optimizer (#28223)
update docs around mixing hf scheduler with deepspeed optimizer
|
2024-01-02 11:48:17 +00:00 |
|
Peter Pan
|
ce31508134
|
docs: replace torch.distributed.run by torchrun (#27528)
* docs: replace torch.distributed.run by torchrun
`transformers` now officially support pytorch >= 1.10.
The entrypoint `torchrun`` is present from 1.10 onwards.
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
* Update src/transformers/trainer.py
with @ArthurZucker's suggestion
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
---------
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
|
2023-11-27 16:26:33 +00:00 |
|
Tuowei Wang
|
a9862a0f49
|
Fix Typo: table in deepspeed.md (#26705)
|
2023-10-10 11:50:10 +02:00 |
|
Aman Gupta Karmani
|
39c37fe45c
|
Fix incorrect Boolean value in deepspeed example (#25788)
|
2023-08-29 09:22:37 +02:00 |
|
Younes Belkada
|
4b79697865
|
🚨🚨🚨 [Refactor] Move third-party related utility files into integrations/ folder 🚨🚨🚨 (#25599)
* move deepspeed to `lib_integrations.deepspeed`
* more refactor
* oops
* fix slow tests
* Fix docs
* fix docs
* addess feedback
* address feedback
* final modifs for PEFT
* fixup
* ok now
* trigger CI
* trigger CI again
* Update docs/source/en/main_classes/deepspeed.md
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* import from `integrations`
* address feedback
* revert removal of `deepspeed` module
* revert removal of `deepspeed` module
* fix conflicts
* ooops
* oops
* add deprecation warning
* place it on the top
* put `FutureWarning`
* fix conflicts with not_doctested.txt
* add back `bitsandbytes` module with a depr warning
* fix
* fix
* fixup
* oops
* fix doctests
---------
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
|
2023-08-25 17:13:34 +02:00 |
|
Kevin Lloyd Bernal
|
ad8321512d
|
recommend DeepSpeed's Argument Parsing documentation (#25268)
|
2023-08-02 11:48:39 -04:00 |
|
Sylvain Gugger
|
eb849f6604
|
Migrate doc files to Markdown. (#24376)
* Rename index.mdx to index.md
* With saved modifs
* Address review comment
* Treat all files
* .mdx -> .md
* Remove special char
* Update utils/tests_fetcher.py
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
---------
Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
|
2023-06-20 18:07:47 -04:00 |
|