Mehant Kammakomati c3ba53303b feat: add support for tensor parallel training workflow with accelerate (#34194) ...

* feat: add support for tensor parallel flow using accelerate

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* fix: add tp degree to env variable

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* fix: add version check for accelerate to allow TP

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* docs: tensor parallelism

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* nit: rename plugin name

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* fix: guard accelerate version before allow tp

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* docs: add more docs and updates related to TP

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

---------

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

2025-02-18 14:05:46 +01:00

..

ar

feat: add support for tensor parallel training workflow with accelerate (#34194)

2025-02-18 14:05:46 +01:00

de

Fix typos in translated quicktour docs (#35302)

2024-12-17 09:32:00 -08:00

en

feat: add support for tensor parallel training workflow with accelerate (#34194)

2025-02-18 14:05:46 +01:00

es

feat: add support for tensor parallel training workflow with accelerate (#34194)

2025-02-18 14:05:46 +01:00

fr

Add French translation of task_summary and tasks_explained (#33407)

2025-01-06 14:23:52 +01:00

hi

[i18n-HI] Translated TFLite page to Hindi (#34572)

2024-11-04 09:40:30 -08:00

it

Fix typos in translated quicktour docs (#35302)

2024-12-17 09:32:00 -08:00

ja

Move DataCollatorForMultipleChoice from the docs to the package (#34763)

2025-02-13 12:01:28 +01:00

ko

feat: add support for tensor parallel training workflow with accelerate (#34194)

2025-02-18 14:05:46 +01:00

ms

Remove old benchmark code (#35730)

2025-01-21 17:56:43 +00:00

pt

Fix typos in translated quicktour docs (#35302)

2024-12-17 09:32:00 -08:00

te

Fix typos in translated quicktour docs (#35302)

2024-12-17 09:32:00 -08:00

tr

Translate index.md to Turkish (#27093)

2023-11-08 08:35:20 -05:00

zh

DeepSpeed github repo move sync (#36021)

2025-02-05 08:19:31 -08:00

_config.py

[#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888)

2024-04-08 14:21:16 +01:00