Mehant Kammakomati c3ba53303b feat: add support for tensor parallel training workflow with accelerate (#34194) ...

* feat: add support for tensor parallel flow using accelerate

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* fix: add tp degree to env variable

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* fix: add version check for accelerate to allow TP

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* docs: tensor parallelism

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* nit: rename plugin name

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* fix: guard accelerate version before allow tp

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

* docs: add more docs and updates related to TP

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>

---------

Signed-off-by: Mehant Kammakomati <mehant.kammakomati2@ibm.com>
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

2025-02-18 14:05:46 +01:00

..

internal

🌐 [i18n-KO] Translated trainer_utils.md to Korean (#33817)

2024-10-15 11:21:05 -07:00

main_classes

FEAT : Adding VPTQ quantization method to HFQuantizer (#34770)

2024-12-20 09:45:53 +01:00

model_doc

🌐 [i18n-KO] Translated altclip.md to Korean (#34594)

2025-01-06 08:45:26 -08:00

quantization

🌐 [i18n-KO] Translated awq.mdto Korean (#32324)

2024-08-12 10:12:48 -07:00

tasks

Move DataCollatorForMultipleChoice from the docs to the package (#34763)

2025-02-13 12:01:28 +01:00

_config.py

[#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888)

2024-04-08 14:21:16 +01:00

_toctree.yml

Remove old benchmark code (#35730)

2025-01-21 17:56:43 +00:00

accelerate.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

add_new_model.md

Remove add-new-model in favor of add-new-model-like (#30424)

2024-04-24 09:38:18 +02:00

add_new_pipeline.md

add push_to_hub to pipeline (#29172)

2024-04-16 15:34:04 +01:00

attention.md

[Docs] Fix broken links and syntax issues (#28918)

2024-02-08 14:13:35 -08:00

autoclass_tutorial.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

bertology.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

big_models.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

chat_templating.md

🌐 [i18n-KO] Translated chat_templating.md to Korean (#32362)

2024-08-07 11:25:19 -07:00

community.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

contributing.md

Drop support for Python 3.8 (#34314)

2024-10-24 11:16:55 +02:00

conversations.md

🌐 [i18n-KO] Translated conversations.md to Korean (#32468)

2024-08-27 09:25:41 -07:00

create_a_model.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

custom_models.md

Updated the custom_models.md changed cross_entropy code (#33118)

2024-08-26 13:15:43 +02:00

debugging.md

🌐 [i18n-KO] Translated debugging.md to Korean (#26246)

2023-09-27 13:47:44 -07:00

deepspeed.md

DeepSpeed github repo move sync (#36021)

2025-02-05 08:19:31 -08:00

fast_tokenizers.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

fsdp.md

🌐 [i18n-KO] Translated fsdp.md to Korean (#32261)

2024-08-08 09:40:03 -07:00

generation_strategies.md

Docs: update example with assisted generation + sample (#30853)

2024-05-16 14:32:21 +01:00

gguf.md

🌐 [i18n-KO] Translated gguf.md to Korean (#33764)

2024-10-07 12:49:08 -07:00

hpo_train.md

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00

in_translation.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

index.md

[Docs] Add missing language options and fix broken links (#28852)

2024-02-06 12:01:01 -08:00

installation.md

docs: HUGGINGFACE_HUB_CACHE -> HF_HUB_CACHE (#34904)

2024-11-26 09:37:18 -08:00

llm_optims.md

FEAT : Adding VPTQ quantization method to HFQuantizer (#34770)

2024-12-20 09:45:53 +01:00

llm_tutorial_optimization.md

🌐 [i18n-KO] Translated ko-llm_tutorial_optimization.md to Korean (#32372)

2024-08-08 09:37:39 -07:00

llm_tutorial.md

Update Korean tutorial for using LLMs, and refactor the nested conditional statements in hr_argparser.py (#27489)

2023-11-20 17:14:23 +00:00

model_memory_anatomy.md

🚨🚨🚨Deprecate evaluation_strategy to eval_strategy🚨🚨🚨 (#30190)

2024-04-18 12:49:43 -04:00

model_sharing.md

[docs] update not-working model revision (#34682)

2024-11-11 07:09:31 -08:00

model_summary.md

🌐 [i18n-KO] Translated model_summary.md to Korean (#24625)

2023-08-09 18:27:27 +02:00

modular_transformers.md

🌐 [i18n-KO] Translated modular_transformers.md to Korean (#33772)

2024-10-08 18:30:41 -07:00

multilingual.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

pad_truncation.md

[Docs] Fix backticks in inline code and documentation links (#28875)

2024-02-06 11:15:44 -08:00

peft.md

Docs / Quantization: Replace all occurences of load_in_8bit with bnb config (#31136)

2024-05-30 16:47:35 +02:00

perf_hardware.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_infer_cpu.md

🌐 [i18n-KO] Translated perf_infer_cpu.md to Korean (#24920)

2023-07-25 16:04:14 +02:00

perf_infer_gpu_one.md

Docs / Quantization: Replace all occurences of load_in_8bit with bnb config (#31136)

2024-05-30 16:47:35 +02:00

perf_train_cpu_many.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_train_cpu.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_train_gpu_many.md

DeepSpeed github repo move sync (#36021)

2025-02-05 08:19:31 -08:00

perf_train_special.md

🌐 [i18n-KO] Translated perf_train_special.md to Korean (#34590)

2024-11-04 09:41:44 -08:00

perf_train_tpu_tf.md

🌐 [i18n-KO] Translated perf_train_tpu_tf.md to Korean (#25433)

2023-08-18 23:08:34 +02:00

performance.md

🌐[i18n-KO] Translated performance.md to Korean (#24883)

2023-07-24 09:23:34 -04:00

perplexity.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

philosophy.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

pipeline_tutorial.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

pipeline_webserver.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

pr_checks.md

[i18n-KO] Translated docs: ko: pr_checks.md to Korean (#24987)

2023-08-17 08:03:17 +02:00

preprocessing.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

quicktour.md

Fix typos in translated quicktour docs (#35302)

2024-12-17 09:32:00 -08:00

run_scripts.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

sagemaker.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

serialization.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

task_summary.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

tasks_explained.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

testing.md

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

tf_xla.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

tflite.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

tokenizer_summary.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

torchscript.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

trainer.md

feat: add support for tensor parallel training workflow with accelerate (#34194)

2025-02-18 14:05:46 +01:00

training.md

🚨🚨🚨Deprecate evaluation_strategy to eval_strategy🚨🚨🚨 (#30190)

2024-04-18 12:49:43 -04:00

transformers_agents.md

🌐 [i18n-KO] Translated transformers_agents.md to Korean (#24881)

2023-07-28 13:06:37 -04:00

troubleshooting.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00