Sourab Mangrulkar f4eb459ef2 fsdp fixes and enhancements (#24980) ...

* fix fsdp prepare to remove the warnings and fix excess memory usage

* Update training_args.py

* parity for FSDP+XLA

* Update trainer.py

2023-07-21 17:52:48 +05:30

..

internal

Generate: add SequenceBiasLogitsProcessor (#24334)

2023-06-21 11:14:41 +01:00

main_classes

fsdp fixes and enhancements (#24980)

2023-07-21 17:52:48 +05:30

model_doc

Deprecate unused OpenLlama architecture (#24922)

2023-07-20 07:03:24 -04:00

tasks

Add DINOv2 (#24016)

2023-07-18 15:34:06 +01:00

_config.py

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

_toctree.yml

[Llama2] Add support for Llama 2 (#24891)

2023-07-18 15:18:31 -04:00

accelerate.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

add_new_model.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

add_new_pipeline.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

add_tensorflow_model.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

attention.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

autoclass_tutorial.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

benchmarks.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bertology.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

big_models.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

community.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

contributing.md

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

create_a_model.md

Update old existing feature extractor references (#24552)

2023-06-29 10:17:36 +01:00

custom_models.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

custom_tools.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

debugging.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

fast_tokenizers.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

generation_strategies.md

Generate: group_beam_search requires diversity_penalty>0.0 (#24456)

2023-06-27 10:46:39 +01:00

glossary.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

hpo_train.md

Update RayTune doc link for Hyperparameter tuning (#24422)

2023-06-22 10:38:01 -04:00

index.md

Update tested versions in READMEs (#24895)

2023-07-19 07:17:34 -04:00

installation.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

model_sharing.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

model_summary.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

multilingual.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

notebooks.md

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

pad_truncation.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_hardware.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_infer_cpu.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_infer_gpu_many.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_infer_gpu_one.md

Docs: 4 bit doc corrections (#24572)

2023-06-29 13:13:20 +01:00

perf_infer_special.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_train_cpu_many.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_train_cpu.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_train_gpu_many.md

deprecate sharded_ddp training argument (#24825)

2023-07-17 06:57:42 -04:00

perf_train_gpu_one.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_train_special.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_train_tpu_tf.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perf_train_tpu.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

performance.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perplexity.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

philosophy.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

pipeline_tutorial.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

pipeline_webserver.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

pr_checks.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

preprocessing.md

Removal of deprecated vision methods and specify deprecation versions (#24570)

2023-06-29 15:09:51 +01:00

quicktour.md

🌐 [i18n-KO] Fixed Korean and English quicktour.md (#24664)

2023-07-21 08:19:28 -04:00

run_scripts.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

sagemaker.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

serialization.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

task_summary.md

Add Multimodal heading and Document question answering in task_summary.mdx (#23318)

2023-07-17 13:51:19 +01:00

tasks_explained.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

testing.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

tf_xla.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

tflite.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

tokenizer_summary.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

torchscript.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

training.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

transformers_agents.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

troubleshooting.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00