Zach Mueller 0507e69d34 Introduce AcceleratorConfig dataclass (#28664) ...

* Introduce acceleratorconfig dataclass

* Extra second warn

* Move import

* Try moving import under is_accelerate_available

* Quality

* Apply suggestions from code review

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Clean

* Remove to_kwargs

* Change version

* Improve tests by including dispatch and split batches

* Improve reliability

* Update tests/trainer/test_trainer.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Fixup tests and review nits

* Make tests pass

* protect import

* Protect import

* Empty-Commit

* Make training_args.to_dict handle the AcceleratorConfig

---------

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

2024-02-14 10:18:09 -05:00

..

benchmark

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

bettertransformer

Fixed malapropism error (#26660)

2023-10-09 11:04:57 +02:00

deepspeed

DeepSpeed: hardcode torch.arange dtype on float usage to avoid incorrect initialization (#28760)

2024-01-31 14:39:07 +00:00

extended

Device agnostic trainer testing (#27131)

2023-10-30 18:16:40 +00:00

fixtures

[WIP] add SpeechT5 model (#18922)

2023-02-03 12:43:46 -05:00

fsdp

fix resuming from ckpt when using FSDP with FULL_STATE_DICT (#27891)

2023-12-16 19:41:43 +05:30

generation

Support batched input for decoder start ids (#28887)

2024-02-08 16:00:53 +00:00

models

Add SiglipForImageClassification and CLIPForImageClassification (#28952)

2024-02-14 08:41:31 +01:00

optimization

Make schedulers picklable by making lr_lambda fns global (#21768)

2023-03-02 12:08:43 -05:00

peft_integration

[Peft] modules_to_save support for peft integration (#27466)

2023-11-14 10:32:57 +01:00

pipelines

[Nougat] Fix pipeline (#28242)

2024-02-12 10:21:15 +01:00

quantization

AQLM quantizer support (#28928)

2024-02-14 09:25:41 +01:00

repo_utils

Allow # Ignore copy (#27328)

2023-12-07 10:00:08 +01:00

sagemaker

Add tf_keras imports to prepare for Keras 3 (#28588)

2024-01-30 17:26:36 +00:00

tokenization

[Styling] stylify using ruff (#27144)

2023-11-16 17:43:19 +01:00

tools

Add support for for loops in python interpreter (#24429)

2023-06-26 09:58:14 -04:00

trainer

Introduce AcceleratorConfig dataclass (#28664)

2024-02-14 10:18:09 -05:00

utils

fix / skip (for now) some tests before switch to torch 2.2 (#28838)

2024-02-02 14:11:50 +01:00

__init__.py

…

test_backbone_common.py

Align backbone stage selection with out_indices & out_features (#27606)

2023-12-20 18:33:17 +00:00

test_cache_utils.py

Static Cache: load models with MQA or GQA (#28975)

2024-02-13 09:58:19 +00:00

test_configuration_common.py

[ PretrainedConfig] Improve messaging (#27438)

2023-11-15 14:10:39 +01:00

test_configuration_utils.py

Config: warning when saving generation kwargs in the model config (#28514)

2024-01-16 18:31:01 +00:00

test_feature_extraction_common.py

Split common test from core tests (#24284)

2023-06-15 07:30:24 -04:00

test_feature_extraction_utils.py

Remove-auth-token (#27060)

2023-11-13 14:20:54 +01:00

test_image_processing_common.py

Fix a couple of typos and add an illustrative test (#26941)

2023-12-11 15:51:51 +00:00

test_image_processing_utils.py

Remove-auth-token (#27060)

2023-11-13 14:20:54 +01:00

test_image_transforms.py

Normalize floating point cast (#27249)

2023-11-10 15:35:27 +00:00

test_modeling_common.py

Tests: tag test_save_load_fast_init_from_base as flaky (#28930)

2024-02-12 14:43:34 +00:00

test_modeling_flax_common.py

[Flax] Update no init test for Flax v0.7.1 (#28735)

2024-01-26 18:20:39 +00:00

test_modeling_flax_utils.py

Enable safetensors conversion from PyTorch to other frameworks without the torch requirement (#27599)

2024-01-23 10:28:23 +01:00

test_modeling_tf_common.py

Add tf_keras imports to prepare for Keras 3 (#28588)

2024-01-30 17:26:36 +00:00

test_modeling_tf_utils.py

Add tf_keras imports to prepare for Keras 3 (#28588)

2024-01-30 17:26:36 +00:00

test_modeling_utils.py

Revert "[WIP] Hard error when ignoring tensors." (#28898)

2024-02-06 17:18:30 +01:00

test_pipeline_mixin.py

Image Feature Extraction pipeline (#28216)

2024-02-05 14:50:07 +00:00

test_processing_common.py

Don't save processor_config.json if a processor has no extra attribute (#28584)

2024-01-19 09:59:14 +00:00

test_sequence_feature_extraction_common.py

Fix typo (#25966)

2023-09-05 10:12:25 +02:00

test_tokenization_common.py

[ TokenizationUtils] Fix add_special_tokens when the token is already there (#28520)

2024-01-16 16:36:29 +01:00

test_tokenization_utils.py

Remove-auth-token (#27060)

2023-11-13 14:20:54 +01:00