Marc Sun bfc9ddf5c6 Add StableAdamW Optimizer (#39446) ...

* Added StableAdamW as an optimizer option for Trainer. Also wrote tests to verify its behaviour.

* Fixed issue with

* Added docs for StableAdamW. Also fixed a typo in schedule free optimizers

---------

Co-authored-by: Gautham Krithiwas <gauthamkrithiwas2003@gmail.com>

2025-07-16 13:35:53 +02:00

..

bettertransformer

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

commands

[tests] tag serve tests as slow (#39343)

2025-07-10 15:40:08 +00:00

deepspeed

Remove script datasets in tests (#38940)

2025-06-25 14:31:20 +00:00

extended

Add Optional to remaining types (#37808)

2025-04-28 14:20:45 +01:00

fixtures

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

fsdp

Gaudi3 CI (#38790)

2025-06-23 10:56:51 +02:00

generation

[refactor] set attention implementation (#38974)

2025-07-15 09:34:06 +02:00

models

Defaults to adamw_torch_fused for Pytorch>=2.8 (#37358)

2025-07-16 09:52:33 +00:00

optimization

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

peft_integration

TST Fix PEFT integration test bitsandbytes config (#39082)

2025-06-27 18:33:11 +02:00

pipelines

Fix bugs from pipeline preprocessor overhaul (#39425)

2025-07-15 14:28:59 +01:00

quantization

Remove residual quantization attribute from dequantized models (#39373)

2025-07-15 17:16:10 +02:00

repo_utils

[modular] speedup check_modular_conversion with multiprocessing (#37456)

2025-07-10 19:07:59 +01:00

sagemaker

Deprecate TF + JAX (#38758)

2025-06-11 17:28:06 +01:00

tensor_parallel

enable static cache on TP model (#39164)

2025-07-09 21:14:45 +00:00

tokenization

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

trainer

Add StableAdamW Optimizer (#39446)

2025-07-16 13:35:53 +02:00

utils

[Core] [Offloading] Fix saving offloaded submodules (#39280)

2025-07-16 08:44:40 +00:00

__init__.py

…

causal_lm_tester.py

Refactor DBRX tests to use CausalLMModelTest base classes (#38475)

2025-06-13 16:22:12 +01:00

test_backbone_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_configuration_common.py

Update composition flag usage (#36263)

2025-04-09 11:48:49 +02:00

test_feature_extraction_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_image_processing_common.py

Fix overriding Fast Image/Video Processors instance attributes affect other instances (#39363)

2025-07-12 23:39:06 +00:00

test_image_transforms.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_modeling_common.py

Add ModernBERT Decoder Models - ModernBERT, but trained with CLM! (#38967)

2025-07-15 10:40:41 +02:00

test_pipeline_mixin.py

No more Tuple, List, Dict (#38797)

2025-06-17 19:37:18 +01:00

test_processing_common.py

[chat template] add a testcase for kwargs (#39415)

2025-07-16 11:31:35 +02:00

test_sequence_feature_extraction_common.py

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

test_tokenization_common.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_tokenization_mistral_common.py

Add mistral common support (#38906)

2025-07-11 16:26:58 +00:00

test_training_args.py

Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734)

2025-03-17 16:09:46 +01:00

test_video_processing_common.py

Fix overriding Fast Image/Video Processors instance attributes affect other instances (#39363)

2025-07-12 23:39:06 +00:00