Matthew Douglas 196d35ccfc Add AdEMAMix optimizer (#33682) ...

* Add AdEMAMix optimizer

* Fix test

* Update tests/trainer/test_trainer.py

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

---------

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

2024-09-25 18:07:21 +01:00

..

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_data_collator.py

Enhancing SFT Training Efficiency Using Packing and FlashAttention2 with Position IDs (#31629)

2024-07-23 15:56:41 +02:00

test_trainer_callback.py

add a callback hook right before the optimizer step (#33444)

2024-09-13 10:43:45 +02:00

test_trainer_distributed.py

CI: update to ROCm 6.0.2 and test MI300 (#30266)

2024-05-13 18:14:36 +02:00

test_trainer_seq2seq.py

Pass datasets trust_remote_code (#31406)

2024-06-17 17:29:13 +01:00

test_trainer_tpu.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_trainer_utils.py

Add strategy to store results in evaluation loop (#30267)

2024-04-17 12:42:27 +01:00

test_trainer.py

Add AdEMAMix optimizer (#33682)

2024-09-25 18:07:21 +01:00