Tim Dettmers 796162c512 Paged Optimizer + Lion Optimizer for Trainer (#23217) ...

* Added lion and paged optimizers and made original tests pass.

* Added tests for paged and lion optimizers.

* Added and fixed optimizer tests.

* Style and quality checks.

---------

Co-authored-by: younesbelkada <younesbelkada@gmail.com>

2023-05-24 12:53:28 +02:00

..

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_data_collator.py

handle numpy inputs in whole word mask data collator (#22032)

2023-03-10 10:50:29 -05:00

test_trainer_callback.py

Apply ruff flake8-comprehensions (#21694)

2023-02-22 09:14:54 +01:00

test_trainer_distributed.py

Introduce PartialState as the device handler in the Trainer (#22752)

2023-04-17 15:09:45 -04:00

test_trainer_seq2seq.py

Reorganize file utils (#16264)

2022-03-23 10:26:33 -04:00

test_trainer_tpu.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_trainer_utils.py

Apply ruff flake8-comprehensions (#21694)

2023-02-22 09:14:54 +01:00

test_trainer.py

Paged Optimizer + Lion Optimizer for Trainer (#23217)

2023-05-24 12:53:28 +02:00