Jason (Siyu) Zhu adb91179b9 Integrate Liger (Linkedin GPU Efficient Runtime) Kernel to Trainer (#32860) ...

* add liger integration

* fix syntax

* fix import issue

* add trainer.md

* Use _apply_liger_kernel()

* Fixed log message

* Update docs/source/en/trainer.md

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* Update docs/source/en/trainer.md

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* Update src/transformers/training_args.py

Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>

* Update src/transformers/trainer.py

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* Update src/transformers/training_args.py

Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>

* Update docs/source/en/trainer.md

Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>

* Fixed checkstyle and updated readme

* Added test

* Fixed checkstyle

* fix docstring

* rename use_liger to use_liger_kernel

* Trigger Build

* Added test

* add fix-copies

* Fixed copy inconsistencies

---------

Co-authored-by: shimizust <sshimizu@linkedin.com>
Co-authored-by: Steven Shimizu <shimizust@gmail.com>
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>

2024-08-23 13:20:49 +02:00

..

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_data_collator.py

Enhancing SFT Training Efficiency Using Packing and FlashAttention2 with Position IDs (#31629)

2024-07-23 15:56:41 +02:00

test_trainer_callback.py

Modify warnings in a with block to avoid flaky tests (#31893)

2024-07-10 17:56:12 +02:00

test_trainer_distributed.py

CI: update to ROCm 6.0.2 and test MI300 (#30266)

2024-05-13 18:14:36 +02:00

test_trainer_seq2seq.py

Pass datasets trust_remote_code (#31406)

2024-06-17 17:29:13 +01:00

test_trainer_tpu.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_trainer_utils.py

Add strategy to store results in evaluation loop (#30267)

2024-04-17 12:42:27 +01:00

test_trainer.py

Integrate Liger (Linkedin GPU Efficient Runtime) Kernel to Trainer (#32860)

2024-08-23 13:20:49 +02:00