jeffhataws c59d71b282 Add AWS Neuron torchrun support (#20806) ...

* Add XLA torchrun support

* Clarify that currently DDP doesn't work with torch.distributed XLA backend yet

* Enable DDP with torchrun and XLA (now available in PT-XLA 1.13)

* Add check for AWS Neuron availability and AWS Neuron specific compiler flag

* Change the new test's name to TestTrainerDistributedNeuronCore

* Remove "assert" and replace raised exception

* Remove compiler flag as it is optional. If needed, will be another PR.

* Use TORCHELASTIC_RUN_ID to determine whether torchrun is used

2023-01-18 11:21:19 -05:00

..

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_data_collator.py

Data collator for token classification pads labels column when receives pytorch tensors (#20244)

2022-11-16 12:18:46 -05:00

test_trainer_callback.py

Make predict() close progress bars after finishing (#17952) (#18078)

2022-07-08 16:44:24 -04:00

test_trainer_distributed.py

Add AWS Neuron torchrun support (#20806)

2023-01-18 11:21:19 -05:00

test_trainer_seq2seq.py

Reorganize file utils (#16264)

2022-03-23 10:26:33 -04:00

test_trainer_tpu.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_trainer_utils.py

Ensure tensors are at least 1d for pad and concat (#17179)

2022-05-11 13:19:08 -04:00

test_trainer.py

Adapt repository creation to latest hf_hub (#21158)

2023-01-18 11:14:00 -05:00