Zachary Mueller 2fbb237967 Add the auto_find_batch_size capability from Accelerate into Trainer (#17068) ...

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

- Adds auto_batch_size finder 
- Moves training loop to an inner training loop

2022-05-09 12:29:18 -04:00

..

benchmark

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

deepspeed

Move test model folders (#17034)

2022-05-03 14:42:02 +02:00

extended

Fix issue probably-meant-fstring found at https://codereview.doctor (#16913)

2022-04-25 15:15:00 -04:00

fixtures

add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629)

2022-04-11 11:06:10 +02:00

generation

TF: XLA bad words logits processor and list of processors (#16974)

2022-04-29 15:54:58 +01:00

models

LayoutLMv2Processor: ensure 1-to-1 mapping between images and samples in case of overflowing tokens (#17092)

2022-05-09 07:39:08 -04:00

onnx

add mobilebert onnx configs (#17029)

2022-05-09 10:36:53 -04:00

optimization

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

pipelines

fix missing "models" in pipeline test module (#17090)

2022-05-05 16:12:01 +02:00

sagemaker

Adapt import to new structure

2022-03-24 14:40:05 -04:00

tokenization

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

trainer

Add the auto_find_batch_size capability from Accelerate into Trainer (#17068)

2022-05-09 12:29:18 -04:00

utils

Move test model folders (#17034)

2022-05-03 14:42:02 +02:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_configuration_common.py

Make sure telemetry arguments are not returned as unused kwargs (#17063)

2022-05-04 07:47:57 -04:00

test_feature_extraction_common.py

Move test model folders (#17034)

2022-05-03 14:42:02 +02:00

test_modeling_common.py

Improve test_pt_tf_model_equivalence on PT side (#16731)

2022-04-19 21:13:27 +02:00

test_modeling_flax_common.py

[Flax] improve large model init and loading (#16148)

2022-04-19 14:19:55 +02:00

test_modeling_tf_common.py

TF: XLA stable softmax (#16892)

2022-04-25 20:10:51 +01:00

test_sequence_feature_extraction_common.py

Some tests misusing assertTrue for comparisons fix (#16771)

2022-04-19 14:44:08 +02:00

test_tokenization_common.py

Fix #16660 (tokenizers setters of ids of special tokens) (#16661)

2022-04-13 07:49:06 -04:00