Pavel Iakubovskii
c15aad0939
Add strategy to store results in evaluation loop ( #30267 )
...
* Add evaluation loop container for interm. results
* Add tests for EvalLoopContainer
* Formatting
* Fix padding_index in test and typo
* Move EvalLoopContainer to pr_utils to avoid additional imports
* Fix `eval_do_concat_batches` arg description
* Fix EvalLoopContainer import
2024-04-17 12:42:27 +01:00
Aaron Gokaslan
5e8c8eb5ba
Apply ruff flake8-comprehensions ( #21694 )
2023-02-22 09:14:54 +01:00
Antoni Baum
47412c7d43
Ensure tensors are at least 1d for pad and concat ( #17179 )
...
* Ensure tensors are at least 1d for pad and concat
* Compatibility
* Fix
* Fix
* Add test
* Retrigger CI
* Consistency with master
* Retrigger CI
2022-05-11 13:19:08 -04:00
Antoni Baum
edcc66d27c
Remove unnecessary columns for all dataset types in Trainer ( #17166 )
...
* Remove unneeded columns for IterableDataset
* Add test
* Update trainer tests
* Edit docstring
* Lint
* Apply feedback
* Apply feedback
2022-05-11 11:11:26 -04:00
Zachary Mueller
2fbb237967
Add the auto_find_batch_size capability from Accelerate into Trainer ( #17068 )
...
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
- Adds auto_batch_size finder
- Moves training loop to an inner training loop
2022-05-09 12:29:18 -04:00
code-review-doctor
a2392415e9
Some tests misusing assertTrue for comparisons fix ( #16771 )
...
* Fix issue avoid-misusing-assert-true found at https://codereview.doctor
* fix tests
* fix tf
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com >
2022-04-19 14:44:08 +02:00
Sylvain Gugger
4975002df5
Reorganize file utils ( #16264 )
...
* Split file_utils in several submodules
* Fixes
* Add back more objects
* More fixes
* Who exactly decided to import that from there?
* Second suggestion to code with code review
* Revert wront move
* Fix imports
* Adapt all imports
* Adapt all imports everywhere
* Revert this import, will fix in a separate commit
2022-03-23 10:26:33 -04:00
Lysandre Debut
29c10a41d0
[Test refactor 1/5] Per-folder tests reorganization ( #15725 )
...
* Per-folder tests reorganization
Co-authored-by: sgugger <sylvain.gugger@gmail.com >
Co-authored-by: Stas Bekman <stas@stason.org >
2022-02-23 15:46:28 -05:00
