SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
18,133 Commits 5 Branches 239 Tags
9ebfda3263fcdc4e05fd87fad1aadc8a08294608
Commit Graph

10 Commits

Author SHA1 Message Date
Ryoo Kwangrok
b1954fd64a layernorm_decay_fix (#35927) 
* layernorm_decay_fix

* W293 fix

* ruff format fix

* black format

* ruff format

* erase last layer

* add test_get_parameter_names_rmsnorm

* rmsnorm fix
 2025-02-04 11:01:49 +01:00
Arthur
b912f5ee43 use torch.testing.assertclose instead to get more details about error in cis (#35659) 
* use torch.testing.assertclose instead to get more details about error in cis

* fix

* style

* test_all

* revert for I bert

* fixes and updates

* more image processing fixes

* more image processors

* fix mamba and co

* style

* less strick

* ok I won't be strict

* skip and be done

* up
 2025-01-24 16:55:28 +01:00
Pavel Iakubovskii
c15aad0939 Add strategy to store results in evaluation loop (#30267) 
* Add evaluation loop container for interm. results

* Add tests for EvalLoopContainer

* Formatting

* Fix padding_index in test and typo

* Move EvalLoopContainer to pr_utils to avoid additional imports

* Fix `eval_do_concat_batches` arg description

* Fix EvalLoopContainer import
 2024-04-17 12:42:27 +01:00
Aaron Gokaslan
5e8c8eb5ba Apply ruff flake8-comprehensions (#21694) 2023-02-22 09:14:54 +01:00
Antoni Baum
47412c7d43 Ensure tensors are at least 1d for pad and concat (#17179) 
* Ensure tensors are at least 1d for pad and concat

* Compatibility

* Fix

* Fix

* Add test

* Retrigger CI

* Consistency with master

* Retrigger CI
 2022-05-11 13:19:08 -04:00
Antoni Baum
edcc66d27c Remove unnecessary columns for all dataset types in Trainer (#17166) 
* Remove unneeded columns for IterableDataset

* Add test

* Update trainer tests

* Edit docstring

* Lint

* Apply feedback

* Apply feedback
 2022-05-11 11:11:26 -04:00
Zachary Mueller
2fbb237967 Add the auto_find_batch_size capability from Accelerate into Trainer (#17068) 
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

- Adds auto_batch_size finder 
- Moves training loop to an inner training loop
 2022-05-09 12:29:18 -04:00
code-review-doctor
a2392415e9 Some tests misusing assertTrue for comparisons fix (#16771) 
* Fix issue avoid-misusing-assert-true found at https://codereview.doctor

* fix tests

* fix tf

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
 2022-04-19 14:44:08 +02:00
Sylvain Gugger
4975002df5 Reorganize file utils (#16264) 
* Split file_utils in several submodules

* Fixes

* Add back more objects

* More fixes

* Who exactly decided to import that from there?

* Second suggestion to code with code review

* Revert wront move

* Fix imports

* Adapt all imports

* Adapt all imports everywhere

* Revert this import, will fix in a separate commit
 2022-03-23 10:26:33 -04:00
Lysandre Debut
29c10a41d0 [Test refactor 1/5] Per-folder tests reorganization (#15725) 
* Per-folder tests reorganization

Co-authored-by: sgugger <sylvain.gugger@gmail.com>
Co-authored-by: Stas Bekman <stas@stason.org>
 2022-02-23 15:46:28 -05:00