Cyril Vallez
380b2a0317
Rework add-new-model-like with modular and make test filenames coherent ( #39612 )
...
* remove tf/flax
* fix
* style
* Update add_new_model_like.py
* work in progress
* continue
* more cleanup
* simplify and first final version
* fixes -> it works
* add linter checks
* Update add_new_model_like.py
* fix
* add modular conversion at the end
* Update add_new_model_like.py
* add video processor
* Update add_new_model_like.py
* Update add_new_model_like.py
* Update add_new_model_like.py
* fix
* Update image_processing_auto.py
* Update image_processing_auto.py
* fix post rebase
* start test filenames replacement
* rename all test_processor -> test_processing
* fix copied from
* add docstrings
* Update add_new_model_like.py
* fix regex
* improve wording
* Update add_new_model_like.py
* Update add_new_model_like.py
* Update add_new_model_like.py
* start adding test
* fix
* fix
* proper first test
* tests
* fix
* fix
* fix
* fix
* modular can be used from anywhere
* protect import
* fix
* Update add_new_model_like.py
* fix
2025-08-04 14:41:09 +02:00
Yuanyuan Chen
95faabf0a6
Apply several ruff SIM rules ( #37283 )
...
* Apply ruff SIM118 fix
Signed-off-by: cyy <cyyever@outlook.com >
* Apply ruff SIM910 fix
Signed-off-by: cyy <cyyever@outlook.com >
* Apply ruff SIM101 fix
Signed-off-by: cyy <cyyever@outlook.com >
* Format code
Signed-off-by: cyy <cyyever@outlook.com >
* More fixes
Signed-off-by: cyy <cyyever@outlook.com >
---------
Signed-off-by: cyy <cyyever@outlook.com >
2025-07-29 11:40:34 +00:00
Quentin Lhoest
858f9b71a8
Remove script datasets in tests ( #38940 )
...
* remove trust_remote_code
* again
* Revert "Skip some tests for now (#38931 )"
This reverts commit 31d30b7224ydshieh@users.noreply.github.com >
2025-06-25 14:31:20 +00:00
Arthur
b912f5ee43
use torch.testing.assertclose instead to get more details about error in cis ( #35659 )
...
* use torch.testing.assertclose instead to get more details about error in cis
* fix
* style
* test_all
* revert for I bert
* fixes and updates
* more image processing fixes
* more image processors
* fix mamba and co
* style
* less strick
* ok I won't be strict
* skip and be done
* up
2025-01-24 16:55:28 +01:00
Albert Villanova del Moral
a14b055b65
Pass datasets trust_remote_code ( #31406 )
...
* Pass datasets trust_remote_code
* Pass trust_remote_code in more tests
* Add trust_remote_dataset_code arg to some tests
* Revert "Temporarily pin datasets upper version to fix CI"
This reverts commit b7672826ca833fc17a3e
2024-06-17 17:29:13 +01:00
Yoach Lacombe
e6708709cb
Add AutoFeatureExtractor support to Wav2Vec2ProcessorWithLM ( #28706 )
...
* Add AutoFeatureExtractor support to Wav2Vec2ProcessorWithLM
* update with a type filter
* add raises error test
* fix added test
2024-05-20 13:40:42 +02:00
Yih-Dar
576994963f
Fix some tests using "common_voice" ( #27147 )
...
* Use mozilla-foundation/common_voice_11_0
* Update expected values
* Update expected values
* For test_word_time_stamp_integration
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com >
2023-10-30 15:27:15 +01:00
Yih-Dar
76d24f1a83
Fix test_word_time_stamp_integration for Wav2Vec2ProcessorWithLMTest ( #22800 )
...
* fix
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com >
2023-04-17 12:41:55 +02:00
Aaron Gokaslan
5e8c8eb5ba
Apply ruff flake8-comprehensions ( #21694 )
2023-02-22 09:14:54 +01:00
Sylvain Gugger
6f79d26442
Update quality tooling for formatting ( #21480 )
...
* Result of black 23.1
* Update target to Python 3.7
* Switch flake8 to ruff
* Configure isort
* Configure isort
* Apply isort with line limit
* Put the right black version
* adapt black in check copies
* Fix copies
2023-02-06 18:10:56 -05:00
Sanchit Gandhi
14d058b940
[W2V2 with LM] Fix decoder test with params ( #21277 )
2023-01-24 19:27:56 +01:00
Sylvain Gugger
4e730b3873
Skip failing test for now ( #21226 )
...
skip failing test for now
2023-01-20 20:46:11 -05:00
Sanchit Gandhi
905e5773a3
[processor] Add 'model input names' property ( #20117 )
...
* [processor] Add 'model input names' property
* add test
* no f string
* add generic property method to mixin
* copy to multimodal
* copy to vision
* tests for all audio
* remove ad-hoc tests
* style
* fix flava test
* fix test
* fix processor code
2022-11-10 19:29:20 +00:00
Antonio Carlos Falcão Petri
af150e4a1c
Allow user-managed Pool in Wav2Vec2ProcessorWithLM.batch_decode ( #18351 )
...
* [Wav2Vec2] Allow user-managed Pool in Wav2Vec2ProcessorWithLM.batch_decode
* [Wav2Vec2] Add user-managed LM's pool tests and usage examples
* Improve styling
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
* [Wav2Vec2] Fix hyperlink references
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
2022-10-18 08:48:03 -04:00
Patrick von Platen
62ceb4d661
[Wav2vec2 + LM Test] Improve wav2vec2 with lm tests and make torch version dependent for now ( #18749 )
...
* add first generation tutorial
* remove generation
* make version dependent expected values
* Apply suggestions from code review
* Update tests/models/wav2vec2_with_lm/test_processor_wav2vec2_with_lm.py
* fix typo
2022-08-26 14:11:55 +02:00
Sylvain Gugger
986526a0e4
Replace as_target context managers by direct calls ( #18325 )
...
* Preliminary work on tokenizers
* Quality + fix tests
* Treat processors
* Fix pad
* Remove all uses of in tests, docs and examples
* Replace all as_target_tokenizer
* Fix tests
* Fix quality
* Update examples/flax/image-captioning/run_image_captioning_flax.py
Co-authored-by: amyeroberts <amy@huggingface.co >
* Style
Co-authored-by: amyeroberts <amy@huggingface.co >
2022-07-29 08:09:09 -04:00
Yih-Dar
19420fd99e
Move test model folders ( #17034 )
...
* move test model folders (TODO: fix imports and others)
* fix (potentially partially) imports (in model test modules)
* fix (potentially partially) imports (in tokenization test modules)
* fix (potentially partially) imports (in feature extraction test modules)
* fix import utils.test_modeling_tf_core
* fix path ../fixtures/
* fix imports about generation.test_generation_flax_utils
* fix more imports
* fix fixture path
* fix get_test_dir
* update module_to_test_file
* fix get_tests_dir from wrong transformers.utils
* update config.yml (CircleCI)
* fix style
* remove missing imports
* update new model script
* update check_repo
* update SPECIAL_MODULE_TO_TEST_MAP
* fix style
* add __init__
* update self-scheduled
* fix add_new_model scripts
* check one way to get location back
* python setup.py build install
* fix import in test auto
* update self-scheduled.yml
* update slack notification script
* Add comments about artifact names
* fix for yolos
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com >
2022-05-03 14:42:02 +02:00
