Pablo Montalvo c624d5ba0b add initial design for uniform processors + align model (#31197) ...

* add initial design for uniform processors + align model

* fix mutable default 👀

* add configuration test

* handle structured kwargs w defaults + add test

* protect torch-specific test

* fix style

* fix

* fix assertEqual

* move kwargs merging to processing common

* rework kwargs for type hinting

* just get Unpack from extensions

* run-slow[align]

* handle kwargs passed as nested dict

* add from_pretrained test for nested kwargs handling

* [run-slow]align

* update documentation + imports

* update audio inputs

* protect audio types, silly

* try removing imports

* make things simpler

* simplerer

* move out kwargs test to common mixin

* [run-slow]align

* skip tests for old processors

* [run-slow]align, clip

* !$#@!! protect imports, darn it

* [run-slow]align, clip

* [run-slow]align, clip

* update doc

* improve documentation for default values

* add model_max_length testing

This parameter depends on tokenizers received.

* Raise if kwargs are specified in two places

* fix

* expand VideoInput

* fix

* fix style

* remove defaults values

* add comment to indicate documentation on adding kwargs

* protect imports

* [run-slow]align

* fix

* remove set() that breaks ordering

* test more

* removed unused func

* [run-slow]align

2024-06-13 16:27:16 +02:00

..

agents

Add support to declare imports for code agent (#31355)

2024-06-12 09:32:28 +02:00

benchmark

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

bettertransformer

Fixed malapropism error (#26660)

2023-10-09 11:04:57 +02:00

deepspeed

Update ds_config_zero3.json (#30829)

2024-05-15 10:02:31 -04:00

extended

CI: update to ROCm 6.0.2 and test MI300 (#30266)

2024-05-13 18:14:36 +02:00

fixtures

Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)

2024-03-19 14:43:02 +00:00

fsdp

Add FSDP config for CPU RAM efficient loading through accelerate (#30002)

2024-04-22 13:15:28 +01:00

generation

Generation: fix handling of special tokens (#31254)

2024-06-06 15:21:32 +05:00

models

add initial design for uniform processors + align model (#31197)

2024-06-13 16:27:16 +02:00

optimization

fix get_scheduler when name is warmup_stable_decay (#31128)

2024-05-30 15:25:43 +01:00

peft_integration

FIX [CI]: Fix failing tests for peft integration (#29330)

2024-02-29 03:56:16 +01:00

pipelines

Remove ConversationalPipeline and Conversation object (#31165)

2024-06-07 17:50:18 +01:00

quantization

Add Qwen2 GGUF loading support (#31175)

2024-06-03 14:55:10 +01:00

repo_utils

Allow # Ignore copy (#27328)

2023-12-07 10:00:08 +01:00

sagemaker

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

tokenization

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

trainer

Implement JSON dump conversion for torch_dtype in TrainingArguments (#31224)

2024-06-07 15:43:34 +01:00

utils

Chat Template support for function calling and RAG (#30621)

2024-06-11 15:46:38 +01:00

__init__.py

…

test_backbone_common.py

Align backbone stage selection with out_indices & out_features (#27606)

2023-12-20 18:33:17 +00:00

test_cache_utils.py

Generate: add tests for caches with pad_to_multiple_of (#29462)

2024-03-06 10:57:04 +00:00

test_configuration_common.py

[ PretrainedConfig] Improve messaging (#27438)

2023-11-15 14:10:39 +01:00

test_configuration_utils.py

Use HF_HUB_OFFLINE + fix has_file in offline mode (#31016)

2024-05-29 11:55:43 +01:00

test_feature_extraction_common.py

Split common test from core tests (#24284)

2023-06-15 07:30:24 -04:00

test_feature_extraction_utils.py

[tests] remove deprecated tests for model loading (#29450)

2024-03-15 14:18:41 +00:00

test_image_processing_common.py

Fast image processor (#28847)

2024-06-11 15:47:38 +01:00

test_image_processing_utils.py

[tests] remove deprecated tests for model loading (#29450)

2024-03-15 14:18:41 +00:00

test_image_transforms.py

fix: center_crop occasionally outputs off-by-one dimension matrix (#30934)

2024-05-21 13:56:52 +01:00

test_modeling_common.py

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

test_modeling_flax_common.py

add sdpa to ViT [follow up of #29325] (#30555)

2024-05-16 10:56:11 +01:00

test_modeling_flax_utils.py

Enable safetensors conversion from PyTorch to other frameworks without the torch requirement (#27599)

2024-01-23 10:28:23 +01:00

test_modeling_tf_common.py

Port IDEFICS to tensorflow (#26870)

2024-05-13 15:59:46 +01:00

test_modeling_tf_utils.py

Cast bfloat16 to float32 for Numpy conversions (#29755)

2024-03-21 14:04:11 +00:00

test_modeling_utils.py

Use huggingface_hub helper function to split state dict (#31091)

2024-06-12 14:10:32 +02:00

test_pipeline_mixin.py

Remove ConversationalPipeline and Conversation object (#31165)

2024-06-07 17:50:18 +01:00

test_processing_common.py

add initial design for uniform processors + align model (#31197)

2024-06-13 16:27:16 +02:00

test_sequence_feature_extraction_common.py

Fix typo (#25966)

2023-09-05 10:12:25 +02:00

test_tokenization_common.py

Add split special tokens (#30772)

2024-05-24 08:38:58 -07:00

test_tokenization_utils.py

Token healing (#30081)

2024-06-03 10:53:15 +02:00