Raushan Turganbay 15ec971b8e Prepare processors for VideoLLMs (#36149) ...

* allow processor to preprocess conversation + video metadata

* allow callable

* add test

* fix test

* nit: fix

* add metadata frames_indices

* Update src/transformers/processing_utils.py

Co-authored-by: Pablo Montalvo <39954772+molbap@users.noreply.github.com>

* Update src/transformers/processing_utils.py

Co-authored-by: Pablo Montalvo <39954772+molbap@users.noreply.github.com>

* port updates from Orr and add one more test

* Update src/transformers/processing_utils.py

Co-authored-by: Pablo Montalvo <39954772+molbap@users.noreply.github.com>

* typo

* as dataclass

* style

* docstring + maek sure tests green

---------

Co-authored-by: Pablo Montalvo <39954772+molbap@users.noreply.github.com>

2025-02-14 11:34:08 +01:00

..

agents

use torch.testing.assertclose instead to get more details about error in cis (#35659)

2025-01-24 16:55:28 +01:00

bettertransformer

use torch.testing.assertclose instead to get more details about error in cis (#35659)

2025-01-24 16:55:28 +01:00

deepspeed

DeepSpeed github repo move sync (#36021)

2025-02-05 08:19:31 -08:00

extended

[tests] skip tests for xpu (#33553)

2024-09-19 19:28:04 +01:00

fixtures

Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)

2024-03-19 14:43:02 +00:00

fsdp

[tests] make cuda-only tests device-agnostic (#35607)

2025-01-13 14:48:39 +01:00

generation

CI: avoid human error, automatically infer generative models (#33212)

2025-02-13 16:27:11 +01:00

models

Add ImageProcessorFast to Qwen2.5-VL processor (#36164)

2025-02-14 17:34:55 +08:00

optimization

Support constant lr with cooldown (#35453)

2025-02-10 13:21:55 +01:00

peft_integration

use torch.testing.assertclose instead to get more details about error in cis (#35659)

2025-01-24 16:55:28 +01:00

pipelines

docs: fix return type annotation of get_default_model_revision (#35982)

2025-02-13 11:59:15 +01:00

quantization

Efficient Inference Kernel for SpQR (#34976)

2025-02-13 16:22:58 +01:00

repo_utils

[Modular] skip modular checks based on diff (#36130)

2025-02-13 12:53:21 +00:00

sagemaker

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00

tokenization

Fix PretrainedTokenizerFast check => Fix PretrainedTokenizerFast Save (#35835)

2025-02-13 12:00:33 +01:00

tp

Update-tp test (#35844)

2025-02-03 09:37:02 +01:00

trainer

Move DataCollatorForMultipleChoice from the docs to the package (#34763)

2025-02-13 12:01:28 +01:00

utils

Fix make_batched_videos and add tests (#36143)

2025-02-13 17:14:30 -05:00

__init__.py

…

test_backbone_common.py

Align backbone stage selection with out_indices & out_features (#27606)

2023-12-20 18:33:17 +00:00

test_configuration_common.py

Load sub-configs from composite configs (#34410)

2024-11-05 11:34:01 +01:00

test_feature_extraction_common.py

Split common test from core tests (#24284)

2023-06-15 07:30:24 -04:00

test_image_processing_common.py

Refactoring of ImageProcessorFast (#35069)

2025-02-04 17:52:31 -05:00

test_image_transforms.py

fix: center_crop occasionally outputs off-by-one dimension matrix (#30934)

2024-05-21 13:56:52 +01:00

test_modeling_common.py

CI: avoid human error, automatically infer generative models (#33212)

2025-02-13 16:27:11 +01:00

test_modeling_flax_common.py

CI: avoid human error, automatically infer generative models (#33212)

2025-02-13 16:27:11 +01:00

test_modeling_tf_common.py

🚨All attention refactor🚨 (#35235)

2024-12-18 16:53:39 +01:00

test_pipeline_mixin.py

Add image text to text pipeline (#34170)

2024-10-31 15:48:11 -04:00

test_processing_common.py

Prepare processors for VideoLLMs (#36149)

2025-02-14 11:34:08 +01:00

test_sequence_feature_extraction_common.py

Fix typo (#25966)

2023-09-05 10:12:25 +02:00

test_tokenization_common.py

apply_chat_template: consistent behaviour for return_assistant_tokens_mask=True return_tensors=True (#35582)

2025-02-04 10:27:52 +01:00

test_training_args.py

CI: fix test-save-trainer (#36191)

2025-02-14 10:20:56 +01:00