Pablo Montalvo
50290cf7a0
Uniformize model processors (#31368)
* add initial design for uniform processors + align model
* add uniform processors for altclip + chinese_clip
* add uniform processors for blip + blip2
* fix mutable default 👀
* add configuration test
* handle structured kwargs w defaults + add test
* protect torch-specific test
* fix style
* fix
* rebase
* update processor to generic kwargs + test
* fix style
* add sensible kwargs merge
* update test
* fix assertEqual
* move kwargs merging to processing common
* rework kwargs for type hinting
* just get Unpack from extensions
* run-slow[align]
* handle kwargs passed as nested dict
* add from_pretrained test for nested kwargs handling
* [run-slow]align
* update documentation + imports
* update audio inputs
* protect audio types, silly
* try removing imports
* make things simpler
* simplerer
* move out kwargs test to common mixin
* [run-slow]align
* skip tests for old processors
* [run-slow]align, clip
* !$#@!! protect imports, darn it
* [run-slow]align, clip
* [run-slow]align, clip
* update common processor testing
* add altclip
* add chinese_clip
* add pad_size
* [run-slow]align, clip, chinese_clip, altclip
* remove duplicated tests
* fix
* add blip, blip2, bridgetower
Added tests for bridgetower which override common. Also modified common
tests to force center cropping if existing
* fix
* update doc
* improve documentation for default values
* add model_max_length testing
This parameter depends on tokenizers received.
* Raise if kwargs are specified in two places
* fix
* removed copied from
* match defaults
* force padding
* fix tokenizer test
* clean defaults
* move tests to common
* add missing import
* fix
* adapt bridgetower tests to shortest edge
* uniformize donut processor + tests
* add wav2vec2
* extend common testing to audio processors
* add testing + bert version
* propagate common kwargs to different modalities
* BC order of arguments
* check py version
* revert kwargs merging
* add draft overlap test
* update
* fix blip2 and wav2vec due to updates
* fix copies
* ensure overlapping kwargs do not disappear
* replace .pop by .get to handle duplicated kwargs
* fix copies
* fix missing import
* add clearly wav2vec2_bert to uniformized models
* fix copies
* increase number of features
* fix style
* [run-slow] blip, blip2, bridgetower, donut, wav2vec2, wav2vec2_bert
* [run-slow] blip, blip_2, bridgetower, donut, wav2vec2, wav2vec2_bert
* fix concatenation
* [run-slow] blip, blip_2, bridgetower, donut, wav2vec2, wav2vec2_bert
* Update tests/test_processing_common.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* 🧹
* address comments
* clean up + tests
* [run-slow] instructblip, blip, blip_2, bridgetower, donut, wav2vec2, wav2vec2_bert
---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2024-10-02 10:41:08 +02:00
..
2024-06-26 21:59:08 +01:00
2024-09-24 21:28:19 -04:00
2024-10-02 10:41:08 +02:00
2024-07-23 14:54:38 +08:00
2024-09-23 18:28:36 +01:00
2024-06-07 19:40:26 +01:00
2024-06-26 21:59:08 +01:00
2024-08-23 11:12:53 +01:00
2024-06-26 21:59:08 +01:00
2024-03-13 14:53:27 +01:00
2024-06-26 21:59:08 +01:00
2024-09-06 14:20:48 +02:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-07-17 08:37:43 +01:00
2024-09-19 12:04:24 +02:00
2024-08-16 11:20:41 +01:00
2024-06-19 10:18:08 +01:00
2024-08-23 11:12:53 +01:00
2024-08-23 11:12:53 +01:00
2024-10-02 10:41:08 +02:00
2024-10-02 10:41:08 +02:00
2024-09-19 12:04:24 +02:00
2024-10-02 10:41:08 +02:00
2024-05-22 06:40:15 +02:00
2024-06-26 21:59:08 +01:00
2024-08-28 10:26:00 +02:00
2024-06-26 21:59:08 +01:00
2024-09-26 10:18:07 -04:00
2024-09-25 19:05:01 +01:00
2024-07-23 14:54:38 +08:00
2024-09-25 19:05:01 +01:00
2024-09-25 19:05:01 +01:00
2024-09-26 19:38:20 +02:00
2024-06-26 21:59:08 +01:00
2024-09-24 16:40:48 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-08-06 11:33:05 +01:00
2024-06-26 21:59:08 +01:00
2024-09-20 14:20:57 +01:00
2024-06-26 21:59:08 +01:00
2024-07-26 10:33:02 +02:00
2024-06-19 10:18:08 +01:00
2024-08-19 10:21:51 +01:00
2024-07-23 14:54:38 +08:00
2024-07-29 10:52:13 +01:00
2024-07-26 10:33:02 +02:00
2024-07-26 10:33:02 +02:00
2024-08-23 11:12:53 +01:00
2024-06-26 21:59:08 +01:00
2024-08-06 11:33:05 +01:00
2024-08-13 16:16:30 +02:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-09-21 01:58:00 +01:00
2024-07-26 10:33:02 +02:00
2023-06-29 10:17:36 +01:00
2024-10-02 10:41:08 +02:00
2024-03-25 10:33:38 +01:00
2024-08-06 11:33:05 +01:00
2024-08-27 11:58:27 +01:00
2024-06-26 21:59:08 +01:00
2024-07-23 14:54:38 +08:00
2024-09-25 12:21:53 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-09-09 10:59:04 +02:00
2024-09-24 16:40:48 +01:00
2024-06-26 21:59:08 +01:00
2024-07-26 10:33:02 +02:00
2024-09-09 13:20:27 +01:00
2024-07-10 13:46:31 +01:00
2024-06-19 10:18:08 +01:00
2024-06-26 21:59:08 +01:00
2024-05-22 06:40:15 +02:00
2024-10-01 23:52:03 +02:00
2024-09-19 19:39:19 +01:00
2024-09-19 17:42:47 +01:00
2024-09-25 19:05:01 +01:00
2024-08-06 11:33:05 +01:00
2024-07-24 17:36:32 +01:00
2024-09-24 16:40:48 +01:00
2024-09-24 16:40:48 +01:00
2024-09-09 10:59:04 +02:00
2024-09-09 10:59:04 +02:00
2024-07-24 17:36:32 +01:00
2024-09-24 16:40:48 +01:00
2024-09-21 01:43:50 +02:00
2024-09-21 01:43:50 +02:00
2024-09-20 10:16:43 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-09-05 16:17:34 +02:00
2024-07-23 14:54:38 +08:00
2024-07-25 15:12:23 +02:00
2024-06-26 21:59:08 +01:00
2024-09-17 22:24:42 +01:00
2024-10-01 23:52:03 +02:00
2024-09-24 16:40:48 +01:00
2024-09-25 12:21:53 +01:00
2024-09-24 21:28:19 -04:00
2024-09-24 21:28:19 -04:00
2024-09-17 19:29:27 +01:00
2024-08-14 16:22:06 +02:00
2024-10-01 23:52:03 +02:00
2024-06-26 21:59:08 +01:00
2024-09-19 19:28:04 +01:00
2024-09-13 11:58:38 +01:00
2024-09-13 11:58:38 +01:00
2024-09-19 12:04:24 +02:00
2024-08-06 11:33:05 +01:00
2024-03-25 10:33:38 +01:00
2024-09-20 10:16:43 +01:00
2024-09-20 11:40:59 -04:00
2024-09-24 21:28:19 -04:00
2024-09-19 12:04:24 +02:00
2024-09-20 11:40:59 -04:00
2024-09-10 11:10:53 +02:00
2024-07-16 09:32:01 -04:00
2024-08-05 15:19:42 +01:00
2024-07-26 10:33:02 +02:00
2024-07-16 09:32:01 -04:00
2024-10-01 09:28:40 +02:00
2024-09-20 11:40:57 +01:00
2024-08-23 11:12:53 +01:00
2024-09-13 11:58:38 +01:00
2024-09-10 11:19:56 +01:00
2024-06-26 21:59:08 +01:00
2024-08-23 11:12:53 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-09-09 13:20:27 +01:00
2024-09-18 19:23:44 +02:00
2024-09-20 10:16:43 +01:00
2024-06-26 21:59:08 +01:00
2024-09-26 16:33:25 +02:00
2024-08-05 15:19:42 +01:00
2024-07-26 10:33:02 +02:00
2024-08-06 11:33:05 +01:00
2024-08-06 11:33:05 +01:00
2024-08-23 11:12:53 +01:00
2024-06-07 19:40:26 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-09-20 15:43:27 +01:00
2024-09-20 15:43:27 +01:00
2024-06-26 21:59:08 +01:00
2024-08-06 15:42:05 +02:00
2024-06-26 21:59:08 +01:00
2024-07-16 09:32:01 -04:00
2024-08-06 11:33:05 +01:00
2024-05-22 06:40:15 +02:00
2024-06-26 21:59:08 +01:00
2024-09-03 18:43:12 +02:00
2024-10-01 23:52:03 +02:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-08-06 11:33:05 +01:00
2024-09-09 13:20:27 +01:00
2024-09-27 11:23:14 +02:00
2024-06-26 21:59:08 +01:00
2024-06-07 19:40:26 +01:00
2024-08-23 11:12:53 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-09-09 10:59:04 +02:00
2024-09-09 10:59:04 +02:00
2024-09-13 14:07:19 +02:00
2024-03-13 14:53:27 +01:00
2024-10-01 23:52:03 +02:00
2024-10-01 23:52:03 +02:00
2024-07-16 09:32:01 -04:00
2024-08-06 11:33:05 +01:00
2024-07-23 14:54:38 +08:00
2024-06-26 21:59:08 +01:00
2024-08-06 11:33:05 +01:00
2024-06-26 21:59:08 +01:00
2024-08-06 11:18:58 +01:00
2024-08-08 15:47:24 +02:00
2024-08-06 11:18:58 +01:00
2024-09-20 11:40:59 -04:00
2024-09-19 11:55:26 +01:00
2024-09-20 10:16:43 +01:00
2024-09-19 12:04:24 +02:00
2024-06-19 10:18:08 +01:00
2024-06-21 01:48:10 -07:00
2024-06-19 10:18:08 +01:00
2024-06-26 21:59:08 +01:00
2024-06-04 10:09:24 +01:00
2024-05-22 06:40:15 +02:00
2024-07-23 17:07:31 +02:00
2024-08-06 11:33:05 +01:00
2024-09-24 16:40:48 +01:00
2024-09-09 13:20:27 +01:00
2024-09-24 16:40:48 +01:00
2024-09-24 16:40:48 +01:00
2024-06-26 21:59:08 +01:00
2024-06-11 15:47:38 +01:00
2024-09-17 08:05:21 +02:00
2024-09-17 08:05:21 +02:00
2024-08-06 11:33:05 +01:00
2024-09-25 12:21:53 +01:00
2024-09-24 16:40:48 +01:00
2024-09-17 10:39:34 +01:00
2024-05-22 06:40:15 +02:00
2024-07-26 10:33:02 +02:00
2024-09-09 10:59:04 +02:00
2024-08-06 11:18:58 +01:00
2024-06-19 10:18:08 +01:00
2024-06-07 19:40:26 +01:00
2024-06-19 10:18:08 +01:00
2024-08-06 11:33:05 +01:00
2024-06-26 18:46:48 +01:00
2024-08-06 11:48:32 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-09-13 11:58:38 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-08-06 11:33:05 +01:00
2024-09-23 12:47:32 -04:00
2024-06-26 21:59:08 +01:00
2024-07-23 14:54:38 +08:00
2024-07-23 14:54:38 +08:00
2024-09-20 10:16:43 +01:00
2024-06-19 10:18:08 +01:00
2024-09-19 12:04:24 +02:00
2024-08-06 11:33:05 +01:00
2024-08-06 11:33:05 +01:00
2024-09-19 12:04:24 +02:00
2024-09-25 12:21:53 +01:00
2024-09-25 12:21:53 +01:00
2024-05-22 06:40:15 +02:00
2024-08-06 11:33:05 +01:00
2024-09-30 18:47:13 +02:00
2024-06-07 19:40:26 +01:00
2024-06-26 21:59:08 +01:00
2024-08-06 11:33:05 +01:00
2024-07-08 13:49:21 +02:00
2024-10-01 20:14:35 +01:00
2024-10-02 10:41:08 +02:00
2024-10-02 10:41:08 +02:00
2024-07-23 14:54:38 +08:00
2024-09-26 19:38:20 +02:00
2024-06-17 17:29:13 +01:00
2024-07-23 14:54:38 +08:00
2024-09-24 16:40:48 +01:00
2024-09-25 19:05:01 +01:00
2024-09-24 16:40:48 +01:00
2024-04-02 10:27:26 +02:00
2024-08-28 10:26:00 +02:00
2024-08-28 10:26:00 +02:00
2024-06-26 21:59:08 +01:00
2024-06-04 10:09:24 +01:00
2024-06-26 21:59:08 +01:00
2024-06-26 21:59:08 +01:00
2024-08-06 11:33:05 +01:00
2022-05-03 14:42:02 +02:00