Yoni Gozlan
a245011252
Add InternVL (2.5 MPO) ( #35968 )
...
* initial commit
* add convert internvl
* add first end-to-end working internvl
* nit prompt and image proc
* add working chat template
* add conversion llama-based models
* add tests
* pass all tests
* fix isort
* fix modular after main merge
* add video processing for internvl
* add support for interlaced images and videos
* Remove processing and config from modular, add more tests
* add llama model tests
* Modify processor for compatibility with refactored got ocr image processor
* add comments in processor
* Add docs and nits
* change video processing to use custom sample_indices_fn
* rebase and fix tests
* add processor tests
* Add changes Raushan review
* Use the new attention interface for the vision model
* nits
* add support for custom video_load_backend
* remove mention to InternVLTokenizer
* refactor vision model to simplify logic
* refactor processor for better readibility
* fix copies
* fix require av processor test
* refactor internVL vision
* Update processor and fix processing tests
* fix docstring
* update convert_weights for internvl3
* change image processor to fast by default
* remove do_center_crop=True in convert_weights
* force use_cache to True
* push_to_hub before reloading
* fix internVLVision for larger models
* update convert weight for qk norm
* fix convert_weights
* fix eos_token_id in convert
* update docs and integration tests
* make modifs after review
* fix wrong k_norm and reduce modular
* change image_token_index to image_token_id
* change checkpoint to OpenGVLab org
* last nits
* explicitely del self.num_key_value_groups
* add extra special tokens
2025-04-18 18:57:33 +02:00
..
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-16 20:49:20 +02:00
2025-04-08 14:12:08 +02:00
2025-04-11 16:37:23 +01:00
2025-04-08 14:12:08 +02:00
2025-04-11 13:32:19 +02:00
2025-04-18 12:28:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-14 17:07:48 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-08 17:15:37 +01:00
2025-04-08 14:12:08 +02:00
2025-04-16 22:39:18 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-16 20:49:20 +02:00
2025-04-15 18:31:20 +02:00
2025-04-08 14:12:08 +02:00
2025-04-16 18:15:22 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-11 11:08:36 +02:00
2025-04-15 18:33:34 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-14 16:24:01 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-16 21:59:24 +02:00
2025-04-08 14:12:08 +02:00
2025-04-11 13:32:19 +02:00
2025-04-08 14:12:08 +02:00
2025-04-18 17:49:24 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-16 11:01:04 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-14 15:05:31 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-11 13:32:19 +02:00
2025-04-18 12:28:08 +02:00
2025-04-18 14:55:43 +01:00
2025-04-18 14:55:43 +01:00
2025-04-08 17:15:37 +01:00
2025-04-16 09:28:02 +02:00
2025-04-09 14:02:04 +02:00
2025-04-08 14:12:08 +02:00
2025-04-11 13:32:19 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-11 18:52:00 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-16 12:26:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-11 13:32:19 +02:00
2025-04-16 20:49:20 +02:00
2025-04-16 20:49:20 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-08 17:15:37 +01:00
2025-04-18 18:57:33 +02:00
2025-04-08 14:12:08 +02:00
2025-04-17 09:18:51 +02:00
2025-04-08 14:12:08 +02:00
2025-04-14 11:39:45 +02:00
2025-04-08 14:12:08 +02:00
2025-04-14 15:06:41 +02:00
2025-04-14 15:42:11 +02:00
2025-04-08 17:15:37 +01:00
2025-04-08 14:12:08 +02:00
2025-04-14 17:07:36 +02:00
2025-04-08 14:12:08 +02:00
2025-04-18 10:09:19 +02:00
2025-04-11 13:32:19 +02:00
2025-04-16 20:49:20 +02:00
2025-04-16 20:49:20 +02:00
2025-04-16 20:49:20 +02:00
2025-04-16 20:49:20 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-16 22:16:01 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-03-28 15:09:35 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-16 20:49:20 +02:00
2025-04-08 14:12:08 +02:00
2025-04-15 11:33:09 +01:00
2025-04-16 20:49:20 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-14 17:08:47 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-18 12:28:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-10 13:33:01 +02:00
2025-04-10 13:33:01 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-18 12:28:08 +02:00
2025-03-28 15:09:35 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-14 17:58:09 +02:00
2025-04-16 20:49:20 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-14 13:49:13 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-14 16:19:04 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-10 14:42:32 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-14 12:36:41 +02:00
2025-04-17 09:38:12 +02:00
2025-04-11 13:32:19 +02:00
2025-04-08 14:12:08 +02:00
2025-04-17 09:38:12 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-10 20:54:21 +02:00
2025-04-10 20:54:21 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-16 11:23:56 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 14:42:32 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-16 20:49:20 +02:00
2025-04-11 08:06:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-18 11:35:46 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 16:58:57 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-17 11:26:03 +02:00
2025-04-08 14:12:08 +02:00
2025-04-17 15:39:44 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-03-21 10:20:05 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 14:42:32 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 17:15:37 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 17:15:37 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-01-24 16:55:28 +01:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-08 14:12:08 +02:00
2025-04-10 20:54:21 +02:00
2025-04-15 14:23:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2025-04-08 14:12:08 +02:00
2022-05-03 14:42:02 +02:00