Yih-Dar
691fd8fdde
Add Kosmos-2 model (#24709)
* Add KOSMOS-2 model
* update
* update
* update
* address review comment - 001
* address review comment - 002
* address review comment - 003
* style
* Apply suggestions from code review
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
* fix
* address review comment - 004
* address review comment - 005
* address review comment - 006
* address review comment - 007
* address review comment - 008
* address review comment - 009
* address review comment - 010
* address review comment - 011
* update readme
* fix
* fix
* fix
* [skip ci] fix
* revert the change in _decode
* fix docstring
* fix docstring
* Update docs/source/en/model_doc/kosmos-2.md
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
* no more Kosmos2Tokenizer
* style
* remove "returned when being computed by the model"
* Apply suggestions from code review
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
* UTM5 Atten
* fix attn mask
* use present_key_value_states instead of next_decoder_cache
* style
* conversion scripts
* conversion scripts
* conversion scripts
* Add _reorder_cache
* fix doctest and copies
* rename 1
* rename 2
* rename 3
* make fixup
* fix table
* fix docstring
* rename 4
* change repo_id
* remove tip
* update md file
* make style
* update md file
* put docs/source/en/model_doc/kosmos-2.md to slow
* update conversion script
* Use CLIPImageProcessor in Kosmos2Processor
* Remove Kosmos2ImageProcessor
* Remove to_dict in Kosmos2Config
* Remove files
* fix import
* Update conversion
* normalized=False
* Not using hardcoded values like <image>
* elt --> element
* Apply suggestion
* Not using hardcoded values like </image>
* No assert
* No nested functions
* Fix md file
* copy
* update doc
* fix docstring
* fix name
* Remove _add_remove_spaces_around_tag_tokens
* Remove dummy docstring of _preprocess_single_example
* Use `BatchEncoding`
* temp
* temp
* temp
* Update
* Update
* Make Kosmos2ProcessorTest a bit pretty
* Update gradient checkpointing
* Fix gradient checkpointing test
* Remove one liner remove_special_fields
* Simplify conversion script
* fix add_eos_token
* update readme
* update tests
* Change to microsoft/kosmos-2-patch14-224
* style
* Fix doc
---------
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
2023-10-30 13:32:17 +01:00
..
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-08-19 11:15:38 +02:00
2023-10-04 17:09:48 +02:00
2023-06-06 14:31:14 -04:00
2023-06-26 18:36:47 +02:00
2023-10-27 11:07:33 +01:00
2023-10-16 17:27:45 +01:00
2023-02-06 18:10:56 -05:00
2023-02-06 18:10:56 -05:00
2023-08-11 11:30:18 +01:00
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-02-06 18:10:56 -05:00
2023-02-06 18:10:56 -05:00
2023-06-22 16:11:27 +02:00
2023-08-02 20:22:36 +02:00
2023-10-11 14:12:09 +02:00
2023-06-29 10:17:36 +01:00
2023-09-14 15:10:34 +01:00
2023-10-23 12:52:05 +02:00
2023-08-16 17:45:02 +01:00
2023-09-25 18:08:12 +02:00
2023-10-24 16:49:26 +02:00
2023-08-11 11:30:18 +01:00
2023-09-25 18:08:12 +02:00
2023-09-18 20:28:36 +02:00
2023-10-18 16:30:53 +02:00
2023-09-18 20:28:36 +02:00
2023-08-16 17:45:02 +01:00
2023-10-11 14:12:09 +02:00
2023-08-25 10:58:14 +02:00
2023-08-08 10:48:45 +02:00
2023-10-18 16:30:53 +02:00
2023-10-24 16:49:26 +02:00
2023-08-11 11:30:18 +01:00
2023-08-02 20:22:36 +02:00
2023-08-11 11:30:18 +01:00
2023-05-16 23:35:11 +02:00
2023-03-22 20:02:24 +01:00
2023-08-02 20:22:36 +02:00
2023-09-18 13:52:43 +02:00
2023-07-24 10:08:47 -04:00
2023-09-05 10:12:25 +02:00
2023-08-02 20:22:36 +02:00
2023-09-18 20:28:36 +02:00
2023-02-28 19:40:57 +01:00
2023-08-11 11:30:18 +01:00
2023-08-11 11:30:18 +01:00
2023-08-11 11:30:18 +01:00
2023-09-05 11:19:56 +02:00
2023-06-29 10:17:36 +01:00
2023-08-29 11:05:27 +01:00
2023-08-02 20:22:36 +02:00
2023-06-29 10:17:36 +01:00
2023-08-11 11:30:18 +01:00
2023-08-02 20:22:36 +02:00
2023-08-11 11:30:18 +01:00
2023-08-11 11:30:18 +01:00
2023-08-14 17:08:47 +01:00
2023-08-02 20:22:36 +02:00
2023-10-04 17:09:48 +02:00
2023-10-24 18:26:16 +01:00
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-09-26 10:15:53 +02:00
2023-10-13 15:10:27 +01:00
2023-08-02 20:22:36 +02:00
2023-08-16 17:45:02 +01:00
2023-10-02 13:55:46 +02:00
2023-05-18 17:29:04 +02:00
2023-09-21 14:46:05 +02:00
2023-06-16 15:40:49 +01:00
2023-10-20 13:46:06 +02:00
2023-08-02 20:22:36 +02:00
2023-08-16 17:45:02 +01:00
2023-09-18 20:28:36 +02:00
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-09-18 20:28:36 +02:00
2023-08-02 20:22:36 +02:00
2023-09-18 20:28:36 +02:00
2023-07-24 10:08:47 -04:00
2023-08-02 20:22:36 +02:00
2023-10-18 16:30:53 +02:00
2023-10-05 10:27:05 +02:00
2023-08-02 20:22:36 +02:00
2023-10-13 09:52:10 +02:00
2023-08-16 17:45:02 +01:00
2023-06-22 16:11:27 +02:00
2023-10-05 14:44:31 +02:00
2023-08-18 12:40:40 +02:00
2023-10-30 13:32:17 +01:00
2023-08-02 20:22:36 +02:00
2023-09-14 15:10:34 +01:00
2023-09-18 20:28:36 +02:00
2023-09-14 15:10:34 +01:00
2023-06-30 16:30:33 +01:00
2023-08-11 11:30:18 +01:00
2023-06-22 16:11:27 +02:00
2023-10-27 16:42:01 +02:00
2023-10-11 14:12:09 +02:00
2023-08-02 20:22:36 +02:00
2023-09-18 20:28:36 +02:00
2023-06-16 15:40:49 +01:00
2023-09-18 20:28:36 +02:00
2023-10-18 16:30:53 +02:00
2023-10-18 16:30:53 +02:00
2023-08-11 11:30:18 +01:00
2023-08-16 18:11:24 +02:00
2023-10-03 19:43:42 +02:00
2022-07-29 08:09:09 -04:00
2023-09-05 21:50:14 +02:00
2023-08-02 20:22:36 +02:00
2022-05-03 14:42:02 +02:00
2023-08-11 11:30:18 +01:00
2023-10-16 22:47:20 +02:00
2023-09-18 20:28:36 +02:00
2023-10-11 14:12:09 +02:00
2023-08-11 11:30:18 +01:00
2023-08-11 11:30:18 +01:00
2023-08-11 11:30:18 +01:00
2023-07-24 10:08:47 -04:00
2023-08-02 20:22:36 +02:00
2023-08-21 11:11:21 +02:00
2023-08-02 20:22:36 +02:00
2023-05-24 13:52:52 +01:00
2023-10-04 17:09:48 +02:00
2023-08-02 20:22:36 +02:00
2023-06-29 10:17:36 +01:00
2023-08-02 20:22:36 +02:00
2023-10-03 19:43:42 +02:00
2023-08-17 17:21:56 +02:00
2023-09-26 07:06:04 +02:00
2023-08-02 20:22:36 +02:00
2023-08-11 11:30:18 +01:00
2023-08-02 20:22:36 +02:00
2023-10-24 16:49:26 +02:00
2023-10-13 16:41:24 +02:00
2023-09-18 20:28:36 +02:00
2023-10-18 16:30:53 +02:00
2023-08-02 20:22:36 +02:00
2023-10-12 17:43:06 +02:00
2023-10-12 11:24:18 +02:00
2023-02-06 18:10:56 -05:00
2023-08-16 17:45:02 +01:00
2023-10-25 10:47:33 +02:00
2023-08-11 11:30:18 +01:00
2023-09-25 18:08:12 +02:00
2023-08-02 20:22:36 +02:00
2023-08-11 11:30:18 +01:00
2023-08-02 20:22:36 +02:00
2023-06-16 15:40:49 +01:00
2023-08-02 20:22:36 +02:00
2023-10-24 16:49:26 +02:00
2023-06-29 10:17:36 +01:00
2023-08-02 20:22:36 +02:00
2023-06-29 10:17:36 +01:00
2023-10-11 14:12:09 +02:00
2023-10-11 14:12:09 +02:00
2023-10-11 14:12:09 +02:00
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-06-22 16:11:27 +02:00
2023-10-23 14:49:48 +02:00
2023-08-11 11:30:18 +01:00
2023-09-05 10:12:25 +02:00
2023-09-05 10:12:25 +02:00
2023-02-06 18:10:56 -05:00
2023-10-04 17:09:48 +02:00
2023-08-02 20:22:36 +02:00
2023-10-17 15:59:35 +02:00
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-07-25 07:56:04 -04:00
2023-06-29 10:17:36 +01:00
2023-10-05 15:20:38 +02:00
2023-06-29 10:17:36 +01:00
2023-08-11 13:16:01 +01:00
2023-10-18 16:30:53 +02:00
2023-07-25 07:56:04 -04:00
2023-09-14 15:10:34 +01:00
2023-06-22 16:11:27 +02:00
2023-08-02 20:22:36 +02:00
2023-09-18 23:47:54 +02:00
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-10-04 17:09:48 +02:00
2023-08-02 20:22:36 +02:00
2023-10-03 10:52:34 +02:00
2023-10-03 10:52:34 +02:00
2023-07-25 07:56:04 -04:00
2023-08-16 17:45:02 +01:00
2023-08-11 11:30:18 +01:00
2023-09-26 07:06:04 +02:00
2023-07-05 13:44:30 +02:00
2023-08-02 20:22:36 +02:00
2023-08-11 11:30:18 +01:00
2023-08-16 17:02:57 +02:00
2023-08-02 20:22:36 +02:00
2023-08-02 20:22:36 +02:00
2023-09-04 11:35:39 +02:00
2023-09-19 10:56:10 -03:00
2023-10-03 19:43:42 +02:00
2023-08-16 17:45:02 +01:00
2023-10-05 10:27:05 +02:00
2023-10-05 10:27:05 +02:00
2022-05-03 14:42:02 +02:00
2023-04-17 12:41:55 +02:00
2023-10-03 10:52:34 +02:00
2023-10-11 14:12:09 +02:00
2023-08-02 20:22:36 +02:00
2023-08-18 12:40:40 +02:00
2023-08-02 20:22:36 +02:00
2023-03-06 09:15:44 +01:00
2023-05-24 13:52:52 +01:00
2023-08-02 20:22:36 +02:00
2023-09-18 20:28:36 +02:00
2023-08-02 20:22:36 +02:00
2023-08-11 11:30:18 +01:00
2023-08-02 20:22:36 +02:00
2022-05-03 14:42:02 +02:00