Arthur
474bf508df
Add Segment Anything Model (SAM) (#22654)
* initial commit
* keys match
* update, fix conversion
* fixes, inference working
* fix
* more fixes
* more fixes
* clean up
* more clean up
* fix copies and add convext copied layer norm
* stash
* pretty big upfate
* cleaning
* more cleaning
* fixup stuffs
* fix copies
* fix iinit
* update test removing tokenizer
* nits
* add pretrained
* more nits
* remove tracking of pipeline
* few fixes
* update san and conversion script
* fix mask decoder and prompt encoder conversion
* fixes
* small update
* fix order
* fix
* fix image embeddings
* nites
* few fixes
* fix logits
* clean up
* fixes boxes inference
* v1 AMG
* clean up
* some clean up
* multi points support
* amg working
* fixup
* clean up
* readme
* update toctree
* fix type hint
* multiple fixes
* fixup
* fixes
* updates
* updates
* more tests
* few fixes
* change to `SamForMaskGeneration`
* doc
* fixup
* fix more tests
* multiple fixes
* fix CI tests
* refactor processor
* renamings
* draft the pipeline
* refactor
* fix tests
* fix test
* few cleanings
* fix test
* edit pipelien support chunking
* udate
* add slow tests
* fix nit
* fixup
* fix nit
* current chunk pipleine
* cast boxes in fp32
* nit
* current updates
* piepleine works
* fixup
* clean up config
* fix slow tests
* fix slow tests
* clean up
* update doc and pipeline
* adds more slow tests
* fix slow tests
* cleaning
* tests pass
* add docstring
* fix copies
* clean up
* support batch of images
* style
* dummy is needed, add tests
* fix slow tests
* fix CI
* update
* adds more tests
* fixes
* fixes
* fixup
* fixes
* few fixes
* filter
* few fixes
* some refactor
* touches finales
* fix
* style
* remove pipeline files
* fixes nits
* revert pipeline changes
* fix test
* fixup
* remove automodel for automatic mask generation
* fix failing torch tests
* update mdx
* revert removal of `MODEL_FOR_AUTOMATIC_MASK_GENERATION_MAPPING`
* update sam config based on review
Co-authored-by: amyeroberts <aeroberts4444@gmail.com>
Co-authored-by: sgugger <sylvain.gugger@gmail.com>
* update low_resolution_masks -> pred_masks
inti ln with layer_norm_eps
add_decomposed_rel_pos doc
forward doc of SamForMaskGeneration
* update processor docstring
* remove image processor import empty
* update for testing
* output vision hidden states + clean recomm
also test all iou values
* fixup
* fixup
* remove unused
* Update src/transformers/models/sam/modeling_sam.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/transformers/models/sam/image_processing_sam.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* nits
* fix
* fix CI tests and slow tests
* replace with Amy's processor
* clearer docstring
* add `SamVisionNeck`
* refactor - all CI tests should pass
* fix broken import on Gcolab
* few fixes here and there
* fix another bug
* fix more bugs
* update and merge
* correct ckpt
* address comments
* add tips
* revert
* fix docstring
* replace with `SamModel`
* make fixup
* add support for bathed images and batch ed points
* make fixup this time, really
* make fixup again and again
* few fixes here and there, this should be the touche finale
* Update docs/source/en/model_doc/sam.mdx
* fixup
* correct checkpoints
* correct name
* rm unneeded file
* add notebook
---------
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: amyeroberts <aeroberts4444@gmail.com>
Co-authored-by: sgugger <sylvain.gugger@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
2023-04-19 21:01:49 +02:00
..
2023-02-28 19:40:57 +01:00
2023-04-06 17:56:06 +02:00
2023-03-23 19:14:17 +01:00
2023-03-23 19:14:17 +01:00
2023-04-18 13:46:11 -04:00
2023-04-14 09:57:25 +01:00
2023-02-06 18:10:56 -05:00
2023-02-06 18:10:56 -05:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-06 18:10:56 -05:00
2023-02-06 18:10:56 -05:00
2023-02-28 19:40:57 +01:00
2023-04-18 17:36:56 +01:00
2023-04-03 09:20:02 -04:00
2023-04-06 13:50:15 +01:00
2023-04-06 17:56:06 +02:00
2023-04-06 17:56:06 +02:00
2023-04-12 17:46:41 +01:00
2023-03-13 15:03:21 +01:00
2023-03-21 19:22:01 +01:00
2022-05-03 14:42:02 +02:00
2023-03-15 20:54:38 +01:00
2023-02-06 18:10:56 -05:00
2023-02-10 10:58:29 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-03-03 18:42:18 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-03-07 14:23:36 +01:00
2023-03-01 11:11:04 +01:00
2023-04-06 13:50:15 +01:00
2023-04-06 17:56:06 +02:00
2023-03-22 20:02:24 +01:00
2023-04-12 07:33:20 -04:00
2023-03-14 10:03:02 +01:00
2023-03-21 12:12:57 +00:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-03-22 07:35:47 +03:00
2023-04-13 21:32:29 +02:00
2023-03-07 15:19:39 -05:00
2023-04-06 13:50:15 +01:00
2023-02-28 19:40:57 +01:00
2022-05-03 14:42:02 +02:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-04-06 22:52:59 +02:00
2023-02-28 19:40:57 +01:00
2023-02-06 18:10:56 -05:00
2023-02-28 19:40:57 +01:00
2023-03-23 19:14:17 +01:00
2023-02-28 19:40:57 +01:00
2023-03-14 10:03:02 +01:00
2023-02-28 19:40:57 +01:00
2023-04-19 20:27:19 +02:00
2023-04-06 17:56:06 +02:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-03-10 22:08:21 +01:00
2023-04-10 10:57:21 +02:00
2023-02-28 19:40:57 +01:00
2023-04-10 11:52:23 -04:00
2023-02-28 19:40:57 +01:00
2022-12-12 13:12:13 -05:00
2023-03-14 10:03:02 +01:00
2023-04-06 22:52:59 +02:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-06 18:10:56 -05:00
2023-04-04 21:59:54 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-04-06 17:56:06 +02:00
2023-03-07 04:20:14 +01:00
2023-04-13 17:22:59 +02:00
2023-04-17 17:45:20 +02:00
2023-04-17 17:45:20 +02:00
2023-02-22 09:14:54 +01:00
2023-04-06 17:56:06 +02:00
2023-02-28 19:40:57 +01:00
2023-03-14 10:03:02 +01:00
2023-04-06 09:53:03 +02:00
2023-03-14 10:03:02 +01:00
2023-04-06 17:56:06 +02:00
2023-03-22 20:02:24 +01:00
2023-02-28 19:40:57 +01:00
2023-04-06 17:56:06 +02:00
2023-04-06 17:56:06 +02:00
2023-04-11 10:00:34 +02:00
2023-03-22 20:45:08 -04:00
2023-04-06 13:50:15 +01:00
2023-04-19 20:27:19 +02:00
2022-07-29 08:09:09 -04:00
2023-03-21 19:22:01 +01:00
2023-04-07 17:13:04 +02:00
2023-02-28 19:40:57 +01:00
2022-05-03 14:42:02 +02:00
2023-04-06 17:56:06 +02:00
2022-05-12 16:25:55 -04:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-06 18:10:56 -05:00
2023-04-06 17:56:06 +02:00
2023-04-06 13:50:15 +01:00
2023-02-28 19:40:57 +01:00
2023-04-04 14:53:06 +02:00
2023-04-06 17:56:06 +02:00
2023-02-28 19:40:57 +01:00
2023-03-23 19:14:17 +01:00
2023-04-05 13:16:00 +01:00
2023-04-07 20:12:57 +02:00
2023-02-28 19:40:57 +01:00
2023-04-06 17:56:06 +02:00
2023-04-06 17:56:06 +02:00
2023-02-28 19:40:57 +01:00
2023-02-06 18:10:56 -05:00
2023-04-13 09:01:14 -04:00
2023-04-06 17:56:06 +02:00
2023-02-28 19:40:57 +01:00
2023-04-06 17:56:06 +02:00
2023-02-28 19:40:57 +01:00
2023-02-09 14:46:15 +00:00
2023-02-28 19:40:57 +01:00
2023-03-14 10:03:02 +01:00
2023-04-04 12:41:12 -04:00
2023-02-28 19:40:57 +01:00
2023-04-06 13:50:15 +01:00
2023-02-06 18:10:56 -05:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-03-14 10:03:02 +01:00
2023-04-04 12:50:33 +02:00
2023-04-19 21:01:49 +02:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-06 18:10:56 -05:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-04-18 10:12:30 +01:00
2023-04-06 17:45:55 +02:00
2023-02-28 19:40:57 +01:00
2023-04-06 13:50:15 +01:00
2023-03-07 14:23:36 +01:00
2023-03-07 14:23:36 +01:00
2023-04-06 17:56:06 +02:00
2023-04-06 17:56:06 +02:00
2023-02-28 19:40:57 +01:00
2023-03-14 10:03:02 +01:00
2023-02-06 18:10:56 -05:00
2023-04-03 09:07:21 -04:00
2023-02-28 19:40:57 +01:00
2023-03-21 19:22:01 +01:00
2023-03-14 10:03:02 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 18:41:34 +00:00
2023-03-01 18:00:48 +00:00
2023-02-28 19:40:57 +01:00
2023-03-22 07:35:47 +03:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-02-28 19:40:57 +01:00
2023-04-04 21:59:54 +01:00
2023-02-28 19:40:57 +01:00
2022-05-03 14:42:02 +02:00
2023-04-17 12:41:55 +02:00
2023-02-28 19:40:57 +01:00
2023-04-18 17:36:56 +01:00
2023-02-28 19:40:57 +01:00
2023-03-06 18:07:31 +01:00
2023-03-14 10:03:02 +01:00
2023-03-06 09:15:44 +01:00
2023-02-09 21:49:54 +01:00
2023-03-29 16:16:23 +02:00
2023-04-19 20:27:19 +02:00
2023-03-29 16:16:23 +02:00
2023-03-07 07:34:04 -05:00
2023-02-28 19:40:57 +01:00
2022-05-03 14:42:02 +02:00