Arthur
474bf508df
Add Segment Anything Model (SAM) (#22654)
* initial commit
* keys match
* update, fix conversion
* fixes, inference working
* fix
* more fixes
* more fixes
* clean up
* more clean up
* fix copies and add convext copied layer norm
* stash
* pretty big upfate
* cleaning
* more cleaning
* fixup stuffs
* fix copies
* fix iinit
* update test removing tokenizer
* nits
* add pretrained
* more nits
* remove tracking of pipeline
* few fixes
* update san and conversion script
* fix mask decoder and prompt encoder conversion
* fixes
* small update
* fix order
* fix
* fix image embeddings
* nites
* few fixes
* fix logits
* clean up
* fixes boxes inference
* v1 AMG
* clean up
* some clean up
* multi points support
* amg working
* fixup
* clean up
* readme
* update toctree
* fix type hint
* multiple fixes
* fixup
* fixes
* updates
* updates
* more tests
* few fixes
* change to `SamForMaskGeneration`
* doc
* fixup
* fix more tests
* multiple fixes
* fix CI tests
* refactor processor
* renamings
* draft the pipeline
* refactor
* fix tests
* fix test
* few cleanings
* fix test
* edit pipelien support chunking
* udate
* add slow tests
* fix nit
* fixup
* fix nit
* current chunk pipleine
* cast boxes in fp32
* nit
* current updates
* piepleine works
* fixup
* clean up config
* fix slow tests
* fix slow tests
* clean up
* update doc and pipeline
* adds more slow tests
* fix slow tests
* cleaning
* tests pass
* add docstring
* fix copies
* clean up
* support batch of images
* style
* dummy is needed, add tests
* fix slow tests
* fix CI
* update
* adds more tests
* fixes
* fixes
* fixup
* fixes
* few fixes
* filter
* few fixes
* some refactor
* touches finales
* fix
* style
* remove pipeline files
* fixes nits
* revert pipeline changes
* fix test
* fixup
* remove automodel for automatic mask generation
* fix failing torch tests
* update mdx
* revert removal of `MODEL_FOR_AUTOMATIC_MASK_GENERATION_MAPPING`
* update sam config based on review
Co-authored-by: amyeroberts <aeroberts4444@gmail.com>
Co-authored-by: sgugger <sylvain.gugger@gmail.com>
* update low_resolution_masks -> pred_masks
inti ln with layer_norm_eps
add_decomposed_rel_pos doc
forward doc of SamForMaskGeneration
* update processor docstring
* remove image processor import empty
* update for testing
* output vision hidden states + clean recomm
also test all iou values
* fixup
* fixup
* remove unused
* Update src/transformers/models/sam/modeling_sam.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/transformers/models/sam/image_processing_sam.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* nits
* fix
* fix CI tests and slow tests
* replace with Amy's processor
* clearer docstring
* add `SamVisionNeck`
* refactor - all CI tests should pass
* fix broken import on Gcolab
* few fixes here and there
* fix another bug
* fix more bugs
* update and merge
* correct ckpt
* address comments
* add tips
* revert
* fix docstring
* replace with `SamModel`
* make fixup
* add support for bathed images and batch ed points
* make fixup this time, really
* make fixup again and again
* few fixes here and there, this should be the touche finale
* Update docs/source/en/model_doc/sam.mdx
* fixup
* correct checkpoints
* correct name
* rm unneeded file
* add notebook
---------
Co-authored-by: younesbelkada <younesbelkada@gmail.com>
Co-authored-by: amyeroberts <aeroberts4444@gmail.com>
Co-authored-by: sgugger <sylvain.gugger@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
2023-04-19 21:01:49 +02:00
..
2023-03-17 14:30:17 +00:00
2023-03-16 13:41:48 +03:00
2023-01-04 09:18:57 +01:00
2023-03-17 14:30:17 +00:00
2023-03-13 12:46:14 +03:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2022-04-29 17:42:15 -04:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-04-03 09:20:02 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-02-28 15:42:55 +01:00
2023-04-04 16:05:22 +01:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2023-03-08 09:00:54 -05:00
2022-04-13 11:36:54 +02:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-11-30 19:22:23 +01:00
2023-02-16 20:59:27 +01:00
2023-01-17 17:18:56 +01:00
2022-11-09 18:31:22 +01:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-14 12:08:14 +03:00
2022-05-02 12:47:39 -04:00
2023-04-12 07:33:20 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-04-05 17:43:48 +02:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-01-17 17:18:56 +01:00
2022-11-29 10:38:01 +00:00
2023-02-15 10:35:14 -08:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-02-20 16:37:11 +03:00
2023-03-17 14:30:17 +00:00
2022-07-27 10:08:59 +02:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-12-27 02:26:14 -05:00
2023-03-10 07:44:45 -05:00
2023-03-17 14:30:17 +00:00
2022-11-08 19:54:41 +00:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 10:27:12 -04:00
2023-03-17 14:30:17 +00:00
2023-04-10 10:57:21 +02:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-04-10 11:52:23 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-02-20 11:25:27 +01:00
2023-01-19 13:05:59 -05:00
2023-01-17 17:18:56 +01:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-07 21:36:38 +01:00
2023-02-27 08:36:36 +01:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-04-12 07:11:12 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-01-25 12:34:43 +01:00
2023-01-16 20:37:07 +03:00
2023-04-05 17:43:48 +02:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-24 08:17:27 -04:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 09:40:06 +00:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-27 19:42:00 +02:00
2023-04-04 14:53:06 +02:00
2023-03-17 14:30:17 +00:00
2023-01-25 12:34:43 +01:00
2023-03-17 14:30:17 +00:00
2023-02-21 10:35:11 -05:00
2023-01-03 19:25:09 +03:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2023-04-13 19:51:13 +01:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-02-15 10:35:14 -08:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-04-04 12:41:12 -04:00
2023-03-17 14:30:17 +00:00
2023-03-24 19:45:57 +00:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-04-19 21:01:49 +02:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-11-03 14:18:45 +01:00
2022-07-29 08:09:09 -04:00
2023-02-03 12:43:46 -05:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-12-16 16:24:01 +01:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-11-07 09:19:04 -05:00
2023-02-21 10:35:11 -05:00
2023-03-17 14:30:17 +00:00
2022-04-08 10:57:51 +02:00
2023-02-13 10:11:16 -05:00
2023-03-17 14:30:17 +00:00
2022-05-17 19:07:43 -04:00
2023-03-17 14:30:17 +00:00
2022-11-30 14:50:55 +00:00
2023-02-15 18:10:30 +00:00
2022-06-21 10:24:50 +02:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-11-08 19:54:41 +00:00
2022-11-30 14:50:55 +00:00
2023-03-01 18:00:48 +00:00
2022-11-30 14:50:55 +00:00
2023-03-17 14:30:17 +00:00
2023-01-17 17:18:56 +01:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-07 16:20:21 +01:00
2023-01-17 17:18:56 +01:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-02-07 16:43:19 -05:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2022-04-04 10:25:46 -04:00
2022-04-04 10:25:46 -04:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00
2023-03-17 14:30:17 +00:00