Sanchit Gandhi
1c1c90756d
Add Musicgen (#24109)
* Add Audiocraft
* add cross attention
* style
* add for lm
* convert and verify
* introduce t5
* split configs
* load t5 + lm
* clean conversion
* copy from t5
* style
* start pattern provider
* make generation work
* style
* fix pos embs
* propagate shape changes
* propagate shape changes
* style
* delay pattern: pad tokens at end
* audiocraft -> musicgen
* fix inits
* add mdx
* style
* fix pad token in processor
* override generate and add todos
* add init to test
* undo pattern delay mask after gen
* remove cfg logits processor
* remove cfg logits processor
* remove logits processor in favour of mask
* clean pos embs
* make fix copies
* update readmes
* clean pos emb
* refactor encoder/decoder
* make fix copies
* update conversion
* fix config imports
* update config docs
* make style
* send pattern mask to device
* pattern mask with delay
* recover prompted audio tokens
* fix docstrings
* laydown test file
* pattern edge case
* remove t5 ref
* add processing class
* config refactor
* better pattern comment
* check if mask is not present
* check if mask is not present
* refactor to auto class
* remove encoder configs
* fix processor
* processor import
* start updating conversion
* start updating tests
* make style
* convert t5, encodec, lm
* convert as composite
* also convert processor
* run generate
* classifier free gen
* comments and clean up
* make style
* docs for logit proc
* docstring for uncond gen
* start lm tests
* work tests
* let the lm generate
* refactor: reshape inside forward
* undo greedy loop changes
* from_enc_dec -> from_sub_model
* fix input id shapes in docstrings
* Apply suggestions from code review
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
* undo generate changes
* from sub model config
* Update src/transformers/models/musicgen/modeling_musicgen.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
* make generate work again
* generate uncond -> get uncond inputs
* remove prefix allowed tokens fn
* better error message
* logit proc checks
* Apply suggestions from code review
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
* make decoder only tests work
* composite fast tests
* make style
* uncond generation
* feat extr padding
* make audio prompt work
* fix inputs docstrings
* unconditional inputs: dict -> model output
* clean up tests
* more clean up tests
* make style
* t5 encoder -> auto text encoder
* remove comments
* deal with frames
* fix auto text
* slow tests
* nice mdx
* remove can generate
* todo - hub id
* convert m/l
* make fix copies
* only import generation with torch
* ignore decoder from tests
* don't wrap uncond inputs
* make style
* cleaner uncond inputs
* add example to musicgen forward
* fix docs
* ignore MusicGen Model/ForConditionalGeneration in auto mapping
* add doc section to toctree
* add to doc tests
* add processor tests
* fix push to hub in conversion
* tips for decoder only loading
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* fix conversion for s / m / l checkpoints
* import stopping criteria from module
* remove from pipeline tests
* fix uncond docstring
* decode audio method
* fix docs
* org: sanchit-gandhi -> facebook
* fix max pos embeddings
* remove auto doc (not compatible with shapes)
* bump max pos emb
* make style
* fix doc
* fix config doc
* fix config doc
* ignore musicgen config from docstring
* make style
* fix config
* fix config for doctest
* consistent from_sub_models
* don't automap decoder
* fix mdx save audio file
* fix mdx save audio file
* processor batch decode for audio
* remove keys to ignore
* update doc md
* update generation config
* allow changes for default generation config
* update tests
* make style
* fix docstring for uncond
* fix processor test
* fix processor test
---------
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2023-06-29 14:48:59 +01:00
..
2023-06-13 17:51:37 +01:00
2023-06-22 16:11:27 +02:00
2023-06-22 16:11:27 +02:00
2023-05-23 14:37:35 -04:00
2023-06-06 14:31:14 -04:00
2023-06-26 18:36:47 +02:00
2023-06-16 15:40:49 +01:00
2023-02-06 18:10:56 -05:00
2023-02-06 18:10:56 -05:00
2023-06-29 10:17:36 +01:00
2023-06-13 17:51:37 +01:00
2023-02-28 19:40:57 +01:00
2023-02-06 18:10:56 -05:00
2023-02-06 18:10:56 -05:00
2023-06-22 16:11:27 +02:00
2023-05-18 11:04:51 +01:00
2023-05-18 17:29:04 +02:00
2023-06-29 10:17:36 +01:00
2023-06-16 15:40:49 +01:00
2023-06-16 15:40:49 +01:00
2023-06-22 16:11:27 +02:00
2023-06-26 11:23:57 +02:00
2023-06-16 16:38:23 +02:00
2023-05-24 13:52:52 +01:00
2023-06-29 10:17:36 +01:00
2023-02-06 18:10:56 -05:00
2023-05-24 13:52:52 +01:00
2023-06-22 16:11:27 +02:00
2023-06-22 16:11:27 +02:00
2023-05-23 14:37:35 -04:00
2023-06-28 20:11:01 +02:00
2023-06-28 20:11:01 +02:00
2023-06-27 12:15:49 +01:00
2023-06-29 10:17:36 +01:00
2023-05-24 13:52:52 +01:00
2023-06-29 10:17:36 +01:00
2023-05-16 23:35:11 +02:00
2023-03-22 20:02:24 +01:00
2023-05-18 17:29:04 +02:00
2023-06-14 14:39:02 +01:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-05-24 13:52:52 +01:00
2023-05-24 13:52:52 +01:00
2023-02-28 19:40:57 +01:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-04-13 21:32:29 +02:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-05-24 13:52:52 +01:00
2023-06-29 10:17:36 +01:00
2023-02-28 19:40:57 +01:00
2023-05-24 13:52:52 +01:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-04-06 22:52:59 +02:00
2023-05-24 13:52:52 +01:00
2023-06-28 18:01:41 +02:00
2023-06-06 18:30:51 +01:00
2023-02-28 19:40:57 +01:00
2023-03-23 19:14:17 +01:00
2023-05-24 13:52:52 +01:00
2023-05-24 13:52:52 +01:00
2023-06-22 16:11:27 +02:00
2023-06-22 16:11:27 +02:00
2023-05-18 17:29:04 +02:00
2023-04-06 17:56:06 +02:00
2023-06-16 15:40:49 +01:00
2023-06-20 18:07:34 +02:00
2023-06-29 10:17:36 +01:00
2023-06-27 12:15:49 +01:00
2023-06-13 19:19:40 +02:00
2023-05-18 17:29:04 +02:00
2023-06-20 19:19:19 +02:00
2023-02-28 19:40:57 +01:00
2022-12-12 13:12:13 -05:00
2023-06-27 12:15:49 +01:00
2023-04-06 22:52:59 +02:00
2023-06-22 16:11:27 +02:00
2023-06-16 15:40:49 +01:00
2023-02-06 18:10:56 -05:00
2023-06-27 12:15:49 +01:00
2023-02-28 19:40:57 +01:00
2023-06-29 10:17:36 +01:00
2023-06-22 16:11:27 +02:00
2023-06-28 19:06:30 +02:00
2023-03-07 04:20:14 +01:00
2023-06-22 16:11:27 +02:00
2023-06-20 14:43:10 +02:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-16 15:40:49 +01:00
2023-06-29 10:17:36 +01:00
2023-06-22 16:11:27 +02:00
2023-05-30 16:50:41 +02:00
2023-06-20 12:59:21 +01:00
2023-04-06 17:56:06 +02:00
2023-06-22 16:11:27 +02:00
2023-06-16 15:40:49 +01:00
2023-04-06 17:56:06 +02:00
2023-06-22 16:11:27 +02:00
2023-04-11 10:00:34 +02:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-16 15:40:49 +01:00
2023-06-27 12:15:49 +01:00
2023-04-07 17:13:04 +02:00
2023-02-28 19:40:57 +01:00
2023-06-29 10:17:36 +01:00
2023-06-16 15:40:49 +01:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-05 18:12:45 +02:00
2023-05-24 13:52:52 +01:00
2023-05-24 13:52:52 +01:00
2023-06-29 14:48:59 +01:00
2023-05-18 11:04:51 +01:00
2023-06-29 10:17:36 +01:00
2023-02-28 19:40:57 +01:00
2023-04-04 14:53:06 +02:00
2023-04-21 17:09:40 +01:00
2023-02-28 19:40:57 +01:00
2023-03-23 19:14:17 +01:00
2023-04-28 11:01:32 -04:00
2023-06-13 17:51:37 +01:00
2023-06-16 15:40:49 +01:00
2023-06-22 16:11:27 +02:00
2023-06-22 16:11:27 +02:00
2023-04-06 17:56:06 +02:00
2023-06-29 10:17:36 +01:00
2023-02-06 18:10:56 -05:00
2023-06-22 16:11:27 +02:00
2023-05-18 11:04:51 +01:00
2023-06-29 10:17:36 +01:00
2023-05-18 11:04:51 +01:00
2023-02-28 19:40:57 +01:00
2023-06-16 15:40:49 +01:00
2023-05-31 14:59:30 +01:00
2023-05-18 11:04:51 +01:00
2023-06-29 10:17:36 +01:00
2023-05-24 13:52:52 +01:00
2023-06-29 10:17:36 +01:00
2023-02-06 18:10:56 -05:00
2023-06-27 14:45:40 -04:00
2023-05-24 13:52:52 +01:00
2023-03-14 10:03:02 +01:00
2023-06-22 16:11:27 +02:00
2023-06-27 12:15:49 +01:00
2023-06-22 16:11:27 +02:00
2023-06-29 10:17:36 +01:00
2023-06-27 12:15:49 +01:00
2023-06-27 12:15:49 +01:00
2023-02-06 18:10:56 -05:00
2023-06-22 16:11:27 +02:00
2023-02-28 19:40:57 +01:00
2023-06-27 12:15:49 +01:00
2023-04-06 17:45:55 +02:00
2023-02-28 19:40:57 +01:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-03-07 14:23:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-22 16:11:27 +02:00
2023-06-27 10:07:06 -04:00
2023-06-29 10:17:36 +01:00
2023-06-20 18:35:45 +02:00
2023-02-06 18:10:56 -05:00
2023-06-22 16:11:27 +02:00
2023-06-29 10:17:36 +01:00
2023-06-27 21:35:15 -04:00
2023-03-21 19:22:01 +01:00
2023-05-24 13:52:52 +01:00
2023-05-18 11:04:51 +01:00
2023-06-29 10:17:36 +01:00
2023-06-27 12:15:49 +01:00
2023-06-27 12:15:49 +01:00
2023-02-28 19:40:57 +01:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-22 16:11:27 +02:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-22 16:11:27 +02:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-29 10:17:36 +01:00
2023-06-27 12:15:49 +01:00
2023-06-27 12:15:49 +01:00
2023-04-17 12:41:55 +02:00
2023-06-27 12:15:49 +01:00
2023-06-28 20:11:01 +02:00
2023-06-22 16:11:27 +02:00
2023-06-13 19:04:22 +01:00
2023-05-24 13:52:52 +01:00
2023-03-06 09:15:44 +01:00
2023-05-24 13:52:52 +01:00
2023-03-29 16:16:23 +02:00
2023-06-20 12:59:21 +01:00
2023-03-29 16:16:23 +02:00
2023-06-29 10:17:36 +01:00
2023-02-28 19:40:57 +01:00