Yoach Lacombe
c43b380e70
Add MusicGen Melody (#28819)
* first modeling code
* make repository
* still WIP
* update model
* add tests
* add latest change
* clean docstrings and copied from
* update docstrings md and readme
* correct chroma function
* correct copied from and remove unreleated test
* add doc to toctree
* correct imports
* add convert script to notdoctested
* Add suggestion from Sanchit
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com>
* correct get_uncoditional_inputs docstrings
* modify README according to SANCHIT feedback
* add chroma to audio utils
* clean librosa and torchaudio hard dependencies
* fix FE
* refactor audio decoder -> audio encoder for consistency with previous musicgen
* refactor conditional -> encoder
* modify sampling rate logics
* modify license at the beginning
* refactor all_self_attns->all_attentions
* remove ignore copy from causallm generate
* add copied from for from_sub_models
* fix make copies
* add warning if audio is truncated
* add copied from where relevant
* remove artefact
* fix convert script
* fix torchaudio and FE
* modify chroma method according to feedback-> better naming
* refactor input_values->input_features
* refactor input_values->input_features and fix import fe
* add input_features to docstrigs
* correct inputs_embeds logics
* remove dtype conversion
* refactor _prepare_conditional_hidden_states_kwargs_for_generation ->_prepare_encoder_hidden_states_kwargs_for_generation
* change warning for chroma length
* Update src/transformers/models/musicgen_melody/convert_musicgen_melody_transformers.py
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com>
* change way to save wav, using soundfile
* correct docs and change to soundfile
* fix import
* fix init proj layers
* remove line breaks from md
* fix issue with docstrings
* add FE suggestions
* improve is in logics and remove useless imports
* remove custom from_pretrained
* simplify docstring code
* add suggestions for modeling tests
* make style
* update converting script with sanity check
* remove encoder attention mask from conditional generation
* replace musicgen melody checkpoints with official orga
* rename ylacombe->facebook in checkpoints
* fix copies
* remove unecessary warning
* add shape in code docstrings
* add files to slow doc tests
* fix md bug and add md to not_tested
* make fix-copies
* fix hidden states test and batching
---------
Co-authored-by: Sanchit Gandhi <93869735+sanchit-gandhi@users.noreply.github.com>
2024-03-18 13:06:12 +00:00
..
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2024-03-12 17:46:19 +00:00
2023-11-08 07:39:37 +00:00
2024-02-23 12:46:31 +00:00
2024-03-12 17:46:19 +00:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-02-29 17:19:17 +08:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-08 10:06:46 +00:00
2024-03-13 14:53:27 +01:00
2024-02-05 14:50:07 +00:00
2024-03-08 10:06:46 +00:00
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2023-08-11 11:30:18 +01:00
2023-09-25 18:08:12 +02:00
2024-02-02 08:45:00 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-15 14:29:11 +01:00
2024-03-12 17:46:19 +00:00
2024-01-30 17:26:36 +00:00
2024-02-05 14:50:07 +00:00
2024-02-05 14:50:07 +00:00
2023-03-22 20:02:24 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-02-05 14:50:07 +00:00
2024-02-29 17:19:17 +08:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2023-02-28 19:40:57 +01:00
2024-03-04 14:18:09 +00:00
2024-02-29 17:19:17 +08:00
2024-01-25 09:34:50 +01:00
2024-03-01 09:42:13 +00:00
2024-03-12 17:46:19 +00:00
2024-02-05 14:50:07 +00:00
2024-02-05 14:50:07 +00:00
2024-03-13 14:53:27 +01:00
2023-06-29 10:17:36 +01:00
2024-02-05 14:50:07 +00:00
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2024-02-29 17:19:17 +08:00
2024-02-05 14:50:07 +00:00
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2024-02-20 16:17:51 +00:00
2023-10-31 18:12:14 +01:00
2024-03-13 14:53:27 +01:00
2024-03-01 03:01:53 +01:00
2023-12-09 05:38:14 +09:00
2024-03-13 14:53:27 +01:00
2024-03-08 10:13:54 +00:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2024-02-05 14:50:07 +00:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2023-11-23 21:00:39 +01:00
2024-03-13 14:53:27 +01:00
2023-10-30 19:53:46 +01:00
2024-02-29 17:19:17 +08:00
2024-03-13 14:53:27 +01:00
2023-08-02 20:22:36 +02:00
2024-02-16 08:16:58 +01:00
2024-01-21 17:01:19 +00:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 08:43:00 +01:00
2024-03-13 14:53:27 +01:00
2023-07-24 10:08:47 -04:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2023-10-05 10:27:05 +02:00
2023-11-08 20:58:36 +01:00
2023-12-09 05:38:14 +09:00
2024-02-05 14:50:07 +00:00
2024-03-12 17:46:19 +00:00
2024-03-12 17:46:19 +00:00
2023-10-31 18:12:14 +01:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-02-29 17:19:17 +08:00
2023-10-30 19:53:46 +01:00
2024-03-13 14:53:27 +01:00
2024-01-10 08:33:33 +01:00
2024-03-13 14:53:27 +01:00
2024-01-11 16:18:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-11 09:46:24 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-02-05 14:50:07 +00:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-02-02 14:11:50 +01:00
2023-08-02 20:22:36 +02:00
2022-05-03 14:42:02 +02:00
2024-03-13 14:53:27 +01:00
2024-01-31 14:19:02 +01:00
2024-01-24 10:12:14 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-02-05 14:50:07 +00:00
2024-03-12 17:46:19 +00:00
2024-02-05 14:50:07 +00:00
2024-02-05 14:50:07 +00:00
2024-03-13 14:53:27 +01:00
2024-01-08 10:39:40 +01:00
2024-03-12 17:46:19 +00:00
2024-02-16 08:16:58 +01:00
2024-03-13 19:12:20 +01:00
2024-03-18 13:06:12 +00:00
2024-03-13 14:53:27 +01:00
2024-02-05 14:50:07 +00:00
2023-08-02 20:22:36 +02:00
2024-03-13 14:53:27 +01:00
2023-11-27 14:23:54 +00:00
2024-03-13 14:53:27 +01:00
2023-08-02 20:22:36 +02:00
2024-03-04 11:04:49 +00:00
2024-03-13 14:53:27 +01:00
2023-12-14 15:17:30 +00:00
2024-03-12 17:46:19 +00:00
2024-03-12 17:46:19 +00:00
2024-01-29 10:09:26 +00:00
2024-01-29 10:09:26 +00:00
2024-03-13 14:53:27 +01:00
2023-10-31 18:12:14 +01:00
2024-03-13 14:53:27 +01:00
2023-12-07 21:34:43 +09:00
2024-01-11 15:58:02 +01:00
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2024-02-05 14:50:07 +00:00
2024-01-11 16:18:27 +01:00
2024-03-13 14:53:27 +01:00
2024-02-29 17:19:17 +08:00
2024-03-14 17:00:32 +01:00
2024-02-16 08:16:58 +01:00
2024-03-13 14:53:27 +01:00
2024-03-14 16:48:11 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-02-05 14:50:07 +00:00
2024-03-13 14:53:27 +01:00
2024-02-05 14:50:07 +00:00
2024-03-13 14:53:27 +01:00
2024-02-16 08:16:58 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2023-08-02 20:22:36 +02:00
2024-01-30 17:26:36 +00:00
2024-03-13 14:53:27 +01:00
2023-12-14 14:43:44 +00:00
2024-02-29 17:19:17 +08:00
2024-03-13 17:52:49 +00:00
2023-09-05 10:12:25 +02:00
2023-09-05 10:12:25 +02:00
2024-03-13 14:53:27 +01:00
2024-02-20 16:17:51 +00:00
2024-03-15 17:58:11 +00:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2023-08-02 20:22:36 +02:00
2024-03-13 14:53:27 +01:00
2024-02-21 13:12:49 +01:00
2024-02-29 03:52:13 +01:00
2024-02-05 14:50:07 +00:00
2024-02-05 14:50:07 +00:00
2024-02-05 14:50:07 +00:00
2024-02-05 14:50:07 +00:00
2024-02-16 08:16:58 +01:00
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2023-11-27 15:48:17 +01:00
2023-09-18 23:47:54 +02:00
2023-08-02 20:22:36 +02:00
2023-11-09 18:35:42 +00:00
2024-01-23 11:01:50 +00:00
2024-03-13 14:53:27 +01:00
2024-02-16 08:16:58 +01:00
2023-10-03 10:52:34 +02:00
2024-01-11 16:18:27 +01:00
2024-03-12 17:46:19 +00:00
2024-01-23 11:01:50 +00:00
2023-11-27 15:48:17 +01:00
2024-03-12 17:46:19 +00:00
2024-01-10 08:33:33 +01:00
2024-03-07 20:45:51 +00:00
2023-11-16 17:43:19 +01:00
2023-10-30 19:53:46 +01:00
2024-02-05 14:50:07 +00:00
2024-03-12 17:46:19 +00:00
2024-03-12 17:46:19 +00:00
2024-02-05 14:50:07 +00:00
2023-12-08 14:54:32 +01:00
2024-01-23 11:01:50 +00:00
2024-03-13 14:53:27 +01:00
2023-08-16 17:45:02 +01:00
2024-03-13 14:53:27 +01:00
2024-01-18 13:37:34 +00:00
2023-10-31 18:12:14 +01:00
2024-03-13 14:53:27 +01:00
2023-10-30 15:27:15 +01:00
2024-01-11 16:18:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-12 17:46:19 +00:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-03-13 14:53:27 +01:00
2024-02-20 12:06:46 +00:00
2024-03-13 14:53:27 +01:00
2024-02-16 08:16:58 +01:00
2024-03-01 09:42:13 +00:00
2023-08-02 20:22:36 +02:00
2022-05-03 14:42:02 +02:00