Add Flash Attention 2 support to Musicgen and Musicgen Melody (#29939)

Browse Source

* add FA2 to o.g Musicgen

* make style

* add FA2 support to Musicgen Melody

* add generation FA2 tests to o.g Musicgen

* make style and fix copies

* add Musicgen to FA2 docs + deprecate list

* add sdpa supports to Musicgen's

* make style and fix copies

* refactor attention implementation arguments

* add Copied from to sdpa tests

* add copied form in sdpa tests melody

* add copied for FA2 generation tests

* add FA2 inference copied from

* make style

...

This commit is contained in:

Yoach Lacombe

2024-04-02 11:23:49 +01:00

committed by GitHub

parent fed27ffc7e

commit 0d04b1e25a

8 changed files with 3313 additions and 24 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

1250

tests/models/musicgen/test_modeling_musicgen.py

File diff suppressed because it is too large Load Diff