Peter St. John d69945e5fc [ESM] Add flash-attention-2 backend for ESM-2 (#38023) ...

* Add flash-attention-2 backend for ESM-2

Signed-off-by: Peter St. John <pstjohn@nvidia.com>

* update extended_attention_mask for fa2

Signed-off-by: Peter St. John <pstjohn@nvidia.com>

* add test_flash_attn_2_equivalence test

Signed-off-by: Peter St. John <pstjohn@nvidia.com>

---------

Signed-off-by: Peter St. John <pstjohn@nvidia.com>

2025-05-16 14:11:56 +01:00

..

bettertransformer

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

deepspeed

🚨 rm already deprecated pad_to_max_length arg (#37617)

2025-05-01 15:21:55 +02:00

extended

Add Optional to remaining types (#37808)

2025-04-28 14:20:45 +01:00

fixtures

…

fsdp

Fix the fsdp config cannot work issue. (#37549)

2025-04-28 10:44:51 +02:00

generation

Bart: new cache format (#35314)

2025-05-16 13:26:54 +02:00

models

[ESM] Add flash-attention-2 backend for ESM-2 (#38023)

2025-05-16 14:11:56 +01:00

optimization

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

peft_integration

FIX: Faulty PEFT tests (#37757)

2025-04-28 15:10:46 +02:00

pipelines

Process inputs directly in apply_chat_template in image-text-to-text pipeline (#35616)

2025-04-23 13:31:33 -04:00

quantization

clean autoawq cases on xpu (#38163)

2025-05-16 13:56:43 +02:00

repo_utils

Simplify soft dependencies and update the dummy-creation process (#36827)

2025-04-11 11:08:36 +02:00

sagemaker

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

tensor_parallel

enable tp on CPU (#36299)

2025-03-31 10:55:47 +02:00

tokenization

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

trainer

enable trainer test cases on xpu (#38138)

2025-05-15 12:17:44 +00:00

utils

[video processor] fix tests (#38104)

2025-05-14 10:24:07 +00:00

__init__.py

…

test_backbone_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_configuration_common.py

Update composition flag usage (#36263)

2025-04-09 11:48:49 +02:00

test_feature_extraction_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_image_processing_common.py

Refactor image processor phi4 (#36976)

2025-05-12 15:13:40 -04:00

test_image_transforms.py

Fix pad image transform for batched inputs (#37544)

2025-05-08 10:51:15 +01:00

test_modeling_common.py

Bart: new cache format (#35314)

2025-05-16 13:26:54 +02:00

test_modeling_flax_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_modeling_tf_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_pipeline_mixin.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_processing_common.py

🔴 Video processors as a separate class (#35206)

2025-05-12 11:55:51 +02:00

test_sequence_feature_extraction_common.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_tokenization_common.py

🚨 rm already deprecated pad_to_max_length arg (#37617)

2025-05-01 15:21:55 +02:00

test_training_args.py

Fix TrainingArguments.torch_empty_cache_steps post_init check (#36734)

2025-03-17 16:09:46 +01:00

test_video_processing_common.py

🔴 Video processors as a separate class (#35206)

2025-05-12 11:55:51 +02:00