Arthur 2c47618c1a 🚨All attention refactor🚨 (#35235) ...

* refactor LlamaAttention

* minimal changes

* fix llama

* update

* modular gemmas

* modular nits

* modular updates

* nits

* simplify

* gpt2

* more modualr and fixes

* granite

* modular modular modular

* nits

* update

* qwen2 + starcoder2

* mostly gemma2

* Update image_processing_auto.py

* fix

* Update modular_starcoder2.py

* fix

* remove all copied from attentions

* remove gcv

* make fix-copies

* oups

* oups2.0

* fix some modulars + all copied from

* should be good now

* revert unwanted changes

* Update modeling_decision_transformer.py

* finish cleanup

* Update modeling_olmo.py

* consistency

* re-add gradient checkpointing attribute

* fix

* style

* make config necessary

* bis

* bis

* Update modeling_my_new_model2.py

* is_causal attr

* fix

* remove past kv return from decoder layer

* fix

* default rope config

* correctly fix rope config

* fix bias

* fix gpt2 attention output

* fix test

* fix inits

* fix default sdpa

* fix default sdpa implementation

* harmonize classes

* fix mistral

* fix sliding window models

* mixtral

* be more explicit

* style

* fix

* several fixes

* Update modeling_dbrx.py

* fix test

* olmo + phi

* rotary

* syle

* phi

* phi again

* again

* kwargs

* Update test_modeling_common.py

* skip fx tracing tests

* Update modeling_utils.py

* gemma 2

* again

* Update modeling_recurrent_gemma.py

* gemma2

* granite

* style

* starcoder

* Update sdpa_attention.py

* switch args

* Update modeling_mllama.py

* fix

* cache type tests

* gpt2

* Update test_modeling_common.py

* fix

* consistency

* fix shape with encoder

* should be the last one

* tests non model

* most comments

* small oupsi

* be more explicit in modulars

* more explicit modulars

* CIs! it works locally

* add kwargs to _flash_attention_forward

---------

Co-authored-by: Cyril Vallez <cyril.vallez@gmail.com>

2024-12-18 16:53:39 +01:00

..

agents

Add token cost + runtime monitoring to Agent and HfEngine children (#34548)

2024-12-03 13:14:52 +01:00

benchmark

…

bettertransformer

Fixed malapropism error (#26660)

2023-10-09 11:04:57 +02:00

deepspeed

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00

extended

[tests] skip tests for xpu (#33553)

2024-09-19 19:28:04 +01:00

fixtures

Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)

2024-03-19 14:43:02 +00:00

fsdp

FSDP grad accum fix (#34645)

2024-11-15 22:28:06 +01:00

generation

skip Fuyu from test_generate (#35246)

2024-12-13 10:12:49 +01:00

models

🚨All attention refactor🚨 (#35235)

2024-12-18 16:53:39 +01:00

optimization

fix: Fixed the 1st argument name in classmethods (#31907)

2024-07-11 12:11:50 +01:00

peft_integration

[PEFT] Better Trainer error when prompt learning with loading best model at the end (#35087)

2024-12-11 12:44:39 +01:00

pipelines

Fix seamless TTS generate (#34968)

2024-12-11 15:38:42 +01:00

quantization

change bnb tests (#34713)

2024-12-18 09:49:59 -05:00

repo_utils

Refactor CI: more explicit (#30674)

2024-08-30 18:17:25 +02:00

sagemaker

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00

tokenization

VLM: special multimodal Tokenizer (#34461)

2024-11-04 16:37:51 +01:00

tp

Simplify Tensor Parallel implementation with PyTorch TP (#34184)

2024-11-18 19:51:49 +01:00

trainer

Fix GA loss bugs and add unit test (#35121)

2024-12-09 09:57:41 +01:00

utils

🚨All attention refactor🚨 (#35235)

2024-12-18 16:53:39 +01:00

__init__.py

…

test_backbone_common.py

Align backbone stage selection with out_indices & out_features (#27606)

2023-12-20 18:33:17 +00:00

test_configuration_common.py

Load sub-configs from composite configs (#34410)

2024-11-05 11:34:01 +01:00

test_feature_extraction_common.py

Split common test from core tests (#24284)

2023-06-15 07:30:24 -04:00

test_image_processing_common.py

Fall back to slow image processor in ImageProcessingAuto when no fast processor available (#34785)

2024-12-15 14:00:36 -05:00

test_image_transforms.py

fix: center_crop occasionally outputs off-by-one dimension matrix (#30934)

2024-05-21 13:56:52 +01:00

test_modeling_common.py

🚨All attention refactor🚨 (#35235)

2024-12-18 16:53:39 +01:00

test_modeling_flax_common.py

🚨All attention refactor🚨 (#35235)

2024-12-18 16:53:39 +01:00

test_modeling_tf_common.py

🚨All attention refactor🚨 (#35235)

2024-12-18 16:53:39 +01:00

test_pipeline_mixin.py

Add image text to text pipeline (#34170)

2024-10-31 15:48:11 -04:00

test_processing_common.py

Separate chat templates into a single file (#33957)

2024-11-26 14:18:04 +00:00

test_sequence_feature_extraction_common.py

Fix typo (#25966)

2023-09-05 10:12:25 +02:00

test_tokenization_common.py

Separate chat templates into a single file (#33957)

2024-11-26 14:18:04 +00:00