Marc Sun 6cc4dfe3f1 Fix the initialization of the cache when we have multi gpu (#33303) ...

* init cache multi-gpu

* Update src/transformers/generation/utils.py

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* switch to execution device map

* naming more consistant

* fix

* mutually exclusive device

* added an integration example

* remove useless check

* suggestion from joao + typing

* fix couple of typo and add test

* revert check

---------

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

2024-09-13 15:06:08 +02:00

..

agents

Multi agents with manager (#32687)

2024-09-04 17:30:54 +02:00

benchmark

…

bettertransformer

…

deepspeed

Revert PR 32299, flag users when Zero-3 was missed (#32851)

2024-08-16 12:35:41 -04:00

extended

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

fixtures

Implementation of SuperPoint and AutoModelForKeypointDetection (#28966)

2024-03-19 14:43:02 +00:00

fsdp

🚨🚨🚨 Update min version of accelerate to 0.26.0 (#32627)

2024-08-20 11:42:36 +02:00

generation

Fix the initialization of the cache when we have multi gpu (#33303)

2024-09-13 15:06:08 +02:00

models

[Phi-3] Bug on stale kv cache (#33129)

2024-09-13 14:07:19 +02:00

optimization

fix: Fixed the 1st argument name in classmethods (#31907)

2024-07-11 12:11:50 +01:00

peft_integration

FIX [CI]: Fix failing tests for peft integration (#29330)

2024-02-29 03:56:16 +01:00

pipelines

Compile compatibilty for decoder-only models (#32617)

2024-09-09 10:59:04 +02:00

quantization

Fix FbgemmFp8Linear not preserving tensor shape (#33239)

2024-09-11 13:26:44 +02:00

repo_utils

Refactor CI: more explicit (#30674)

2024-08-30 18:17:25 +02:00

sagemaker

Fixed log messages that are resulting in TypeError due to too many arguments (#32017)

2024-07-17 10:56:44 +01:00

tokenization

Mitigate a conflict when using sentencepiece (#33327)

2024-09-13 13:19:06 +02:00

trainer

add a callback hook right before the optimizer step (#33444)

2024-09-13 10:43:45 +02:00

utils

Make StaticCache configurable at model construct time (#32830)

2024-09-10 16:35:57 +01:00

__init__.py

…

test_backbone_common.py

Align backbone stage selection with out_indices & out_features (#27606)

2023-12-20 18:33:17 +00:00

test_configuration_common.py

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

test_feature_extraction_common.py

…

test_image_processing_common.py

Update kwargs validation for preprocess with decorator (#32024)

2024-08-06 11:33:05 +01:00

test_image_transforms.py

fix: center_crop occasionally outputs off-by-one dimension matrix (#30934)

2024-05-21 13:56:52 +01:00

test_modeling_common.py

Compile compatibilty for decoder-only models (#32617)

2024-09-09 10:59:04 +02:00

test_modeling_flax_common.py

add sdpa to ViT [follow up of #29325] (#30555)

2024-05-16 10:56:11 +01:00

test_modeling_tf_common.py

Port IDEFICS to tensorflow (#26870)

2024-05-13 15:59:46 +01:00

test_pipeline_mixin.py

Config: unified logic to retrieve text config (#33219)

2024-09-04 12:03:30 +01:00

test_processing_common.py

Qwen2-VL: clean-up and add more tests (#33354)

2024-09-12 18:24:04 +02:00

test_sequence_feature_extraction_common.py

…

test_tokenization_common.py

Enable padding_side as call time kwargs (#33385)

2024-09-13 11:58:38 +01:00