Marc Sun 6cc4dfe3f1 Fix the initialization of the cache when we have multi gpu (#33303) ...

* init cache multi-gpu

* Update src/transformers/generation/utils.py

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* switch to execution device map

* naming more consistant

* fix

* mutually exclusive device

* added an integration example

* remove useless check

* suggestion from joao + typing

* fix couple of typo and add test

* revert check

---------

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

2024-09-13 15:06:08 +02:00

..

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_beam_constraints.py

Generate: move generation_*.py src files into generation/*.py (#20096)

2022-11-09 15:34:08 +00:00

test_beam_search.py

Time to Say Goodbye, torch 1.7 and 1.8 (#22291)

2023-03-21 19:22:01 +01:00

test_configuration_utils.py

Generate: throw warning when return_dict_in_generate is False but should be True (#33146)

2024-08-31 10:47:08 +01:00

test_flax_logits_process.py

Adding FlaxNoRepeatNGramLogitsProcessor (#29677)

2024-04-02 11:39:33 +02:00

test_flax_utils.py

Add support for beam search's num_return_sequencs flag in flax (#23082)

2023-05-03 10:50:34 -04:00

test_framework_agnostic.py

Generation: fix handling of special tokens (#31254)

2024-06-06 15:21:32 +05:00

test_logits_process.py

Pass device in Logits Processor's init (#29804)

2024-06-04 10:19:19 +05:00

test_stopping_criteria.py

Dynamic number of speculative tokens in order to accelerate speculative decoding (#33258)

2024-09-11 14:22:28 +02:00

test_streamers.py

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

test_tf_logits_process.py

fix: multilingual midel convert to tflite get wrong token (#32079)

2024-08-27 11:44:09 +02:00

test_tf_utils.py

Revert workaround for TF safetensors loading (#30128)

2024-04-09 11:04:18 +01:00

test_utils.py

Fix the initialization of the cache when we have multi gpu (#33303)

2024-09-13 15:06:08 +02:00