Kashif Rasul 2936902a76 [Paged-Attention] Handle continuous batching for repetition penalty (#39457) ...

* Handle continuous batching for repetition penalty

* fix last scores and with token mask creation

* add test

* Update src/transformers/generation/continuous_batching.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Update src/transformers/generation/logits_process.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* fix formatting

* remove unneeded cast

---------

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

2025-07-22 18:13:40 +02:00

..

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_beam_constraints.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_beam_search.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_candidate_generator.py

prune LM Head for USD (#36695)

2025-04-08 16:44:10 +01:00

test_configuration_utils.py

🚨🚨🚨 [pipelines] update defaults in pipelines that can generate (#38129)

2025-05-19 18:02:06 +01:00

test_flash_attention_parity.py

Support for Flash Attention 3 (#38972)

2025-06-25 14:39:27 +02:00

test_fsdp.py

enable generation fsdp/utils cases on XPU (#38009)

2025-05-09 20:52:41 +00:00

test_logits_process.py

[Paged-Attention] Handle continuous batching for repetition penalty (#39457)

2025-07-22 18:13:40 +02:00

test_paged_attention.py

enable more test cases on xpu (#38572)

2025-06-06 09:29:51 +02:00

test_stopping_criteria.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_streamers.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_utils.py

[cache refactor] Move all the caching logic to a per-layer approach (#39106)

2025-07-22 16:10:25 +02:00