Raushan Turganbay 4ab33c2d81 Generation: stop at eos for assisted decoding (#31301) ...

* fix

* move changes to prompt lookup

* add test

* set eos in assistant model

* style

* fix flakiness

* changes for new `main`

* Update tests/generation/test_utils.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Update tests/generation/test_utils.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* add comment to explain

---------

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

2024-07-26 10:16:06 +05:00

..

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_beam_constraints.py

Generate: move generation_*.py src files into generation/*.py (#20096)

2022-11-09 15:34:08 +00:00

test_beam_search.py

Time to Say Goodbye, torch 1.7 and 1.8 (#22291)

2023-03-21 19:22:01 +01:00

test_configuration_utils.py

Follow up for #31973 (#32025)

2024-07-25 16:12:23 +02:00

test_flax_logits_process.py

Adding FlaxNoRepeatNGramLogitsProcessor (#29677)

2024-04-02 11:39:33 +02:00

test_flax_utils.py

Add support for beam search's num_return_sequencs flag in flax (#23082)

2023-05-03 10:50:34 -04:00

test_framework_agnostic.py

Generation: fix handling of special tokens (#31254)

2024-06-06 15:21:32 +05:00

test_logits_process.py

Pass device in Logits Processor's init (#29804)

2024-06-04 10:19:19 +05:00

test_stopping_criteria.py

Fix single letter stop strings (#31448)

2024-06-18 14:07:16 +01:00

test_streamers.py

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

test_tf_logits_process.py

Better TF docstring types (#23477)

2023-05-24 13:52:52 +01:00

test_tf_utils.py

Revert workaround for TF safetensors loading (#30128)

2024-04-09 11:04:18 +01:00

test_utils.py

Generation: stop at eos for assisted decoding (#31301)

2024-07-26 10:16:06 +05:00