Raushan Turganbay 5fabd1e83b Generation: fix handling of special tokens (#31254) ...

* fix special tokens in generatioon

* fix test

* add warning

* fix the check

* warn once

* fix

2024-06-06 15:21:32 +05:00

..

__init__.py

…

test_beam_constraints.py

Generate: move generation_*.py src files into generation/*.py (#20096)

2022-11-09 15:34:08 +00:00

test_beam_search.py

Time to Say Goodbye, torch 1.7 and 1.8 (#22291)

2023-03-21 19:22:01 +01:00

test_configuration_utils.py

Generate: get generation mode from the generation config instance 🧼 (#29441)

2024-03-06 11:18:35 +00:00

test_flax_logits_process.py

Adding FlaxNoRepeatNGramLogitsProcessor (#29677)

2024-04-02 11:39:33 +02:00

test_flax_utils.py

Add support for beam search's num_return_sequencs flag in flax (#23082)

2023-05-03 10:50:34 -04:00

test_framework_agnostic.py

Generation: fix handling of special tokens (#31254)

2024-06-06 15:21:32 +05:00

test_logits_process.py

Pass device in Logits Processor's init (#29804)

2024-06-04 10:19:19 +05:00

test_stopping_criteria.py

Terminator strings for generate() (#28932)

2024-04-22 14:13:04 +01:00

test_streamers.py

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

test_tf_logits_process.py

Better TF docstring types (#23477)

2023-05-24 13:52:52 +01:00

test_tf_utils.py

Revert workaround for TF safetensors loading (#30128)

2024-04-09 11:04:18 +01:00

test_utils.py

Token healing (#30081)

2024-06-03 10:53:15 +02:00