HuggingFace_transformer

Files

Jonathan Mamou 7a51cbc65f Dynamic number of speculative tokens in order to accelerate speculative decoding (#33258 )

* optimal Speculation Lookahead based on probability

* update peer finished condition

* add support to do_sample True

* add stopping criteria

* gitignore

* add print

* remove prints

* minor

* minor

* git ignore

* adding test to stopping ConfidenceCriteria

* doc + format

* add doc

* Update .gitignore

* update docstring and default value of assistant_confidence_threshold

* add docstring

* Update src/transformers/generation/configuration_utils.py

implicit default value (None)

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* style fix

---------

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

2024-09-11 14:22:28 +02:00

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725 )

2022-02-23 15:46:28 -05:00

test_beam_constraints.py

Generate: move generation_*.py src files into generation/*.py (#20096 )

2022-11-09 15:34:08 +00:00

test_beam_search.py

Time to Say Goodbye, torch 1.7 and 1.8 (#22291 )

2023-03-21 19:22:01 +01:00

test_configuration_utils.py

Generate: throw warning when return_dict_in_generate is False but should be True (#33146 )