TF generate refactor - Beam Search (#16374)

* refactor TF beam search * refactored generate can now properly use attention masks * add force bos/eos logit processors
2022-04-06 18:19:34 +01:00
parent 4d10083539
commit 3f43d824b9
11 changed files with 796 additions and 56 deletions
--- a/docs/source/en/internal/generation_utils.mdx
+++ b/docs/source/en/internal/generation_utils.mdx
@@ -178,6 +178,12 @@ generation.
 [[autodoc]] TFRepetitionPenaltyLogitsProcessor
    - __call__

+[[autodoc]] TFForcedBOSTokenLogitsProcessor
+    - __call__
+
+[[autodoc]] TFForcedEOSTokenLogitsProcessor
+    - __call__
+
 [[autodoc]] FlaxLogitsProcessor
    - __call__