SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[Generate] Add save mode logits processor to remove nans and infs if necessary (#10769)

Browse Source 
* push

* finish

* finish

* make fix copies

* change name
This commit is contained in:
Patrick von Platen
2021-03-23 01:00:05 +03:00
committed by GitHub
parent 9f8fa4e973
commit 77bf3fe787
9 changed files with 156 additions and 36 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
docs/source/internal/generation_utils.rst
View File

@@ -151,6 +151,16 @@ generation.
.. autoclass:: transformers.HammingDiversityLogitsProcessor
:members: __call__
.. autoclass:: transformers.ForcedBOSTokenLogitsProcessor
:members: __call__
.. autoclass:: transformers.ForcedEOSTokenLogitsProcessor
:members: __call__
.. autoclass:: transformers.InfNanRemoveLogitsProcessor
:members: __call__
StoppingCriteria
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~