[docs] navigation improvement between text gen pipelines and text gen params (#26477)

* navigation improvement between text generation pipelines and text generation docs * make style
2023-09-29 03:43:39 -04:00
parent 7bb1c0c147
commit 14170b784b
3 changed files with 10 additions and 4 deletions
--- a/docs/source/en/generation_strategies.md
+++ b/docs/source/en/generation_strategies.md
@@ -82,7 +82,8 @@ Even if the default decoding strategy mostly works for your task, you can still
 commonly adjusted parameters include:

 - `max_new_tokens`: the maximum number of tokens to generate. In other words, the size of the output sequence, not
-including the tokens in the prompt.
+including the tokens in the prompt. As an alternative to using the output's length as a stopping criteria, you can choose 
+to stop generation whenever the full generation exceeds some amount of time. To learn more, check [`StoppingCriteria`].
 - `num_beams`: by specifying a number of beams higher than 1, you are effectively switching from greedy search to
 beam search. This strategy evaluates several hypotheses at each time step and eventually chooses the hypothesis that
 has the overall highest probability for the entire sequence. This has the advantage of identifying high-probability