Generate: basic token streaming (#22449)

* haha tokens go brrrr
2023-03-30 12:00:12 +01:00
parent f0aeb1be17
commit 228792a9dc
8 changed files with 230 additions and 7 deletions
--- a/docs/source/en/main_classes/text_generation.mdx
+++ b/docs/source/en/main_classes/text_generation.mdx
@@ -24,7 +24,8 @@ of the generation method.

 To learn how to inspect a model's generation configuration, what are the defaults, how to change the parameters ad hoc,
 and how to create and save a customized generation configuration, refer to the
-[text generation strategies guide](../generation_strategies).
+[text generation strategies guide](../generation_strategies). The guide also explains how to use related features,
+like token streaming.

 ## GenerationConfig