[generate] move SinkCache to a custom_generate repo (#38399)

remove sink cache
2025-06-02 11:13:30 +01:00
parent fe5bfaa4b5
commit beaed8ce01
6 changed files with 13 additions and 240 deletions
--- a/docs/source/en/internal/generation_utils.md
+++ b/docs/source/en/internal/generation_utils.md
@@ -380,11 +380,6 @@ A [`Constraint`] can be used to force the generation to include specific tokens

 [[autodoc]] HQQQuantizedCache

-[[autodoc]] SinkCache
-    - update
-    - get_seq_length
-    - reorder_cache
-
 [[autodoc]] OffloadedCache
    - update
    - prefetch_layer
@@ -443,4 +438,3 @@ A [`Constraint`] can be used to force the generation to include specific tokens

 [[autodoc]] CompileConfig
    - __call__
-