[generate] move SinkCache to a custom_generate repo (#38399)

remove sink cache
2025-06-02 11:13:30 +01:00
parent fe5bfaa4b5
commit beaed8ce01
6 changed files with 13 additions and 240 deletions
--- a/docs/source/ko/internal/generation_utils.md
+++ b/docs/source/ko/internal/generation_utils.md
@@ -366,11 +366,6 @@ generation_output[:2]

 [[autodoc]] HQQQuantizedCache

-[[autodoc]] SinkCache
-    - update
-    - get_seq_length
-    - reorder_cache
-
 [[autodoc]] OffloadedCache
    - update
    - prefetch_layer