Manuel de Prada Corral c338fd43b0 [cache refactor] Move all the caching logic to a per-layer approach (#39106) ...

* Squash for refactor: Replace monolithic cache classes with modular LayeredCache (#38077)

- Introduces CacheLayer and Cache base classes
- Ports Static, Dynamic, Offloaded, Quantized, Hybrid, etc. to use layers
- Implements method/attr dispatch across layers to reduce boilerplate
- Adds CacheProcessor hooks for offloading, quantization, etc.
- Updates and passes tests

* fix quantized, add tests

* remove CacheProcessorList

* raushan review, arthur review

* joao review: minor things

* remove cache configs, make CacheLayer a mixin (joaos review)

* back to storage inside Cache()

* remove cachebase for decorator

* no more __getattr__

* fix tests

* joaos review except docs

* fix ast deprecations for python 3.14: replace node.n by node.value and use `ast.Constant`

More verbose exceptions in `fix_docstring` on docstring formatting issues.

* Revert "back to storage inside Cache()"

This reverts commit 27916bc2737806bf849ce2148cb1e66d59573913.

* cyril review

* simplify cache export

* fix lfm2 cache

* HybridChunked to layer

* BC proxy object for cache.key_cache[i]=...

* reorder classes

* bfff come on LFM2

* better tests for hybrid and hybridChunked

* complete coverage for hybrid chunked caches (prefill chunking)

* reimplementing HybridChunked

* cyril review

* fix ci

* docs for cache refactor

* docs

* oopsie

* oopsie

* fix after merge

* cyril review

* arthur review

* opsie

* fix lfm2

* opsie2

2025-07-22 16:10:25 +02:00

..

import_structures

Support for version spec in requires & arbitrary mismatching depths across folders (#37854)

2025-05-09 15:26:27 +02:00

__init__.py

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

test_activations.py

use torch.testing.assertclose instead to get more details about error in cis (#35659)

2025-01-24 16:55:28 +01:00

test_add_new_model_like.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_audio_utils.py

Add torchcodec in docstrings/tests for datasets 4.0 (#39156)

2025-07-08 17:06:12 +02:00

test_auto_docstring.py

[AutoDocstring] Based on inspect parsing of the signature (#33771)

2025-05-08 17:46:07 -04:00

test_backbone_utils.py

🚨 out_indices always a list (#30941)

2024-05-22 15:23:04 +01:00

test_cache_utils.py

[cache refactor] Move all the caching logic to a per-layer approach (#39106)

2025-07-22 16:10:25 +02:00

test_chat_template_utils.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_cli.py

Transformers cli clean command (#37657)

2025-04-30 12:15:43 +01:00

test_configuration_utils.py

🚨🚨 Fix and simplify attention implementation dispatch and subconfigs handling (#39423)

2025-07-18 13:41:54 +02:00

test_convert_slow_tokenizer.py

Revert error back into warning for byte fallback conversion. (#22607)

2023-04-06 14:00:29 +02:00

test_deprecation.py

enable utils test cases on XPU (#38005)

2025-05-09 08:45:01 +02:00

test_doc_samples.py

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

test_dynamic_module_utils.py

Fix the regex in get_imports to support multiline try blocks and excepts with specific exception types (#23725)

2023-05-24 15:40:19 -04:00

test_expectations.py

Expectation fixes and added AMD expectations (#38729)

2025-06-13 16:14:58 +02:00

test_feature_extraction_utils.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_file_utils.py

[tests] remove tests from libraries with deprecated support (flax, tensorflow_text, ...) (#39051)

2025-06-26 16:25:00 +01:00

test_generic.py

Refactor the way we handle outputs for new llamas and new models (#39120)

2025-07-05 11:34:28 +02:00

test_hf_argparser.py

Fix typing order (#39467)

2025-07-17 15:47:31 +00:00

test_hub_utils.py

Add test to ensure unknown exceptions reraising in utils/hub.py::cached_files() (#37651)

2025-04-22 11:38:10 +02:00

test_image_processing_utils.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_image_utils.py

🔴 Video processors as a separate class (#35206)

2025-05-12 11:55:51 +02:00

test_import_structure.py

Enable some ruff checks for performance and readability (#39383)

2025-07-17 13:21:59 +00:00

test_import_utils.py

Fix test isolation for clear_import_cache utility (#36345)

2025-03-17 16:09:09 +01:00

test_logging.py

Fix flaky test for log level (#21776)

2023-02-28 16:24:14 -05:00

test_masking_utils.py

Add a default value for position_ids in masking_utils (#39310)

2025-07-10 18:53:40 +02:00

test_model_card.py

Use HF papers (#38184)

2025-06-13 11:07:09 +00:00

test_model_debugging_utils.py

Model debugger upgrades (#37391)

2025-04-18 16:45:54 +02:00

test_model_output.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_modeling_rope_utils.py

Delete deprecated stuff (#38838)

2025-07-10 05:18:44 +00:00

test_modeling_utils.py

🚨🚨 Fix and simplify attention implementation dispatch and subconfigs handling (#39423)

2025-07-18 13:41:54 +02:00

test_offline.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_skip_decorators.py

enable utils test cases on XPU (#38005)

2025-05-09 08:45:01 +02:00

test_tokenization_utils.py

Use Python 3.9 syntax in tests (#37343)

2025-04-08 14:12:08 +02:00

test_versions_utils.py

Remove old code for PyTorch, Accelerator and tokenizers (#37234)

2025-04-10 20:54:21 +02:00

test_video_utils.py

[video processor] support torchcodec and decrease cuda memory usage (#38880)

2025-06-25 08:23:37 +00:00

tiny_model_summary.json

Add image text to text pipeline (#34170)

2024-10-31 15:48:11 -04:00