Manuel de Prada Corral
|
c338fd43b0
|
[cache refactor] Move all the caching logic to a per-layer approach (#39106)
* Squash for refactor: Replace monolithic cache classes with modular LayeredCache (#38077)
- Introduces CacheLayer and Cache base classes
- Ports Static, Dynamic, Offloaded, Quantized, Hybrid, etc. to use layers
- Implements method/attr dispatch across layers to reduce boilerplate
- Adds CacheProcessor hooks for offloading, quantization, etc.
- Updates and passes tests
* fix quantized, add tests
* remove CacheProcessorList
* raushan review, arthur review
* joao review: minor things
* remove cache configs, make CacheLayer a mixin (joaos review)
* back to storage inside Cache()
* remove cachebase for decorator
* no more __getattr__
* fix tests
* joaos review except docs
* fix ast deprecations for python 3.14: replace node.n by node.value and use `ast.Constant`
More verbose exceptions in `fix_docstring` on docstring formatting issues.
* Revert "back to storage inside Cache()"
This reverts commit 27916bc2737806bf849ce2148cb1e66d59573913.
* cyril review
* simplify cache export
* fix lfm2 cache
* HybridChunked to layer
* BC proxy object for cache.key_cache[i]=...
* reorder classes
* bfff come on LFM2
* better tests for hybrid and hybridChunked
* complete coverage for hybrid chunked caches (prefill chunking)
* reimplementing HybridChunked
* cyril review
* fix ci
* docs for cache refactor
* docs
* oopsie
* oopsie
* fix after merge
* cyril review
* arthur review
* opsie
* fix lfm2
* opsie2
|
2025-07-22 16:10:25 +02:00 |
|
Joao Gante
|
beaed8ce01
|
[generate] move SinkCache to a custom_generate repo (#38399)
remove sink cache
|
2025-06-02 12:13:30 +02:00 |
|
Pavel Iakubovskii
|
4f58fc9c82
|
Deprecate modeling_utils.py classes (#37298)
* Move utils classes into models
* Add deprecation warnings
* Remove from docs
* Update config attributes check
|
2025-04-18 18:47:34 +01:00 |
|
Yijun Lee
|
554ed5d1e0
|
🌐 [i18n-KO] Translated trainer_utils.md to Korean (#33817)
* docs: ko: trainer_utils.md
* feat: nmt draft
* fix: manual edits
* fix: resolve suggestions
Co-authored-by: Woojun Jung <46880056+jungnerd@users.noreply.github.com>
---------
Co-authored-by: Woojun Jung <46880056+jungnerd@users.noreply.github.com>
|
2024-10-15 11:21:05 -07:00 |
|
Yijun Lee
|
88d01d9119
|
🌐 [i18n-KO] Translated generation_utils.md to Korean (#33818)
* docs: ko: generation_utils.md
* feat: nmt draft
* fix: manual edits
* fix: resolve suggestions
Co-authored-by: Woojun Jung <46880056+jungnerd@users.noreply.github.com>
* Update generation_utils.md
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
---------
Co-authored-by: Woojun Jung <46880056+jungnerd@users.noreply.github.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
|
2024-10-09 11:55:07 -07:00 |
|
Yijun Lee
|
6ac5f25bb6
|
🌐 [i18n-KO] Translated modeling_utils.md to Korean (#33808)
* docs: ko: modeling_utils.md
* feat: nmt draft
* fix: manual edits
* fix: resolve suggestions
Co-authored-by: Jiwook Han <33192762+mreraser@users.noreply.github.com>
---------
Co-authored-by: Jiwook Han <33192762+mreraser@users.noreply.github.com>
|
2024-10-09 10:50:03 -07:00 |
|
Yijun Lee
|
6151bc47ba
|
🌐 [i18n-KO] Translated image_processing_utils.md to Korean (#33804)
* docs: ko: image_processing_utils.md
* feat: nmt draft
* fix: manual edits
|
2024-10-08 18:19:37 -07:00 |
|
Yijun Lee
|
c15d01fa1d
|
🌐 [i18n-KO] Translated file_utils.md to Korean (#33803)
* docs: ko: file_utils.md
* feat: nmt draft
* fix: manual edits
* fix: resolve suggestions
Co-authored-by: Jiwook Han <33192762+mreraser@users.noreply.github.com>
---------
Co-authored-by: Jiwook Han <33192762+mreraser@users.noreply.github.com>
|
2024-10-08 17:57:17 -07:00 |
|
Yijun Lee
|
0d0ec1dbfb
|
🌐 [i18n-KO] Translated tokenization_utils.md to Korean (#33813)
* docs: ko: tokenization_utils.md
* feat: nmt draft
* fix: manual edits
|
2024-10-08 17:56:30 -07:00 |
|
Yijun Lee
|
e9fbe62965
|
🌐 [i18n-KO] Translated pipelines_utils.md to Korean (#33809)
* docs: ko: pipelines_utils.md
* feat: nmt draft
* fix: manual edits
|
2024-10-07 15:05:17 -07:00 |
|
Yijun Lee
|
9c61ba2f25
|
🌐 [i18n-KO] Translated time_series_utils.md to Korean (#33806)
* docs: ko: time_series_utils.md
* feat: nmt draft
* fix: manual edits
|
2024-10-07 15:05:00 -07:00 |
|
Yijun Lee
|
6996f2186a
|
🌐 [i18n-KO] Translated audio_utils.md to Korean (#33802)
* docs: ko: audio_utils.md
* feat: nmt draft
* fix: manual edits
|
2024-10-07 13:39:10 -07:00 |
|