Cyril Vallez dc11a3cbb2 [core] Refactor the Cache logic to make it simpler and more general (#39797) ...

* Simplify the logic quite a bit

* Update cache_utils.py

* continue work

* continue simplifying a lot

* style

* Update cache_utils.py

* offloading much simpler

* style

* Update cache_utils.py

* update inits

* Update cache_utils.py

* consistemncy

* Update cache_utils.py

* update generate

* style

* fix

* fix

* add early_initialization

* fix

* fix mamba caches

* update

* fix

* fix

* fix

* fix tests

* fix configs

* revert

* fix tests

* alright

* Update modeling_gptj.py

* fix the constructors

* cache tests

* Update test_cache_utils.py

* fix

* simplify

* back to before -> avoid compile bug

* doc

* mistral test

* llama4 test dtype

* Update test_modeling_llama4.py

* CIs

* Finally find a nice impl

* Update cache_utils.py

* Update cache_utils.py

* add lazy methods in autodoc

* typo

* better doc

* Add detailed docstring for lazy init

* CIs

* style

* fix

2025-08-08 14:47:21 +02:00

..

internal

[core] Refactor the Cache logic to make it simpler and more general (#39797)

2025-08-08 14:47:21 +02:00

main_classes

🌐 [i18n-KO] Translated tokenizer.md to Korean (#39532)

2025-07-29 08:04:14 -07:00

model_doc

Fix bad markdown links (#39819)

2025-07-31 09:14:14 -07:00

quantization

🌐 [i18n-KO] Translated quark.md to Korean (#39268)

2025-07-09 09:29:51 -07:00

tasks

No more Tuple, List, Dict (#38797)

2025-06-17 19:37:18 +01:00

_config.py

[#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888)

2024-04-08 14:21:16 +01:00

_toctree.yml

[docs] ko toc fix (#39927)

2025-08-06 10:12:34 +00:00

accelerate.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

accelerator_selection.md

[docs] Ko doc fixes after toc update (#39660)

2025-07-29 17:05:26 +01:00

add_new_model.md

Transformers cli clean command (#37657)

2025-04-30 12:15:43 +01:00

add_new_pipeline.md

add push_to_hub to pipeline (#29172)

2024-04-16 15:34:04 +01:00

cache_explanation.md

🌐 [i18n-KO] Translated cache_explanation.md to Korean (#39535)

2025-08-05 08:20:13 -07:00

chat_templating.md

🌐 [i18n-KO] Translated chat_templating.md to Korean (#32362)

2024-08-07 11:25:19 -07:00

community.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

contributing.md

Transformers cli clean command (#37657)

2025-04-30 12:15:43 +01:00

conversations.md

🌐 [i18n-KO] Translated conversations.md to Korean (#32468)

2024-08-27 09:25:41 -07:00

custom_models.md

Rename huggingface_cli to hf (#39630)

2025-07-25 14:10:04 +02:00

debugging.md

🌐 [i18n-KO] Translated debugging.md to Korean (#26246)

2023-09-27 13:47:44 -07:00

deepspeed.md

Transformers cli clean command (#37657)

2025-04-30 12:15:43 +01:00

executorch.md

Update docs/source/ko/_toctree.yml (#39516)

2025-07-22 09:00:42 -07:00

fast_tokenizers.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

fsdp.md

🌐 [i18n-KO] Translated fsdp.md to Korean (#32261)

2024-08-08 09:40:03 -07:00

generation_strategies.md

Fix bad markdown links (#39819)

2025-07-31 09:14:14 -07:00

gguf.md

Fixed broken links (#37466)

2025-04-14 14:16:07 +01:00

glossary.md

Add Korean translation for glossary.md (#38804)

2025-07-07 09:12:55 -07:00

how_to_hack_models.md

🌐 [i18n-KO] Translated how_to_hack_models.md to Korean (#39536)

2025-07-29 08:09:16 -07:00

hpo_train.md

Trainer - deprecate tokenizer for processing_class (#32385)

2024-10-02 14:08:46 +01:00

in_translation.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

index.md

Use HF papers (#38184)

2025-06-13 11:07:09 +00:00

installation.md

docs: HUGGINGFACE_HUB_CACHE -> HF_HUB_CACHE (#34904)

2024-11-26 09:37:18 -08:00

llm_optims.md

[core] Refactor the Cache logic to make it simpler and more general (#39797)

2025-08-08 14:47:21 +02:00

llm_tutorial_optimization.md

Fix bad markdown links (#39819)

2025-07-31 09:14:14 -07:00

llm_tutorial.md

Update Korean tutorial for using LLMs, and refactor the nested conditional statements in hr_argparser.py (#27489)

2023-11-20 17:14:23 +00:00

model_memory_anatomy.md

Use HF papers (#38184)

2025-06-13 11:07:09 +00:00

model_sharing.md

Rename huggingface_cli to hf (#39630)

2025-07-25 14:10:04 +02:00

modular_transformers.md

🌐 [i18n-KO] Translated modular_transformers.md to Korean (#33772)

2024-10-08 18:30:41 -07:00

pad_truncation.md

[Docs] Fix backticks in inline code and documentation links (#28875)

2024-02-06 11:15:44 -08:00

peft.md

Use HF papers (#38184)

2025-06-13 11:07:09 +00:00

perf_hardware.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_infer_cpu.md

🌐 [i18n-KO] Translated perf_infer_cpu.md to Korean (#24920)

2023-07-25 16:04:14 +02:00

perf_infer_gpu_multi.md

🌐 [i18n-KO] Translated perf_infer_gpu_multi.md to Korean (#39441)

2025-07-21 09:14:15 -07:00

perf_infer_gpu_one.md

Use HF papers (#38184)

2025-06-13 11:07:09 +00:00

perf_train_cpu_many.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_train_cpu.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_train_gpu_many.md

Use HF papers (#38184)

2025-06-13 11:07:09 +00:00

perf_train_gpu_one.md

🌐 [i18n-KO] Translated perf_train_gpu_one.md to Korean (#39552)

2025-07-29 08:08:57 -07:00

perf_train_special.md

🌐 [i18n-KO] Translated perf_train_special.md to Korean (#34590)

2024-11-04 09:41:44 -08:00

perplexity.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

philosophy.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

pipeline_gradio.md

🌐 [i18n-KO] Translated pipeline_gradio.md to Korean (#39520)

2025-07-29 08:04:30 -07:00

pipeline_tutorial.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

pipeline_webserver.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

pr_checks.md

[i18n-KO] Translated docs: ko: pr_checks.md to Korean (#24987)

2023-08-17 08:03:17 +02:00

quicktour.md

Fix typos in translated quicktour docs (#35302)

2024-12-17 09:32:00 -08:00

run_scripts.md

Rename huggingface_cli to hf (#39630)

2025-07-25 14:10:04 +02:00

serialization.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

serving.md

🌐 [i18n-KO] Translated gpu_selection.md to Korean (#36757)

2025-05-01 08:44:12 -07:00

testing.md

[tests] remove TF tests (uses of require_tf) (#38944)

2025-06-25 17:29:10 +00:00

tflite.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

tokenizer_summary.md

Use HF papers (#38184)

2025-06-13 11:07:09 +00:00

torchscript.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

trainer.md

Simplify and update trl examples (#38772)

2025-06-13 12:03:49 +00:00

training.md

🚨🚨🚨Deprecate evaluation_strategy to eval_strategy🚨🚨🚨 (#30190)

2024-04-18 12:49:43 -04:00

troubleshooting.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00