SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Introduce GradientCheckpointingLayer (#37223)

Browse Source 
* GradientCheckpointingLayer

* trigger

* Move GC layer to a separate file

* Update import

* Expose and document GC layer

* Fix dummy

* Apply to llama-based models

* Update modulars

* Update a few more models for consistency

* Update glm4

* Update Janus
This commit is contained in:
Pavel Iakubovskii
2025-04-22 11:33:31 +01:00
committed by GitHub
parent 413f9bbf80
commit 9167fadab9
35 changed files with 435 additions and 761 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/en/internal/modeling_utils.md
View File

@@ -20,6 +20,10 @@ This page lists all the custom layers used by the library, as well as the utilit
Most of those are only useful if you are studying the code of the models in the library.
## Layers
[[autodoc]] GradientCheckpointingLayer
## Attention Functions
[[autodoc]] AttentionInterface