Allow easy registration of custom attention functions (#36889)

* Update modeling_utils.py * style * Update modeling_utils.py * Update modeling_utils.py * Update modeling_utils.py * Update modeling_utils.py * Update modeling_utils.py * Update modeling_utils.py * add to init * Update modeling_utils.py * style * update * Update modeling_utils.py * Update modeling_utils.py * style * Add some doc * Update _toctree.yml * readd it for tgi/vllm compat * CIs * CIs
2025-03-26 16:15:06 +01:00
parent ad5d40de9c
commit 788e1092e9
6 changed files with 171 additions and 11 deletions
--- a/docs/source/en/internal/modeling_utils.md
+++ b/docs/source/en/internal/modeling_utils.md
@@ -16,10 +16,14 @@ rendered properly in your Markdown viewer.

 # Custom Layers and Utilities

-This page lists all the custom layers used by the library, as well as the utility functions it provides for modeling.
+This page lists all the custom layers used by the library, as well as the utility functions and classes it provides for modeling.

 Most of those are only useful if you are studying the code of the models in the library.

+## Attention Functions
+
+[[autodoc]] AttentionInterface
+    - register

 ## Pytorch custom modules