Automatic compilation in generate: do not rely on inner function (#34923)

* compiled forward in PreTrainedModel * update * style * update name * trigger CIs * Add way to use custom compile args * style * switch parameterization to generation_config * Add to inits * Update configuration_utils.py * inits * style * docs * style * Update configuration_utils.py * back without dataclass for repo consistency * Update configuration_utils.py * style * style * style once again * add config serialization * update * true dataclass * trigger CIs * merge compile methods + remove serialization of compile config
2024-12-03 11:20:31 +01:00
parent f9c7e6021e
commit ee37bf0d95
6 changed files with 99 additions and 12 deletions
--- a/docs/source/en/internal/generation_utils.md
+++ b/docs/source/en/internal/generation_utils.md
@@ -436,3 +436,9 @@ A [`Constraint`] can be used to force the generation to include specific tokens

 [[autodoc]] SynthIDTextWatermarkDetector
    - __call__
+
+## Compile Utils
+
+[[autodoc]] CompileConfig
+    - __call__
+