[WhisperForCausalLM] Add WhisperForCausalLM for speculative decoding (#27195)

* finish * add tests * fix all tests * [Assistant Decoding] Add test * fix more * better * finish * Apply suggestions from code review Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> * finish --------- Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
2023-11-01 16:01:53 +01:00
parent f9b4bea0a6
commit 391d14e810
10 changed files with 601 additions and 5 deletions
--- a/docs/source/en/model_doc/whisper.md
+++ b/docs/source/en/model_doc/whisper.md
@@ -88,6 +88,11 @@ The original code can be found [here](https://github.com/openai/whisper).
    - forward
    - generate

+## WhisperForCausalLM
+
+[[autodoc]] WhisperForCausalLM
+    - forward
+
 ## WhisperForAudioClassification

 [[autodoc]] WhisperForAudioClassification