Add gguf support for gpt2 (#34044)

* add gpt2 gguf support * add doc change * small refactoring
2024-10-10 13:42:18 +02:00
parent 66e08dba71
commit c9afee5392
5 changed files with 95 additions and 2 deletions
--- a/docs/source/en/gguf.md
+++ b/docs/source/en/gguf.md
@@ -83,6 +83,7 @@ For now the supported model architectures are the architectures that have been v
 - Bloom
 - Falcon
 - StableLM
+- GPT2

 ## Example usage