Add GGUF for starcoder2 (#34094)

* add starcoder2 arch support for gguf * fix q6 test
2024-10-14 10:22:49 +02:00
parent 4c439173df
commit cb5ca3265f
3 changed files with 69 additions and 0 deletions
--- a/docs/source/en/gguf.md
+++ b/docs/source/en/gguf.md
@@ -84,6 +84,7 @@ For now the supported model architectures are the architectures that have been v
 - Falcon
 - StableLM
 - GPT2
+- Starcoder2

 ## Example usage