Add T5 GGUF loading support (#33389)

* add: GGUFT5Converter * add: tensormapping for t5 * add: test code for t5 * fix: Remove whitespace from blank line * add: t5 fp16 tests * fix: whitespace formatting * fix: minor formatting * fix: testing every weights
2024-10-24 22:10:59 +09:00
parent 30c76d5b28
commit dd267fca72
5 changed files with 197 additions and 7 deletions
--- a/docs/source/en/gguf.md
+++ b/docs/source/en/gguf.md
@@ -85,6 +85,7 @@ For now the supported model architectures are the architectures that have been v
 - StableLM
 - GPT2
 - Starcoder2
+- T5

 ## Example usage