Isotr0py edeca4387c 🚨 Support dequantization for most GGML types (#32625) ...

* use gguf internal dequantize

* add Q5_0 test

* add iq1 test

* add remained test

* remove duplicated test

* update docs

* add gguf version limit

* make style

* update gguf import catch

* revert vocab_size patch

* make style

* use GGUF_MIN_VERSION everywhere

2024-09-03 12:58:14 +02:00

19 KiB

Raw Blame History

View Raw