HuggingFace_transformer

Files

Yijun Lee e5fd865eba Add Gemma2 GGUF support (#34002 )

* initial setup for ggml.py

* initial setup of GGUFGemma2Converter class

* Add gemma2 model to gguf.md doc

* Partial work on GGUF_TENSOR_MAPPING

* initial setup of GGUF_TENSOR_MAPPING for Gemma2

* refactor: rename GemmaConvert class to GemmaConverter for naming consistency

* feat: complete gemma2 tensor mapping implementation

* feat: add initial implementation of GGUFGemmaConverter

* feat: complete GGUFGemmaConverter implementation

* feat: add test code for gemma2

* refactor: minor code cleanup

* refactor: minor code cleanup

* fix: resolve suggestions

* Update tests/quantization/ggml/test_ggml.py

Co-authored-by: Isotr0py <2037008807@qq.com>

---------

Co-authored-by: Isotr0py <2037008807@qq.com>

2025-01-03 14:50:07 +01:00

aqlm_integration

Skipping aqlm non working inference tests till fix merged (#34865 )

2024-11-26 11:09:30 +01:00

autoawq

Enables CPU AWQ model with IPEX version. (#33460 )

2024-10-04 16:25:10 +02:00

bitnet_integration

Fix : BitNet tests (#34895 )

2024-11-25 16:47:14 +01:00

bnb

Fix new BNB test failures (#35345 )