Younes Belkada 266c67b06a [Mixtral / Awq] Add mixtral fused modules for Awq (#28240) ...

* add mixtral fused modules

* add changes from modeling utils

* add test

* fix test + rope theta issue

* Update src/transformers/modeling_utils.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* add tests

---------

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

2024-01-12 14:29:35 +01:00

..

autoawq

[Mixtral / Awq] Add mixtral fused modules for Awq (#28240)

2024-01-12 14:29:35 +01:00

bnb

[bnb] Let's make serialization of 4bit models possible (#26037)

2023-12-21 11:54:44 +01:00

gptq

Add exllamav2 better (#27111)

2023-11-01 13:09:21 -04:00