HuggingFace_transformer

Files

jiqing-feng b916efcb3c Enables CPU AWQ model with IPEX version. (#33460 )

* enable cpu awq ipex linear

* add doc for cpu awq with ipex kernel

* add tests for cpu awq

* fix code style

* fix doc and tests

* Update docs/source/en/quantization/awq.md

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* Update tests/quantization/autoawq/test_awq.py

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* fix comments

* fix log

* fix log

* fix style

---------

Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

2024-10-04 16:25:10 +02:00

aqlm_integration

Cache: use batch_size instead of max_batch_size (#32657 )

2024-08-16 11:48:45 +01:00

autoawq

Enables CPU AWQ model with IPEX version. (#33460 )

2024-10-04 16:25:10 +02:00

bnb

Enable BNB multi-backend support (#31098 )

2024-09-24 03:40:56 -06:00

compressed_tensor

HFQuantizer implementation for compressed-tensors library (#31704 )