Files
HuggingFace_transformer/docs/source/en/quantization
Jerry Zhang 2af272c101 Add autoquant support for torchao quantizer (#35503)
* Add autoquant support for torchao quantizer

Summary:
att, also verified that autoquantized model can be saved and loaded:

save: https://gist.github.com/jerryzh168/01d367aaf44dbbbfd4068a4a10a00061
load: https://gist.github.com/jerryzh168/d5c6c401b2abdf18e0b6771341f1525c

Test Plan:
tested locally with above script
model uploaded to https://huggingface.co/jerryzh168/llama3-8b-autoquant

Reviewers:

Subscribers:

Tasks:

Tags:

* add test

* ruff fix

* ruff reformat

* add docs and min_sqnr support

* format

* format

* fix test

* update doc

* format

* remove disable_compile

* format
2025-02-24 15:54:16 +01:00
..
2025-02-11 10:35:28 -08:00
2025-02-07 12:42:09 -08:00
2025-02-13 15:29:59 +01:00
2025-01-15 14:22:49 +01:00
2024-12-23 16:54:49 +01:00
2024-09-30 14:47:18 +02:00