HuggingFace_transformer

Files

Jerry Zhang 2af272c101 Add autoquant support for torchao quantizer (#35503 )

* Add autoquant support for torchao quantizer

Summary:
att, also verified that autoquantized model can be saved and loaded:

save: https://gist.github.com/jerryzh168/01d367aaf44dbbbfd4068a4a10a00061
load: https://gist.github.com/jerryzh168/d5c6c401b2abdf18e0b6771341f1525c

Test Plan:
tested locally with above script
model uploaded to https://huggingface.co/jerryzh168/llama3-8b-autoquant

Reviewers:

Subscribers:

Tasks:

Tags:

* add test

* ruff fix

* ruff reformat

* add docs and min_sqnr support

* format

* format

* fix test

* update doc

* format

* remove disable_compile

* format

2025-02-24 15:54:16 +01:00

aqlm.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350 )

2024-09-09 10:47:24 +02:00

awq.md

[docs] update awq doc (#36079 )

2025-02-11 10:35:28 -08:00

bitnet.md

FEAT : Adding BitNet quantization method to HFQuantizer (#33410 )

2024-10-09 17:51:41 +02:00

bitsandbytes.md

[docs] fix bugs in the bitsandbytes documentation (#35868 )