mobicham 59952994c4 Add HQQ quantization support (#29637) ...

* update HQQ transformers integration

* push import_utils.py

* add force_hooks check in modeling_utils.py

* fix | with Optional

* force bias as param

* check bias is Tensor

* force forward for multi-gpu

* review fixes pass

* remove torch grad()

* if any key in linear_tags fix

* add cpu/disk check

* isinstance return

* add multigpu test + refactor tests

* clean hqq_utils imports in hqq.py

* clean hqq_utils imports in quantizer_hqq.py

* delete hqq_utils.py

* Delete src/transformers/utils/hqq_utils.py

* ruff init

* remove torch.float16 from __init__ in test

* refactor test

* isinstance -> type in quantizer_hqq.py

* cpu/disk device_map check in quantizer_hqq.py

* remove type(module) nn.linear check in quantizer_hqq.py

* add BaseQuantizeConfig import inside HqqConfig init

* remove hqq import in hqq.py

* remove accelerate import from test_hqq.py

* quant config.py doc update

* add hqqconfig to main_classes doc

* make style

* __init__ fix

* ruff __init__

* skip_modules list

* hqqconfig format fix

* hqqconfig doc fix

* hqqconfig doc fix

* hqqconfig doc fix

* hqqconfig doc fix

* hqqconfig doc fix

* hqqconfig doc fix

* hqqconfig doc fix

* hqqconfig doc fix

* hqqconfig doc fix

* test_hqq.py remove mistral comment

* remove self.using_multi_gpu is False

* torch_dtype default val set and logger.info

* hqq.py isinstance fix

* remove torch=None

* torch_device test_hqq

* rename test_hqq

* MODEL_ID in test_hqq

* quantizer_hqq setattr fix

* quantizer_hqq typo fix

* imports quantizer_hqq.py

* isinstance quantizer_hqq

* hqq_layer.bias reformat quantizer_hqq

* Step 2 as comment in quantizer_hqq

* prepare_for_hqq_linear() comment

* keep_in_fp32_modules fix

* HqqHfQuantizer reformat

* quantization.md hqqconfig

* quantization.md model example reformat

* quantization.md # space

* quantization.md space   })

* quantization.md space   })

* quantization_config fix doc

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* axis value check in quantization_config

* format

* dynamic config explanation

* quant config method in quantization.md

* remove shard-level progress

* .cuda fix modeling_utils

* test_hqq fixes

* make fix-copies

---------

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

2024-05-02 17:51:49 +01:00

..

internal

Docs: add missing StoppingCriteria autodocs (#30617)

2024-05-02 15:20:04 +01:00

main_classes

Add HQQ quantization support (#29637)

2024-05-02 17:51:49 +01:00

model_doc

phi3 chat_template does not support system role (#30606)

2024-05-02 15:30:21 +02:00

tasks

Docs: fix generate-related rendering issues (#30600)

2024-05-02 14:42:25 +01:00

_config.py

[#29174] ImportError Fix: Trainer with PyTorch requires accelerate>=0.20.1 Fix (#29888)

2024-04-08 14:21:16 +01:00

_redirects.yml

Extended semantic segmentation to image segmentation (#27039)

2023-11-23 15:58:21 +00:00

_toctree.yml

Add sidebar tutorial for chat models (#30401)

2024-04-25 19:38:48 +01:00

accelerate.md

Fix typos (#25936)

2023-09-04 11:15:12 +01:00

add_new_model.md

Remove add-new-model in favor of add-new-model-like (#30424)

2024-04-24 09:38:18 +02:00

add_new_pipeline.md

add push_to_hub to pipeline (#29172)

2024-04-16 15:34:04 +01:00

attention.md

[Docs] Fix broken links and syntax issues (#28918)

2024-02-08 14:13:35 -08:00

autoclass_tutorial.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

benchmarks.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

bertology.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

big_models.md

[docs] Big model loading (#29920)

2024-04-01 18:47:32 -07:00

chat_templating.md

Deprecate default chat templates (#30346)

2024-04-19 15:41:26 +01:00

community.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

contributing.md

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

conversations.md

Add sidebar tutorial for chat models (#30401)

2024-04-25 19:38:48 +01:00

create_a_model.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

custom_models.md

[Docs] Add language identifiers to fenced code blocks (#28955)

2024-02-12 10:48:31 -08:00

custom_tools.md

[docs] Remove redundant - and the from custom_tools.md (#29767)

2024-03-21 10:56:40 +00:00

debugging.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

deepspeed.md

Rename torch.run to torchrun (#30405)

2024-04-23 09:04:17 -07:00

fast_tokenizers.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

fsdp.md

[docs] Trainer docs (#28145)

2023-12-20 10:37:23 -08:00

generation_strategies.md

Docs: fix generate-related rendering issues (#30600)

2024-05-02 14:42:25 +01:00

glossary.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

hf_quantizer.md

[CI] Quantization workflow (#29046)

2024-02-28 10:09:25 -05:00

hpo_train.md

Remove-auth-token (#27060)

2023-11-13 14:20:54 +01:00

index.md

Phi-3 (#30423)

2024-04-24 17:32:09 +02:00

installation.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

llm_optims.md

Cache: Static cache as a standalone object (#30476)

2024-04-30 16:37:19 +01:00

llm_tutorial_optimization.md

F.scaled_dot_product_attention support (#26572)

2023-12-09 05:38:14 +09:00

llm_tutorial.md

Generate: update links on LLM tutorial doc (#30550)

2024-04-30 18:14:12 +01:00

model_memory_anatomy.md

🚨🚨🚨Deprecate evaluation_strategy to eval_strategy🚨🚨🚨 (#30190)

2024-04-18 12:49:43 -04:00

model_sharing.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

model_summary.md

model_summary.md - Restore link to Harvard's Annotated Transformer. (#29702)

2024-03-23 18:29:39 -07:00

multilingual.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

notebooks.md

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

pad_truncation.md

[Doc] Spanish translation of pad_truncation.md (#27890)

2023-12-08 10:32:18 -08:00

peft.md

[Peft] modules_to_save support for peft integration (#27466)

2023-11-14 10:32:57 +01:00

perf_hardware.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_infer_cpu.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

perf_infer_gpu_one.md

Fix GroundingDINO, DPR after BERT SDPA update (#30506)

2024-04-26 18:04:41 +01:00

perf_torch_compile.md

Fix rendering for torch.compile() docs (#25432)

2023-08-10 13:25:00 +02:00

perf_train_cpu_many.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_train_cpu.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_train_gpu_many.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_train_gpu_one.md

Fix minor typo: softare => software (#29602)

2024-03-12 10:39:56 +00:00

perf_train_special.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

perf_train_tpu_tf.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

performance.md

[docs] Update CPU/GPU inference docs (#26881)

2023-10-31 09:44:51 -07:00

perplexity.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

philosophy.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

pipeline_tutorial.md

More fixes for doctest (#30265)

2024-04-16 11:58:55 +02:00

pipeline_webserver.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

pr_checks.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

preprocessing.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

quantization.md

Add HQQ quantization support (#29637)

2024-05-02 17:51:49 +01:00

quicktour.md

Add HQQ quantization support (#29637)

2024-05-02 17:51:49 +01:00

run_scripts.md

Fix broken link to Transformers notebooks (#30512)

2024-04-29 10:57:51 +01:00

sagemaker.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

serialization.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

task_summary.md

More fixes for doctest (#30265)

2024-04-16 11:58:55 +02:00

tasks_explained.md

[docs] Spanish translation of tasks_explained.md (#29224)

2024-02-26 08:18:15 -08:00

testing.md

[doc] fix some typos and add xpu to the testing documentation (#29894)

2024-03-28 09:42:49 +00:00

tf_xla.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

tflite.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

tokenizer_summary.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

torchscript.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

trainer.md

🚨🚨🚨Deprecate evaluation_strategy to eval_strategy🚨🚨🚨 (#30190)

2024-04-18 12:49:43 -04:00

training.md

🚨🚨🚨Deprecate evaluation_strategy to eval_strategy🚨🚨🚨 (#30190)

2024-04-18 12:49:43 -04:00

transformers_agents.md

[doc] Always call it Agents for consistency (#25958)

2023-09-05 12:27:20 +01:00

troubleshooting.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00