Raushan Turganbay d583f1317b Quantized KV Cache (#30483) ...

* clean-up

* Update src/transformers/cache_utils.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Update src/transformers/cache_utils.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Update src/transformers/cache_utils.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* fixup

* Update tests/quantization/quanto_integration/test_quanto.py

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Update src/transformers/generation/configuration_utils.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* more suggestions

* mapping if torch available

* run tests & add 'support_quantized' flag

* fix jamba test

* revert, will be fixed by another PR

* codestyle

* HQQ and versatile cache classes

* final update

* typo

* make tests happy

---------

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

2024-05-23 17:25:20 +05:00

..

transformers-all-latest-gpu

Quantized KV Cache (#30483)

2024-05-23 17:25:20 +05:00

transformers-doc-builder

Use python 3.10 for docbuild (#28399)

2024-01-11 14:39:49 +01:00

transformers-gpu

TF: TF 2.10 unpin + related onnx test skips (#18995)

2022-09-12 19:30:27 +01:00

transformers-past-gpu

Byebye pytorch 1.9 (#24080)

2023-06-16 16:38:23 +02:00

transformers-pytorch-amd-gpu

CI: update to ROCm 6.0.2 and test MI300 (#30266)

2024-05-13 18:14:36 +02:00

transformers-pytorch-deepspeed-amd-gpu

Disable AMD memory benchmarks (#29871)

2024-03-26 14:43:12 +01:00

transformers-pytorch-deepspeed-latest-gpu

Pin deepspeed (#30701)

2024-05-07 13:45:24 -04:00

transformers-pytorch-deepspeed-nightly-gpu

Update CUDA versions for DeepSpeed (#27853)

2023-12-05 16:15:21 -05:00

transformers-pytorch-gpu

Use torch 2.3 for CI (#30837)

2024-05-15 19:31:52 +02:00

transformers-pytorch-tpu

Rename master to main for notebooks links and leftovers (#16397)

2022-03-25 09:12:23 -04:00

transformers-quantization-latest-gpu

FIX / Quantization: Fix Dockerfile build (#30890)

2024-05-20 10:08:26 +02:00

transformers-tensorflow-gpu

Use torch 2.3 for CI (#30837)

2024-05-15 19:31:52 +02:00

consistency.dockerfile

Update build ci image [push-ci-image] (#30933)

2024-05-22 10:52:59 +02:00

custom-tokenizers.dockerfile

[CI update] Try to use dockers and no cache (#29202)

2024-05-06 10:10:32 +02:00

examples-tf.dockerfile

[CI update] Try to use dockers and no cache (#29202)

2024-05-06 10:10:32 +02:00

examples-torch.dockerfile

[CI update] Try to use dockers and no cache (#29202)

2024-05-06 10:10:32 +02:00

exotic-models.dockerfile

[CI update] Try to use dockers and no cache (#29202)

2024-05-06 10:10:32 +02:00

jax-light.dockerfile

Update build ci image [push-ci-image] (#30933)

2024-05-22 10:52:59 +02:00

pipeline-tf.dockerfile

Update build ci image [push-ci-image] (#30933)

2024-05-22 10:52:59 +02:00

pipeline-torch.dockerfile

Update build ci image [push-ci-image] (#30933)

2024-05-22 10:52:59 +02:00

quality.dockerfile

Update build ci image [push-ci-image] (#30933)

2024-05-22 10:52:59 +02:00

tf-light.dockerfile

Update build ci image [push-ci-image] (#30933)

2024-05-22 10:52:59 +02:00

torch-jax-light.dockerfile

Update build ci image [push-ci-image] (#30933)

2024-05-22 10:52:59 +02:00

torch-light.dockerfile

Update build ci image [push-ci-image] (#30933)

2024-05-22 10:52:59 +02:00

torch-tf-light.dockerfile

[CI update] Try to use dockers and no cache (#29202)

2024-05-06 10:10:32 +02:00