From fa0ae17958fd9693a713715062c48bf1caeb6193 Mon Sep 17 00:00:00 2001 From: Younes Belkada <49240599+younesbelkada@users.noreply.github.com> Date: Tue, 7 Feb 2023 15:09:27 +0100 Subject: [PATCH] [`Doc`] Fix int8 docs (#21487) fix int8 docs --- docs/source/en/perf_infer_gpu_one.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/en/perf_infer_gpu_one.mdx b/docs/source/en/perf_infer_gpu_one.mdx index 1f447462f8..55b3b9fd99 100644 --- a/docs/source/en/perf_infer_gpu_one.mdx +++ b/docs/source/en/perf_infer_gpu_one.mdx @@ -40,7 +40,7 @@ Below are some notes to help you use this module, or follow the demos on [Google ### Requirements -- Make sure you run on NVIDIA GPUs that support 8-bit tensor cores (Turing, Ampere or newer architectures - e.g. T4, RTX20s RTX30s, A40-A100). +- If you have `bitsandbytes<0.37.0`, make sure you run on NVIDIA GPUs that support 8-bit tensor cores (Turing, Ampere or newer architectures - e.g. T4, RTX20s RTX30s, A40-A100). For `bitsandbytes>=0.37.0`, all GPUs should be supported. - Install the correct version of `bitsandbytes` by running: `pip install bitsandbytes>=0.31.5` - Install `accelerate`