SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Fix quantization docs typo (#22666)

Browse Source
This commit is contained in:
Kirill
2023-04-10 15:53:53 +03:00
committed by GitHub
parent 3876fc6839
commit 14fc1a2467
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/en/main_classes/quantization.mdx
View File

@@ -33,7 +33,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "bigscience/bloom-1b7" model_id = "bigscience/bloom-1b7"
tokenizer = AutoTokenizer.from_pretrained(model_id) tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, device_map == "auto", load_in_8bit=True) model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto", load_in_8bit=True)
``` ```
Then, use your model as you would usually use a [`PreTrainedModel`]. Then, use your model as you would usually use a [`PreTrainedModel`].