SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[docs] fix typo (#36080)

Browse Source 
typo fix
This commit is contained in:
Fanli Lin
2025-02-08 04:42:09 +08:00
committed by GitHub
parent c361b1e3d9
commit 14ca7f1452
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/en/quantization/compressed_tensors.md
View File

@@ -61,7 +61,7 @@ ct_model = AutoModelForCausalLM.from_pretrained("nm-testing/Meta-Llama-3.1-8B-In
# Measure memory usage # Measure memory usage
mem_params = sum([param.nelement()*param.element_size() for param in ct_model.parameters()]) mem_params = sum([param.nelement()*param.element_size() for param in ct_model.parameters()])
print(f"{mem/2**30:.4f} GB") print(f"{mem_params/2**30:.4f} GB")
# 8.4575 GB # 8.4575 GB
``` ```