SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[docs] fixed links with 404 (#27327)

Browse Source 
* fixed links with 404

* make style
This commit is contained in:
Maria Khalusova
2023-11-06 14:45:03 -05:00
committed by GitHub
parent 1b20e2bb42
commit 9beb2737d7
44 changed files with 88 additions and 77 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/en/main_classes/quantization.md
View File

@@ -95,7 +95,7 @@ The benchmark was run on a NVIDIA-A100 instance and the model used was [`TheBlok
<img src="https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/quantization/forward_latency_plot.png">
</div>
You can find the full results together with packages versions in [this link](https://github.com/huggingface/optimum-benchmark/tree/main/examples/running-mistral).
You can find the full results together with packages versions in [this link](https://github.com/huggingface/optimum-benchmark/tree/main/examples/running-mistrals).
From the results it appears that AWQ quantization method is the fastest quantization method for inference, text generation and among the lowest peak memory for text generation. However, AWQ seems to have the largest forward latency per batch size.