SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Fix small typo in flan-ul2.mdx (#22068)

Browse Source 
* Update flan-ul2.mdx

* Update flan-ul2.mdx
This commit is contained in:
Kevin Jiang
2023-03-10 07:44:45 -05:00
committed by GitHub
parent a3fef89b26
commit ade26bf991
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/en/model_doc/flan-ul2.mdx
View File

@@ -31,7 +31,7 @@ One can refer to [T5's documentation page](t5) for all tips, code examples and n
The original checkpoints can be found [here](https://github.com/google-research/t5x/blob/main/docs/models.md#flan-ul2-checkpoints). The original checkpoints can be found [here](https://github.com/google-research/t5x/blob/main/docs/models.md#flan-ul2-checkpoints).
## Running on low ressources devices ## Running on low resource devices
The model is pretty heavy (~40GB in half precision) so if you just want to run the model, make sure you load your model in 8bit, and use `device_map="auto"` to make sure you don't have any OOM issue! The model is pretty heavy (~40GB in half precision) so if you just want to run the model, make sure you load your model in 8bit, and use `device_map="auto"` to make sure you don't have any OOM issue!
@@ -49,4 +49,4 @@ The model is pretty heavy (~40GB in half precision) so if you just want to run t
## Inference ## Inference
The inference protocol is exaclty the same as any `T5` model, please have a look at the [T5's documentation page](t5) for more details. The inference protocol is exaclty the same as any `T5` model, please have a look at the [T5's documentation page](t5) for more details.