SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[docs] use device-agnostic API instead of cuda (#34913)

Browse Source 
add device-agnostic API

Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
This commit is contained in:
Fanli Lin
2024-11-27 01:23:34 +08:00
committed by GitHub
parent 64b73e61f8
commit 6bc0c219c1
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
docs/source/en/perplexity.md
View File

@@ -73,8 +73,9 @@ Let's demonstrate this process with GPT-2.
```python ```python
from transformers import GPT2LMHeadModel, GPT2TokenizerFast from transformers import GPT2LMHeadModel, GPT2TokenizerFast
from accelerate.test_utils.testing import get_backend
device = "cuda" device, _, _ = get_backend() # automatically detects the underlying device type (CUDA, CPU, XPU, MPS, etc.)
model_id = "openai-community/gpt2-large" model_id = "openai-community/gpt2-large"
model = GPT2LMHeadModel.from_pretrained(model_id).to(device) model = GPT2LMHeadModel.from_pretrained(model_id).to(device)
tokenizer = GPT2TokenizerFast.from_pretrained(model_id) tokenizer = GPT2TokenizerFast.from_pretrained(model_id)