SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Fix code repetition in serialization guide (#16346)

Browse Source
This commit is contained in:
Omar Sanseviero
2022-03-22 21:57:19 +01:00
committed by GitHub
parent 4f6c938342
commit 62cbd8423b
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/serialization.mdx
View File

@@ -169,7 +169,7 @@ checkpoint as follows:
>>> from transformers import AutoTokenizer, AutoModelForSequenceClassification >>> from transformers import AutoTokenizer, AutoModelForSequenceClassification
>>> # Load tokenizer and PyTorch weights form the Hub >>> # Load tokenizer and PyTorch weights form the Hub
>>> tokenizer = tokenizer = AutoTokenizer.from_pretrained("distilbert-base-uncased") >>> tokenizer = AutoTokenizer.from_pretrained("distilbert-base-uncased")
>>> pt_model = AutoModelForSequenceClassification.from_pretrained("distilbert-base-uncased") >>> pt_model = AutoModelForSequenceClassification.from_pretrained("distilbert-base-uncased")
>>> # Save to disk >>> # Save to disk
>>> tokenizer.save_pretrained("local-pt-checkpoint") >>> tokenizer.save_pretrained("local-pt-checkpoint")
@@ -188,7 +188,7 @@ python -m transformers.onnx --model=local-pt-checkpoint onnx/
>>> from transformers import AutoTokenizer, TFAutoModelForSequenceClassification >>> from transformers import AutoTokenizer, TFAutoModelForSequenceClassification
>>> # Load tokenizer and TensorFlow weights from the Hub >>> # Load tokenizer and TensorFlow weights from the Hub
>>> tokenizer = tokenizer = AutoTokenizer.from_pretrained("distilbert-base-uncased") >>> tokenizer = AutoTokenizer.from_pretrained("distilbert-base-uncased")
>>> tf_model = TFAutoModelForSequenceClassification.from_pretrained("distilbert-base-uncased") >>> tf_model = TFAutoModelForSequenceClassification.from_pretrained("distilbert-base-uncased")
>>> # Save to disk >>> # Save to disk
>>> tokenizer.save_pretrained("local-tf-checkpoint") >>> tokenizer.save_pretrained("local-tf-checkpoint")