SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Save the tokenizer and image preprocessor after training a model with the contrastive image-text example (#23035)

Browse Source 
Save tokenizer and image preprocessor
This commit is contained in:
regisss
2023-05-02 15:23:16 +02:00
committed by GitHub
parent 85e3d7b6a0
commit bcedd0a471
1 changed files with 2 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/pytorch/contrastive-image-text/run_clip.py
View File

@@ -510,6 +510,8 @@ def main():
checkpoint = last_checkpoint checkpoint = last_checkpoint
train_result = trainer.train(resume_from_checkpoint=checkpoint) train_result = trainer.train(resume_from_checkpoint=checkpoint)
trainer.save_model() trainer.save_model()
tokenizer.save_pretrained(training_args.output_dir)
image_processor.save_pretrained(training_args.output_dir)
trainer.log_metrics("train", train_result.metrics) trainer.log_metrics("train", train_result.metrics)
trainer.save_metrics("train", train_result.metrics) trainer.save_metrics("train", train_result.metrics)
trainer.save_state() trainer.save_state()