From bdb84e2bada3658f99c6a81c963ec562f8485151 Mon Sep 17 00:00:00 2001 From: stanleycai95 <46463107+stanleycai95@users.noreply.github.com> Date: Mon, 19 Dec 2022 13:59:34 -0500 Subject: [PATCH] Add model resources for ViT (#20723) * Set up overall resources documentation structure * Update vit.mdx * Removing irrelevant sections on text models * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx * Update vit.mdx --- docs/source/en/model_doc/vit.mdx | 28 ++++++++++++++++++++++++++++ 1 file changed, 28 insertions(+) diff --git a/docs/source/en/model_doc/vit.mdx b/docs/source/en/model_doc/vit.mdx index b71d85082c..de31278dfe 100644 --- a/docs/source/en/model_doc/vit.mdx +++ b/docs/source/en/model_doc/vit.mdx @@ -87,6 +87,34 @@ Note that we converted the weights from Ross Wightman's [timm library](https://g go to him! +## Resources + +A list of official Hugging Face and community (indicated by 🌎) resources to help you get started with ViT. If you're interested in submitting a resource to be included here, please feel free to open a Pull Request and we'll review it! The resource should ideally demonstrate something new instead of duplicating an existing resource. + +`ViTForImageClassification` is supported by: + + +- A blog post on how to [Fine-Tune ViT for Image Classification with Hugging Face Transformers](https://huggingface.co/blog/fine-tune-vit) +- A blog post on [Image Classification with Hugging Face Transformers and `Keras`](https://www.philschmid.de/image-classification-huggingface-transformers-keras) +- A notebook on [Fine-tuning for Image Classification with Hugging Face Transformers](https://github.com/huggingface/notebooks/blob/main/examples/image_classification.ipynb) +- A notebook on how to [Fine-tune the Vision Transformer on CIFAR-10 with the Hugging Face Trainer](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_the_%F0%9F%A4%97_Trainer.ipynb) +- A notebook on how to [Fine-tune the Vision Transformer on CIFAR-10 with PyTorch Lightning](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Fine_tuning_the_Vision_Transformer_on_CIFAR_10_with_PyTorch_Lightning.ipynb) + +⚗️ Optimization + +- A blog post on how to [Accelerate Vision Transformer (ViT) with Quantization using Optimum](https://www.philschmid.de/optimizing-vision-transformer) + +⚡️ Inference + +- A notebook on [Quick demo: Vision Transformer (ViT) by Google Brain](https://github.com/NielsRogge/Transformers-Tutorials/blob/master/VisionTransformer/Quick_demo_of_HuggingFace_version_of_Vision_Transformer_inference.ipynb) + +🚀 Deploy + +- A blog post on [Deploying Tensorflow Vision Models in Hugging Face with TF Serving](https://huggingface.co/blog/tf-serving-vision) +- A blog post on [Deploying Hugging Face ViT on Vertex AI](https://huggingface.co/blog/deploy-vertex-ai) +- A blog post on [Deploying Hugging Face ViT on Kubernetes with TF Serving](https://huggingface.co/blog/deploy-tfserving-kubernetes) + + ## ViTConfig [[autodoc]] ViTConfig