From c19aa7accef713d0df95cc2d02156b43d461aa89 Mon Sep 17 00:00:00 2001 From: Ambuj Pawar Date: Tue, 15 Nov 2022 19:26:46 +0100 Subject: [PATCH] Add clip resources to the transformers documentation (#20190) * WIP: Added CLIP resources from HuggingFace blog * ADD: Notebooks documentation to clip * Add link straight to notebook Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> * Change notebook links to colab Co-authored-by: Ambuj Pawar Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> --- docs/source/en/model_doc/clip.mdx | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/docs/source/en/model_doc/clip.mdx b/docs/source/en/model_doc/clip.mdx index 5c56bf637d..943a0f7f5a 100644 --- a/docs/source/en/model_doc/clip.mdx +++ b/docs/source/en/model_doc/clip.mdx @@ -75,6 +75,25 @@ encode the text and prepare the images. The following example shows how to get t This model was contributed by [valhalla](https://huggingface.co/valhalla). The original code can be found [here](https://github.com/openai/CLIP). +## Resources + +A list of official Hugging Face and community (indicated by 🌎) resources to help you get started with CLIP. If you're +interested in submitting a resource to be included here, please feel free to open a Pull Request and we will review it. +The resource should ideally demonstrate something new instead of duplicating an existing resource. + + +- A blog post on [How to use CLIP to retrieve images from text](https://huggingface.co/blog/fine-tune-clip-rsicd). +- A blog bost on [How to use CLIP for Japanese text to image generation](https://huggingface.co/blog/japanese-stable-diffusion). + + + +- A notebook showing [Video to text matching with CLIP for videos](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/X-CLIP/Video_text_matching_with_X_CLIP.ipynb). + + + +- A notebook showing [Zero shot video classification using CLIP for video](https://colab.research.google.com/github/NielsRogge/Transformers-Tutorials/blob/master/X-CLIP/Zero_shot_classify_a_YouTube_video_with_X_CLIP.ipynb). + + ## CLIPConfig [[autodoc]] CLIPConfig