Alara Dirik 12d66b4701 Add OWL-ViT model for zero-shot object detection (#17938) ...

* add owlvit model skeleton

* add class and box predictor heads

* convert modified flax clip to pytorch

* fix box and class predictors

* add OwlViTImageTextEmbedder

* convert class and box head checkpoints

* convert image text embedder checkpoints

* add object detection head

* fix bugs

* update conversion script

* update conversion script

* fix q,v,k,out weight conversion conversion

* add owlvit object detection output

* fix bug in image embedder

* fix bugs in text embedder

* fix positional embeddings

* fix bug in inference mode vision pooling

* update docs, init tokenizer and processor files

* support batch processing

* add OwlViTProcessor

* remove merge conflicts

* readd owlvit imports

* fix bug in OwlViTProcessor imports

* fix bugs in processor

* update docs

* fix bugs in processor

* update owlvit docs

* add OwlViTFeatureExtractor

* style changes, add postprocess method to feature extractor

* add feature extractor and processor tests

* add object detection tests

* update conversion script

* update config paths

* update config paths

* fix configuration paths and bugs

* fix bugs in OwlViT tests

* add import checks to processor

* fix docs and minor issues

* fix docs and minor issues

* fix bugs and issues

* fix bugs and issues

* fix bugs and issues

* fix bugs and issues

* update docs and examples

* fix bugs and issues

* update conversion script, fix positional embeddings

* process 2D input ids, update tests

* fix style and quality issues

* update docs

* update docs and imports

* update OWL-ViT index.md

* fix bug in OwlViT feature ext tests

* fix code examples, return_dict by default

* return_dict by default

* minor fixes, add tests to processor

* small fixes

* add output_attentions arg to main model

* fix bugs

* remove output_hidden_states arg from main model

* update self.config variables

* add option to return last_hidden_states

* fix bug in config variables

* fix copied from statements

* fix small issues and bugs

* fix bugs

* fix bugs, support greyscale images

* run fixup

* update repo name

* merge OwlViTImageTextEmbedder with obj detection head

* fix merge conflict

* fix merge conflict

* make fixup

* fix bugs

* fix bugs

* add additional processor test

2022-07-22 13:35:32 +03:00

..

internal

Allow from transformers import TypicalLogitsWarper (#17477)

2022-06-03 11:08:35 +02:00

main_classes

Add Visual Question Answering (VQA) pipeline (#17286)

2022-06-13 07:49:44 -04:00

model_doc

Add OWL-ViT model for zero-shot object detection (#17938)

2022-07-22 13:35:32 +03:00

tasks

Doc to dataset (#18037)

2022-07-06 12:10:06 -04:00

_config.py

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

_toctree.yml

Add OWL-ViT model for zero-shot object detection (#17938)

2022-07-22 13:35:32 +03:00

accelerate.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

add_new_model.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

add_new_pipeline.mdx

Update add_new_pipeline.mdx (#18224)

2022-07-21 07:55:30 +02:00

autoclass_tutorial.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

benchmarks.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

bertology.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

big_models.mdx

Add link to existing documentation (#17931)

2022-07-04 04:13:05 -04:00

community.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

contributing.md

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

converting_tensorflow_models.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

create_a_model.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

custom_models.mdx

Fix some typos. (#17560)

2022-07-11 05:00:13 -04:00

debugging.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

fast_tokenizers.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

glossary.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

index.mdx

Add OWL-ViT model for zero-shot object detection (#17938)

2022-07-22 13:35:32 +03:00

installation.mdx

Added Command for windows VENV activation in installation docs (#18008)

2022-07-07 08:18:44 -04:00

migration.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

model_sharing.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

model_summary.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

multilingual.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

notebooks.md

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

pad_truncation.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

perf_hardware.mdx

[WIP] [doc] performance/scalability revamp (#15723)

2022-05-16 13:36:41 +02:00

perf_infer_cpu.mdx

Extend Transformers Trainer Class to Enable PyTorch Torchscript for Inference (#17153)

2022-06-14 07:56:47 -04:00

perf_infer_gpu_many.mdx

Improve performance docs (#17750)

2022-06-23 14:51:54 +02:00

perf_infer_gpu_one.mdx

Improve performance docs (#17750)

2022-06-23 14:51:54 +02:00

perf_infer_special.mdx

Improve performance docs (#17750)

2022-06-23 14:51:54 +02:00

perf_train_cpu.mdx

Extend Transformers Trainer Class to Enable CPU AMP and Integrate Intel Extension for PyTorch (#17138)

2022-06-08 09:41:57 -04:00

perf_train_gpu_many.mdx

Improve performance docs (#17750)

2022-06-23 14:51:54 +02:00

perf_train_gpu_one.mdx

Enable torchdynamo with torch_tensorrt(fx path) (#17765)

2022-07-13 12:43:28 -04:00

perf_train_special.mdx

Improve performance docs (#17750)

2022-06-23 14:51:54 +02:00

perf_train_tpu.mdx

Improve performance docs (#17750)

2022-06-23 14:51:54 +02:00

performance.mdx

Improve performance docs (#17750)

2022-06-23 14:51:54 +02:00

perplexity.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

philosophy.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

pipeline_tutorial.mdx

docs(transformers): fix typo (#17263)

2022-05-16 17:04:30 -04:00

pr_checks.mdx

Add a check on config classes docstring checkpoints (#17012)

2022-04-30 10:40:46 +02:00

preprocessing.mdx

Doc to dataset (#18037)

2022-07-06 12:10:06 -04:00

quicktour.mdx

Add custom config to quicktour (#18115)

2022-07-20 12:23:03 -05:00

run_scripts.mdx

Fix all docs for accelerate install directions (#17145)

2022-05-09 15:45:18 -04:00

sagemaker.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

serialization.mdx

add ONNX support for LeVit (#18154)

2022-07-18 15:17:07 +02:00

task_summary.mdx

[Doctests] Correct task summary (#16644)

2022-04-11 14:59:35 +02:00

testing.mdx

Fix some typos. (#17560)

2022-07-11 05:00:13 -04:00

tokenizer_summary.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00

training.mdx

Doc to dataset (#18037)

2022-07-06 12:10:06 -04:00

troubleshooting.mdx

Enable doc in Spanish (#16518)

2022-04-04 10:25:46 -04:00