Yih-Dar 8f2cc1c3ab Add TFCLIPModel (#13967) ...

* Start the work for TFCLIPModel

* Convert to TF code (TODO: loss + doc)

* Clean up

* Fix pooled_output for TFCLIPTextTransformer - using tf.gather_nd

* assert -> raise error

* Expose TFCLIPModel

* Deal with dummy_inputs

* Add tests

* Fix all tests. TODO: manual check weight loading + add more comments

* Fix pt tf equivalence test

* fixes

* update TFCLIPVisionEmbeddings's Conv2D

* Fix loss + overwrite test_pt_tf_model_equivalence from common

* Add a comment about the change about MainLayer in test_keras_save_load

* Set return_loss=True in TFCLIPModelTester + make tests pass

* overwrite test_pt_tf_model_equivalence from tf common

* fix base_model_prefix

* Fix examples

* remove unused

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* apply review suggestions

* change self.pre_layrnorm to self.pre_layernorm

* apply more review suggestions

* return attention probs before dropout (to align with PT)

* fix weight init

* fix

* build doc

* fix missing doc

* fix for test

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

2021-12-23 11:19:44 -05:00

..

internal

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

main_classes

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

model_doc

Add TFCLIPModel (#13967)

2021-12-23 11:19:44 -05:00

_config.py

Prevent style_doc from tempering the config file

2021-12-10 15:31:43 -05:00

_toctree.yml

Feature/fix slow test in mluke (#14749)

2021-12-22 06:35:59 -05:00

add_new_model.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

add_new_pipeline.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

benchmarks.mdx

Fix dead link to benchmarks.ipynb (#14842)

2021-12-20 09:08:05 -05:00

bertology.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

community.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

custom_datasets.mdx

Put back open in colab markers (#14684)

2021-12-09 12:00:06 -05:00

debugging.mdx

[doc porting] several docs (#14858)

2021-12-21 09:55:25 -08:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

fast_tokenizers.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

glossary.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

index.mdx

Add TFCLIPModel (#13967)

2021-12-23 11:19:44 -05:00

installation.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

migration.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

model_sharing.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

model_summary.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

multilingual.mdx

Put back open in colab markers (#14684)

2021-12-09 12:00:06 -05:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

parallelism.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

performance.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

perplexity.mdx

Removes images to put them in a dataset (#14781)

2021-12-16 04:42:02 -05:00

philosophy.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

pr_checks.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

preprocessing.mdx

Put back open in colab markers (#14684)

2021-12-09 12:00:06 -05:00

quicktour.mdx

Swap TF and PT code inside two blocks (#14742)

2021-12-13 10:31:11 -05:00

sagemaker.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

serialization.mdx

Add ONNX support for MarianMT models (#14586)

2021-12-23 13:35:56 +01:00

task_summary.mdx

Put back open in colab markers (#14684)

2021-12-09 12:00:06 -05:00

testing.mdx

[doc porting] several docs (#14858)

2021-12-21 09:55:25 -08:00

tokenizer_summary.mdx

Put back open in colab markers (#14684)

2021-12-09 12:00:06 -05:00

training.mdx

Put back open in colab markers (#14684)

2021-12-09 12:00:06 -05:00

troubleshooting.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00