Sayak Paul 2d9853b226 MSN (Masked Siamese Networks) for ViT (#18815) ...

* feat: modeling and conversion scripts for msn.

* chore: change license year.

* chore: remove unneeded modules.

* feat: direct loading of state_dict from remote url.

* fix: import paths.

* add: rest of the files.

* add and fix rest of the files.

Co-authored-by: Niels <niels.rogge1@gmail.com>

* chore: formatting.

* code quality fix.

* chore: remove pooler.

* feat: add classification top.

* fix: configuration object.

* add: initial test cases (one failing).

* fix: basemodeloutput.

* add: caution on using the classification head.

* add: rest of the model related files.

* add: vit msn readme.

* fix: copied from statement.

* fix: dummy objects.

* add: ViTMSNPreTrainedModel to inits.

* fix: repo consistency.

* minor change in the model doc.

* fix: tests.

* Empty-Commit

* Update src/transformers/models/vit_msn/configuration_vit_msn.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* address PR comments.

* Update src/transformers/models/vit_msn/modeling_vit_msn.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* chore: put model in no_grad() and formatting.

Co-authored-by: Niels <niels.rogge1@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

2022-09-22 07:15:03 -04:00

..

benchmark

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

deepspeed

deprecate is_torch_bf16_available (#17738)

2022-06-20 08:40:11 -04:00

extended

Update self-push workflow (#17177)

2022-05-13 16:28:00 +02:00

fixtures

add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629)

2022-04-11 11:06:10 +02:00

generation

🚨🚨🚨 Optimize Top P Sampler and fix edge case (#18984)

2022-09-15 15:50:11 +02:00

mixed_int8

[bnb] Minor modifications (#18631)

2022-08-17 00:48:10 +02:00

models

MSN (Masked Siamese Networks) for ViT (#18815)

2022-09-22 07:15:03 -04:00

onnx

Add SegFormer ONNX support (#18006)

2022-08-31 20:58:44 +02:00

optimization

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

pipelines

Change document question answering pipeline to always return an array (#19071)

2022-09-20 15:17:57 +02:00

repo_utils

Add some tests for check_dummies (#19146)

2022-09-21 14:54:09 -04:00

sagemaker

transformers-cli login => huggingface-cli login (#18490)

2022-08-06 09:42:55 +02:00

tokenization

fix train_new_from_iterator in the case of byte-level tokenizers (#17549)

2022-06-08 15:30:41 +02:00

trainer

Run torchdynamo tests (#19056)

2022-09-15 11:10:16 -07:00

utils

Add some tests for check_dummies (#19146)

2022-09-21 14:54:09 -04:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_configuration_common.py

Add tests for legacy load by url and fix bugs (#19078)

2022-09-16 23:20:02 +02:00

test_feature_extraction_common.py

Add tests for legacy load by url and fix bugs (#19078)

2022-09-16 23:20:02 +02:00

test_modeling_common.py

Add accelerate support for ViLT (#18683)

2022-09-22 13:14:39 +02:00

test_modeling_flax_common.py

[JAX] Replace all jax.tree_* calls with jax.tree_util.tree_* (#18361)

2022-09-09 15:18:56 +02:00

test_modeling_tf_common.py

Add tests for legacy load by url and fix bugs (#19078)

2022-09-16 23:20:02 +02:00

test_sequence_feature_extraction_common.py

Some tests misusing assertTrue for comparisons fix (#16771)

2022-04-19 14:44:08 +02:00

test_tokenization_common.py

Add tests for legacy load by url and fix bugs (#19078)

2022-09-16 23:20:02 +02:00