Patrick von Platen 0234de8418 Add Fine-Tuning for Wav2Vec2 (#10145) ...

* add encode labels function to tokenizer

* start adding finetuning

* init dropout

* upload

* correct convert script

* apply changes

* fix second typo

* make first dummy training run

* adapt convert script

* push confg for comparison

* remove conf

* finish training

* adapt data collator

* add research folder

* update according to fairseq feedback

* some minor corrections

* refactor masking indices a bit

* some minor changes

* clean tokenizer

* finish clean-up

* remove previous logic

* update run script

* correct training

* finish changes

* finish model

* correct bug

* fix training a bit more

* add some tests

* finish gradient checkpointing

* finish example

* correct gradient checkpointing

* improve tokenization method

* revert changes in tokenizer

* revert general change

* adapt fine-tuning

* update

* save intermediate test

* Update README.md

* finish finetuning

* delete conversion script

* Update src/transformers/models/wav2vec2/configuration_wav2vec2.py

* Update src/transformers/models/wav2vec2/processing_wav2vec2.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* finish wav2vec2 script

* finish wav2vec2 fine-tuning

* finalize test

* correct test

* adapt tests

* finish

* remove test file

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

2021-03-01 12:13:17 +03:00

..

_static

v4.3.3 docs

2021-02-24 15:19:01 -05:00

imgs

[Templates] Add template "call-for-model" markdown and "call-for-big-bird" markdown (#9921)

2021-02-05 15:47:54 +03:00

internal

Introduce save_strategy training argument (#10286)

2021-02-27 19:34:22 -05:00

main_classes

Add support for ZeRO-2/3 and ZeRO-offload in fairscale (#10354)

2021-02-25 11:07:53 -05:00

model_doc

Add Fine-Tuning for Wav2Vec2 (#10145)

2021-03-01 12:13:17 +03:00

add_new_model.rst

Add new model docs (#9667)

2021-02-01 17:55:10 +03:00

benchmarks.rst

Make doc styler detect lists on rst (#9488)

2021-01-11 08:53:41 -05:00

bertology.rst

Fix documentation links always pointing to master. (#9217)

2021-01-05 06:18:48 -05:00

community.md

Add new community notebook - Blenderbot (#10126)

2021-02-11 12:53:40 +03:00

conf.py

Release: v4.2.0

2021-01-13 16:01:51 +01:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.rst

Fix broken links in the converting tf ckpt document (#9791)

2021-01-26 03:37:57 -05:00

custom_datasets.rst

Fix None in add_token_positions - issue #10210 (#10374)

2021-02-25 09:18:33 -07:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

favicon.ico

Adding usage examples for common tasks (#2850)

2020-02-25 13:48:24 -05:00

glossary.rst

Adds terms to Glossary (#10443)

2021-02-28 08:27:54 -05:00

index.rst

I-BERT model support (#10153)

2021-02-25 10:06:42 -05:00

installation.md

[docs] expand install instructions (#9817)

2021-01-28 09:36:46 -08:00

migration.md

Copyright (#8970)

2020-12-07 18:36:34 -05:00

model_sharing.rst

[doc] nested markup is invalid in rst (#9898)

2021-01-30 09:59:19 -05:00

model_summary.rst

ConvBERT Model (#9717)

2021-01-27 03:20:09 -05:00

multilingual.rst

Fix documentation links always pointing to master. (#9217)

2021-01-05 06:18:48 -05:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

perplexity.rst

Copyright (#8970)

2020-12-07 18:36:34 -05:00

philosophy.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

preprocessing.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

pretrained_models.rst

Integrate DeBERTa v2(the 1.5B model surpassed human performance on Su… (#10018)

2021-02-19 18:34:44 -05:00

quicktour.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

serialization.rst

Copyright (#8970)

2020-12-07 18:36:34 -05:00

task_summary.rst

Remove unused variable in example for Q&A (#10392)

2021-02-25 09:18:47 -05:00

testing.rst

Fix documentation links always pointing to master. (#9217)

2021-01-05 06:18:48 -05:00

tokenizer_summary.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

training.rst

[trainer] deepspeed integration (#9211)

2021-01-12 19:05:18 -08:00