Files

Patrick von Platen 0234de8418 Add Fine-Tuning for Wav2Vec2 (#10145 )

* add encode labels function to tokenizer

* start adding finetuning

* init dropout

* upload

* correct convert script

* apply changes

* fix second typo

* make first dummy training run

* adapt convert script

* push confg for comparison

* remove conf

* finish training

* adapt data collator

* add research folder

* update according to fairseq feedback

* some minor corrections

* refactor masking indices a bit

* some minor changes

* clean tokenizer

* finish clean-up

* remove previous logic

* update run script

* correct training

* finish changes

* finish model

* correct bug

* fix training a bit more

* add some tests

* finish gradient checkpointing

* finish example

* correct gradient checkpointing

* improve tokenization method

* revert changes in tokenizer

* revert general change

* adapt fine-tuning

* update

* save intermediate test

* Update README.md

* finish finetuning

* delete conversion script

* Update src/transformers/models/wav2vec2/configuration_wav2vec2.py

* Update src/transformers/models/wav2vec2/processing_wav2vec2.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* finish wav2vec2 script

* finish wav2vec2 fine-tuning

* finalize test

* correct test

* adapt tests

* finish

* remove test file

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

2021-03-01 12:13:17 +03:00

adversarial

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

bert-loses-patience

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

bertabs

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

bertology

Line endings should be LF across repo and not CRLF (#10119 )

2021-02-10 10:50:00 -05:00

deebert

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

distillation

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

longform-qa

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

lxmert

[research proj] [lxmert] rm bleach dependency (#9970 )

2021-02-03 05:24:40 -05:00

mlm_wwm

Fit chinese wwm to new datasets (#9887 )

2021-02-01 03:37:59 -05:00

mm-imdb

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

movement-pruning

Remove nested lxmert (#9440 )

2021-01-07 04:10:41 -05:00

performer

Adding performer fine-tuning research exampke (#9239 )

2020-12-21 21:19:41 +01:00

pplm

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

rag

Fix typos in README and bugs in RAG example code for end-to-end evaluation and finetuning (#9355 )

2021-01-03 16:00:30 +01:00

seq2seq-distillation

[PyTorch Bart] Split Bart into different models (#9343 )

2021-01-05 22:00:05 +01:00

wav2vec2

Add Fine-Tuning for Wav2Vec2 (#10145 )

2021-03-01 12:13:17 +03:00

zero-shot-distillation

Zero shot distillation script cuda patch (#10284 )

2021-02-19 14:06:57 -05:00

README.md

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

README.md

Research projects

This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.

To use any of them, just run the command

pip install -r requirements.txt

inside the folder of your choice.

If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.