Files

Stas Bekman 11d86d3de4 [Deepspeed Wav2vec2] integration (#11638 )

* wip

* wip - but working with https://github.com/microsoft/DeepSpeed/pull/1044

* cleanup

* workaround

* working 5/8 modes

* solve fp32 distributed zero3

* style

* sync

* sync

* rework

* deprecation

* cleanup

* https://github.com/microsoft/DeepSpeed/pull/1044 pr was merged

* clean up

* add a guide

* more prose

* more prose

* fix

* more prose

* sub_group_size was too big

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* refactor

* bug fix

* make the true check explicit

* new deepspeed release

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

2021-06-08 12:32:03 -07:00

adversarial

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

bert-loses-patience

make style (#11442 )

2021-04-26 13:50:34 +02:00

bertabs

make style (#11442 )

2021-04-26 13:50:34 +02:00

bertology

make style (#11442 )

2021-04-26 13:50:34 +02:00

deebert

make style (#11442 )

2021-04-26 13:50:34 +02:00

distillation

Variable Correction for Consistency in Distillation Example (#11444 )

2021-04-26 13:30:48 -04:00

longform-qa

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

lxmert

Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027 )

2021-06-08 13:58:38 +01:00

mlm_wwm

Fit chinese wwm to new datasets (#9887 )

2021-02-01 03:37:59 -05:00

mm-imdb

[Examples] Fix invalid links after reorg (#11650 )

2021-05-10 11:16:48 +05:30

movement-pruning

Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027 )

2021-06-08 13:58:38 +01:00

performer

Adding performer fine-tuning research exampke (#9239 )

2020-12-21 21:19:41 +01:00

pplm

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

rag

Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027 )

2021-06-08 13:58:38 +01:00

rag-end2end-retriever

Replace legacy tensor.Tensor with torch.tensor/torch.empty (#12027 )

2021-06-08 13:58:38 +01:00

seq2seq-distillation

Close open files to suppress ResourceWarning (#11240 )

2021-04-14 10:31:04 -04:00

wav2vec2

[Deepspeed Wav2vec2] integration (#11638 )

2021-06-08 12:32:03 -07:00

zero-shot-distillation

Update README.md (#11489 )

2021-04-30 04:29:59 -04:00

README.md

Reorganize examples (#9010 )

2020-12-11 10:07:02 -05:00

README.md

Research projects

This folder contains various research projects using 🤗 Transformers. They are not maintained and require a specific version of 🤗 Transformers that is indicated in the requirements file of each folder. Updating them to the most recent version of the library will require some work.

To use any of them, just run the command

pip install -r requirements.txt

inside the folder of your choice.

If you need help with any of those, contact the author(s), indicated at the top of the README of each folder.