Anton Lozhkov d472bd7b18 Wav2Vec2 Pretraining (#11306) ...

* Working quantizer forward

* Working quantizer forward

* Clean up unused model parts, test reproducibility

* Working quantizer forward

* Clean up unused model parts, test reproducibility

* Remove custom outputs from the shared ones

* correct conversion

* correct bug

* add first pretrain script

* save intermediate

* static shapes

* save intermediate

* finish first pretrain script version

* more refactor

* remove wanddb

* refactor more

* improve test

* correct perplexity compute bug

* finish model implementation

* add to docs

* finish docs

* finish pretraining script

* finish pretraining script

* remove wandb

* finish PR for merge

* finish config

* finish

* make deepspeed work

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* apply suggestions

* fix flaky test

Co-authored-by: patrickvonplaten <patrick.v.platen@gmail.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

2021-06-09 18:40:56 +01:00

..

_static

Docs for v4.7.0.dev0

2021-05-12 17:08:35 +02:00

imgs

[Templates] Add template "call-for-model" markdown and "call-for-big-bird" markdown (#9921)

2021-02-05 15:47:54 +03:00

internal

[docs] fix xref to PreTrainedModel.generate (#11049)

2021-06-02 09:21:05 -07:00

main_classes

typo

2021-06-08 12:55:17 -07:00

model_doc

Wav2Vec2 Pretraining (#11306)

2021-06-09 18:40:56 +01:00

add_new_model.rst

Indent code block in the documentation (#11233)

2021-04-13 15:36:36 -04:00

benchmarks.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

bertology.rst

Fix documentation links always pointing to master. (#9217)

2021-01-05 06:18:48 -05:00

community.md

Add DETR (#11653)

2021-06-09 11:51:13 -04:00

conf.py

added social thumbnail for docs (#11083)

2021-04-06 14:56:18 +02:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

custom_datasets.rst

Rename NLP library to Datasets library (#10920)

2021-03-26 08:07:59 -04:00

debugging.rst

[debug utils] activation/weights underflow/overflow detector (#11274)

2021-04-30 11:15:46 -07:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

fast_tokenizers.rst

Documentation about loading a fast tokenizer within Transformers (#11029)

2021-04-05 10:51:16 -04:00

favicon.ico

Adding usage examples for common tasks (#2850)

2020-02-25 13:48:24 -05:00

glossary.rst

Indent code block in the documentation (#11233)

2021-04-13 15:36:36 -04:00

index.rst

Add DETR (#11653)

2021-06-09 11:51:13 -04:00

installation.md

Fix two typos in docs (#11852)

2021-05-24 14:26:02 -04:00

migration.md

[docs] fix invalid class name (#11438)

2021-04-26 08:37:32 -07:00

model_sharing.rst

Fix two typos in docs (#11852)

2021-05-24 14:26:02 -04:00

model_summary.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

multilingual.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

perplexity.rst

minor typo fix

2021-04-01 11:58:37 -06:00

philosophy.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

preprocessing.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

pretrained_models.rst

GPT Neo few fixes (#10968)

2021-03-30 11:15:55 -04:00

quicktour.rst

Finish Making Quick Tour respect the model object (#11467)

2021-04-27 10:04:12 -04:00

sagemaker.md

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

serialization.rst

Copyright (#8970)

2020-12-07 18:36:34 -05:00

task_summary.rst

[docs] fix xref to PreTrainedModel.generate (#11049)

2021-06-02 09:21:05 -07:00

testing.rst

[testing doc] bring doc up to date (#11359)

2021-04-21 08:51:00 -07:00

tokenizer_summary.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

training.rst

Update training tutorial (#11533)

2021-05-03 13:18:46 -04:00

troubleshooting.md

[troubleshooting] add 2 points of reference to the offline mode (#11236)

2021-04-14 08:39:23 -07:00