Sylvain Gugger 9d14be5c20 Add support for ZeRO-2/3 and ZeRO-offload in fairscale (#10354) ...

* Ass support for ZeRO-2/3 and ZeRO-offload in fairscale

* Quality

* Rework from review comments

* Add doc

* Apply suggestions from code review

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

* Address review comments

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

2021-02-25 11:07:53 -05:00

..

callback.rst

Copyright (#8970)

2020-12-07 18:36:34 -05:00

configuration.rst

Copyright (#8970)

2020-12-07 18:36:34 -05:00

feature_extractor.rst

[PretrainedFeatureExtractor] + Wav2Vec2FeatureExtractor, Wav2Vec2Processor, Wav2Vec2Tokenizer (#10324)

2021-02-25 17:42:46 +03:00

logging.rst

Logging propagation (#10092)

2021-02-09 10:27:49 -05:00

model.rst

[Flax] Align FlaxBertForMaskedLM with BertForMaskedLM, implement from_pretrained, init (#9054)

2020-12-16 13:03:32 +01:00

optimizer_schedules.rst

Seq2seq trainer (#9241)

2020-12-22 11:33:44 -05:00

output.rst

Add caching mechanism to BERT, RoBERTa (#9183)

2020-12-23 23:01:32 +05:30

pipelines.rst

TableQuestionAnsweringPipeline (#9145)

2020-12-16 12:31:50 -05:00

processors.rst

Fix documentation links always pointing to master. (#9217)

2021-01-05 06:18:48 -05:00

tokenizer.rst

A few fixes in the documentation (#10033)

2021-02-08 05:02:01 -05:00

trainer.rst

Add support for ZeRO-2/3 and ZeRO-offload in fairscale (#10354)

2021-02-25 11:07:53 -05:00