Make Trainer compatible with sharded checkpoints (#17053)

* Make Trainer compatible with sharded checkpoints * Add doc
2022-05-03 09:55:10 -04:00
parent 19420fd99e
commit a8fa2f91f4
6 changed files with 256 additions and 8 deletions
--- a/docs/source/en/_toctree.yml
+++ b/docs/source/en/_toctree.yml
@@ -61,6 +61,8 @@
    title: Export 🤗 Transformers models
  - local: performance
    title: 'Performance and Scalability: How To Fit a Bigger Model and Train It Faster'
+  - local: big_models
+    title: Instantiating a big model
  - local: parallelism
    title: Model Parallelism
  - local: benchmarks