Make Trainer compatible with sharded checkpoints (#17053)

* Make Trainer compatible with sharded checkpoints * Add doc
2022-05-03 09:55:10 -04:00
parent 19420fd99e
commit a8fa2f91f4
6 changed files with 256 additions and 8 deletions
--- a/docs/source/en/main_classes/model.mdx
+++ b/docs/source/en/main_classes/model.mdx
@@ -89,3 +89,7 @@ Due to Pytorch design, this functionality is only available for floating dtypes.
 ## Pushing to the Hub

 [[autodoc]] utils.PushToHubMixin
+
+## Sharded checkpoints
+
+[[autodoc]] modeling_utils.load_sharded_checkpoint