[doc] DP/PP/TP/etc parallelism (#12524)

* wip * complete the doc * missing img * improve * correction * Apply suggestions from code review Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2021-07-09 17:39:09 -07:00
parent 4cdbf63c03
commit 0dcc3c86e4
12 changed files with 311 additions and 0 deletions
--- a/docs/source/index.rst
+++ b/docs/source/index.rst
@@ -464,6 +464,7 @@ Flax), PyTorch, and/or TensorFlow.
    add_new_model
    fast_tokenizers
    performance
+    parallelism
    testing
    debugging
    serialization