From 7543e275d4aba3cfc33693dc39c6b3e218d55273 Mon Sep 17 00:00:00 2001 From: "Wang, Yi" Date: Wed, 12 Oct 2022 10:54:19 +0800 Subject: [PATCH] update doc for perf_train_cpu_many (#19506) Signed-off-by: Wang, Yi A Signed-off-by: Wang, Yi A --- docs/source/en/hpo_train.mdx | 2 +- docs/source/en/perf_train_cpu_many.mdx | 4 +++- 2 files changed, 4 insertions(+), 2 deletions(-) diff --git a/docs/source/en/hpo_train.mdx b/docs/source/en/hpo_train.mdx index e9f01fe090..5a7cc429ac 100644 --- a/docs/source/en/hpo_train.mdx +++ b/docs/source/en/hpo_train.mdx @@ -116,5 +116,5 @@ You could define your own compute_objective function, if not defined, the defaul ... ) ``` -## Hyperparameter search For DDP refinetune +## Hyperparameter search For DDP finetune Currently, Hyperparameter search for DDP is enabled for optuna and sigopt. Only the rank-zero process will generate the search trial and pass the argument to other ranks. \ No newline at end of file diff --git a/docs/source/en/perf_train_cpu_many.mdx b/docs/source/en/perf_train_cpu_many.mdx index 9e7bd61467..0f1a1eddfd 100644 --- a/docs/source/en/perf_train_cpu_many.mdx +++ b/docs/source/en/perf_train_cpu_many.mdx @@ -27,6 +27,7 @@ Wheel files are available for the following Python versions: | Extension Version | Python 3.6 | Python 3.7 | Python 3.8 | Python 3.9 | Python 3.10 | | :---------------: | :--------: | :--------: | :--------: | :--------: | :---------: | +| 1.12.100 | | √ | √ | √ | √ | | 1.12.0 | | √ | √ | √ | √ | | 1.11.0 | | √ | √ | √ | √ | | 1.10.0 | √ | √ | √ | √ | | @@ -41,6 +42,7 @@ Versions of oneCCL and PyTorch must match. oneccl_bindings_for_pytorch 1.12.0 prebuilt wheel does not work with PyTorch 1.12.1 (it is for PyTorch 1.12.0) +PyTorch 1.12.1 should work with oneccl_bindings_for_pytorch 1.12.100 @@ -49,7 +51,7 @@ Use this standards-based MPI implementation to deliver flexible, efficient, scal oneccl_bindings_for_pytorch is installed along with the MPI tool set. Need to source the environment before using it. -for Intel® oneCCL 1.12.0 +for Intel® oneCCL >= 1.12.0 ``` oneccl_bindings_for_pytorch_path=$(python -c "from oneccl_bindings_for_pytorch import cwd; print(cwd)") source $oneccl_bindings_for_pytorch_path/env/setvars.sh