From f9a711df4a899d8586a62eabe6005334412936e8 Mon Sep 17 00:00:00 2001 From: dymil <30931139+dymil@users.noreply.github.com> Date: Thu, 13 Jul 2023 11:56:53 -0400 Subject: [PATCH] Fix typo 'submosules' (#24809) --- docs/source/en/main_classes/model.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/en/main_classes/model.md b/docs/source/en/main_classes/model.md index f4ac72c405..da907f80ee 100644 --- a/docs/source/en/main_classes/model.md +++ b/docs/source/en/main_classes/model.md @@ -103,7 +103,7 @@ t0pp.hf_device_map 'lm_head': 'cpu'} ``` -You can also write your own device map following the same format (a dictionary layer name to device). It should map all parameters of the model to a given device, but you don't have to detail where all the submosules of one layer go if that layer is entirely on the same device. For instance, the following device map would work properly for T0pp (as long as you have the GPU memory): +You can also write your own device map following the same format (a dictionary layer name to device). It should map all parameters of the model to a given device, but you don't have to detail where all the submodules of one layer go if that layer is entirely on the same device. For instance, the following device map would work properly for T0pp (as long as you have the GPU memory): ```python device_map = {"shared": 0, "encoder": 0, "decoder": 1, "lm_head": 1}