From e2972dffdd2f41cfdaae89b0ec22bf7917d43657 Mon Sep 17 00:00:00 2001 From: Elliott Wang Date: Fri, 9 Jun 2023 19:32:16 +0800 Subject: [PATCH] PLAM => PaLM (#24129) --- docs/source/en/model_doc/open-llama.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/en/model_doc/open-llama.mdx b/docs/source/en/model_doc/open-llama.mdx index f4d2b72b09..fa463953ee 100644 --- a/docs/source/en/model_doc/open-llama.mdx +++ b/docs/source/en/model_doc/open-llama.mdx @@ -16,7 +16,7 @@ specific language governing permissions and limitations under the License. The Open-Llama model was proposed in [Open-Llama project](https://github.com/s-JoL/Open-Llama) by community developer s-JoL. -The model is mainly based on LLaMA with some modifications, incorporating memory-efficient attention from Xformers, stable embedding from Bloom, and shared input-output embedding from PLAM. +The model is mainly based on LLaMA with some modifications, incorporating memory-efficient attention from Xformers, stable embedding from Bloom, and shared input-output embedding from PaLM. And the model is pre-trained on both Chinese and English, which gives it better performance on Chinese language tasks. This model was contributed by [s-JoL](https://huggingface.co/s-JoL).