From d818dd3a41925a98694b1d6a6265de1b35f69a15 Mon Sep 17 00:00:00 2001 From: Steven Liu <59462357+stevhliu@users.noreply.github.com> Date: Thu, 27 Oct 2022 11:33:52 -0700 Subject: [PATCH] Add BLOOM resources (#19881) * add bloom resources * add pipeline icon --- docs/source/en/model_doc/bloom.mdx | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/docs/source/en/model_doc/bloom.mdx b/docs/source/en/model_doc/bloom.mdx index 3fc48ab974..1672da43e5 100644 --- a/docs/source/en/model_doc/bloom.mdx +++ b/docs/source/en/model_doc/bloom.mdx @@ -25,6 +25,21 @@ Several smaller versions of the models have been trained on the same dataset. BL - [bloom-7b1](https://huggingface.co/bigscience/bloom-7b1) - [bloom](https://huggingface.co/bigscience/bloom) (176B parameters) +## Resources + + +A list of official Hugging Face and community (indicated by 🌎) resources to help you get started with BLOOM. If you're interested in submitting a resource to be included here, please feel free to open a Pull Request and we'll review it! The resource should ideally demonstrate something new instead of duplicating an existing resource. + + + +- [`BloomForCausalLM`] is suppported by this [causal language modeling example script](https://github.com/huggingface/transformers/tree/main/examples/pytorch/language-modeling#gpt-2gpt-and-causal-language-modeling) and [notebook](https://colab.research.google.com/github/huggingface/notebooks/blob/main/examples/language_modeling.ipynb). + +⚡️ Inference +- A blog on [Optimization story: Bloom inference](https://huggingface.co/blog/bloom-inference-optimization). +- A blog on [Incredibly Fast BLOOM Inference with DeepSpeed and Accelerate](https://huggingface.co/blog/bloom-inference-pytorch-scripts). + +⚙️ Training +- A blog on [The Technology Behind BLOOM Training](https://huggingface.co/blog/bloom-megatron-deepspeed). ## BloomConfig