From db979301224050c704ee2f9278562cf3b15d7f29 Mon Sep 17 00:00:00 2001 From: Lysandre Date: Fri, 7 Feb 2020 12:12:25 -0500 Subject: [PATCH] Update XLM-R tips --- docs/source/model_doc/xlmroberta.rst | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/source/model_doc/xlmroberta.rst b/docs/source/model_doc/xlmroberta.rst index 8ddb38b1c2..6e5bcce7c9 100644 --- a/docs/source/model_doc/xlmroberta.rst +++ b/docs/source/model_doc/xlmroberta.rst @@ -22,6 +22,9 @@ and XNLI benchmarks. We will make XLM-R code, data, and models publicly availabl Tips: +- XLM-R is a multilingual model trained on 100 different languages. Unlike some XLM multilingual models, it does + not require `lang` tensors to understand which language is used, and should be able to determine the correct + language from the input ids. - This implementation is the same as RoBERTa. Refer to the `documentation of RoBERTa <./roberta.html>`__ for usage examples as well as the information relative to the inputs and outputs.