Camembert

2020-01-17 18:13:14 -05:00
parent 264eb23912
commit f44ff574d3
3 changed files with 34 additions and 217 deletions
--- a/docs/source/model_doc/camembert.rst
+++ b/docs/source/model_doc/camembert.rst
@@ -1,6 +1,14 @@
 CamemBERT
 ----------------------------------------------------

+The CamemBERT model was proposed in `CamemBERT: a Tasty French Language Model`_
+by Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric Villemonte de la
+Clergerie, Djamé Seddah, and Benoît Sagot. It is based on Facebook's RoBERTa model released in 2019.
+
+It is a model trained on 138GB of French text.
+
+This implementation is the same as RoBERTa.
+
 ``CamembertConfig``
 ~~~~~~~~~~~~~~~~~~~~~