SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Finish conversion of REALM doc to MDX

Browse Source
This commit is contained in:
Sylvain Gugger
2022-01-18 18:00:30 -05:00
parent fe78fe98ca
commit db3503949d
1 changed files with 3 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
docs/source/model_doc/realm.mdx
View File

@@ -14,8 +14,7 @@ specific language governing permissions and limitations under the License.
## Overview ## Overview
The REALM model was proposed in `REALM: Retrieval-Augmented Language Model Pre-Training The REALM model was proposed in [REALM: Retrieval-Augmented Language Model Pre-Training](https://arxiv.org/abs/2002.08909) by Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat and Ming-Wei Chang. It's a
<https://arxiv.org/abs/2002.08909>`__ by Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat and Ming-Wei Chang. It's a
retrieval-augmented language model that firstly retrieves documents from a textual knowledge corpus and then retrieval-augmented language model that firstly retrieves documents from a textual knowledge corpus and then
utilizes retrieved documents to process question answering tasks. utilizes retrieved documents to process question answering tasks.
@@ -34,8 +33,8 @@ explicit and implicit knowledge storage on three popular Open-QA benchmarks, and
methods by a significant margin (4-16% absolute accuracy), while also providing qualitative benefits such as methods by a significant margin (4-16% absolute accuracy), while also providing qualitative benefits such as
interpretability and modularity.* interpretability and modularity.*
This model was contributed by `qqaatw <https://huggingface.co/qqaatw>`__. The original code can be found `here This model was contributed by [qqaatw](https://huggingface.co/qqaatw). The original code can be found
<https://github.com/google-research/language/tree/master/language/realm>`__. [here](https://github.com/google-research/language/tree/master/language/realm).
## RealmConfig ## RealmConfig