From dbbd94cb7a664e9aefee3bf57d0f0f1822b657bc Mon Sep 17 00:00:00 2001 From: Stefan Schweter Date: Tue, 16 Jul 2019 23:40:04 +0200 Subject: [PATCH] docs: fix link to bertology example and update dataset description --- docs/source/bertology.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/bertology.rst b/docs/source/bertology.rst index 3c8a911953..0ea5b53d80 100644 --- a/docs/source/bertology.rst +++ b/docs/source/bertology.rst @@ -15,4 +15,4 @@ In order to help this new field develop, we have included a few additional featu * accessing all the attention weights for each head of BERT/GPT/GPT-2, * retrieving heads output values and gradients to be able to compute head importance score and prune head as explained in https://arxiv.org/abs/1905.10650. -To help you understand and use these features, we have added a specific example script: `bertology.py `_ while extract information and prune a model pre-trained on MRPC. +To help you understand and use these features, we have added a specific example script: `bertology.py `_ while extract information and prune a model pre-trained on GLUE.