diff --git a/docs/source/en/bertology.mdx b/docs/source/en/bertology.mdx index e64379d658..505b569028 100644 --- a/docs/source/en/bertology.mdx +++ b/docs/source/en/bertology.mdx @@ -21,6 +21,7 @@ There is a growing field of study concerned with investigating the inner working - Are Sixteen Heads Really Better than One? by Paul Michel, Omer Levy, Graham Neubig: https://arxiv.org/abs/1905.10650 - What Does BERT Look At? An Analysis of BERT's Attention by Kevin Clark, Urvashi Khandelwal, Omer Levy, Christopher D. Manning: https://arxiv.org/abs/1906.04341 +- CAT-probing: A Metric-based Approach to Interpret How Pre-trained Models for Programming Language Attend Code Structure: https://arxiv.org/abs/2210.04633 In order to help this new field develop, we have included a few additional features in the BERT/GPT/GPT-2 models to help people access the inner representations, mainly adapted from the great work of Paul Michel diff --git a/docs/source/es/bertology.mdx b/docs/source/es/bertology.mdx index 4a3a1e551b..9a7c488742 100644 --- a/docs/source/es/bertology.mdx +++ b/docs/source/es/bertology.mdx @@ -21,6 +21,7 @@ Hay un creciente campo de estudio empeñado en la investigación del funcionamie - Are Sixteen Heads Really Better than One? por Paul Michel, Omer Levy, Graham Neubig: https://arxiv.org/abs/1905.10650 - What Does BERT Look At? An Analysis of BERT's Attention por Kevin Clark, Urvashi Khandelwal, Omer Levy, Christopher D. Manning: https://arxiv.org/abs/1906.04341 +- CAT-probing: A Metric-based Approach to Interpret How Pre-trained Models for Programming Language Attend Code Structure: https://arxiv.org/abs/2210.04633 Para asistir al desarrollo de este nuevo campo, hemos incluido algunas features adicionales en los modelos BERT/GPT/GPT-2 para ayudar a acceder a las representaciones internas, principalmente adaptado de la gran obra de Paul Michel