Revert open-in-colab and add perceiver (#14683)

This commit is contained in:
Sylvain Gugger
2021-12-08 13:52:31 -05:00
committed by GitHub
parent f6b87c5f30
commit 01b8cd5932
10 changed files with 2 additions and 18 deletions

View File

@@ -12,8 +12,6 @@ specific language governing permissions and limitations under the License.
# Perplexity of fixed-length models
[[open-in-colab]]
Perplexity (PPL) is one of the most common metrics for evaluating language models. Before diving in, we should note
that the metric applies specifically to classical language models (sometimes called autoregressive or causal language
models) and is not well defined for masked language models like BERT (see [summary of the models](model_summary)).