Update masked_language_modeling.md (#24560)

See https://github.com/huggingface/transformers/issues/24546
This commit is contained in:
condor-cp
2023-06-28 23:54:20 +02:00
committed by GitHub
parent fd6735102a
commit 66954ea25e

View File

@@ -168,7 +168,6 @@ You can now use a second preprocessing function to
... k: [t[i : i + block_size] for i in range(0, total_length, block_size)] ... k: [t[i : i + block_size] for i in range(0, total_length, block_size)]
... for k, t in concatenated_examples.items() ... for k, t in concatenated_examples.items()
... } ... }
... result["labels"] = result["input_ids"].copy()
... return result ... return result
``` ```