SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Revert frozen training arguments (#25903)

Browse Source 
* Revert frozen training arguments

* TODO
This commit is contained in:
Zach Mueller
2023-09-01 11:24:12 -04:00
committed by GitHub
parent 69c5b8f186
commit be0e189bd3
9 changed files with 31 additions and 58 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
examples/research_projects/mlm_wwm/run_mlm_wwm.py
View File

@@ -21,7 +21,6 @@ https://huggingface.co/models?filter=fill-mask
"""
# You can also adapt this script on your own masked language modeling task. Pointers for this are left as comments.
import dataclasses
import json
import logging
import math
@@ -367,7 +366,7 @@ def main():
# If we have ref files, need to avoid it removed by trainer
has_ref = data_args.train_ref_file or data_args.validation_ref_file
if has_ref:
training_args = dataclasses.replace(training_args, remove_unused_columns=False)
training_args.remove_unused_columns = False
# Data collator
# This one will take care of randomly masking the tokens.