SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

CTC example: updated trainer parameters to save tokenizer (#23243)

Browse Source 
trainer parameters changed to save tokenizer in addition to feature_extractor
This commit is contained in:
Maria Khalusova
2023-05-10 07:45:10 -04:00
committed by GitHub
parent 3335724376
commit 91f4c84a19
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/pytorch/speech-recognition/run_speech_recognition_ctc.py
View File

@@ -705,7 +705,7 @@ def main():
compute_metrics=compute_metrics, compute_metrics=compute_metrics,
train_dataset=vectorized_datasets["train"] if training_args.do_train else None, train_dataset=vectorized_datasets["train"] if training_args.do_train else None,
eval_dataset=vectorized_datasets["eval"] if training_args.do_eval else None, eval_dataset=vectorized_datasets["eval"] if training_args.do_eval else None,
tokenizer=feature_extractor, tokenizer=processor,
) )
# 8. Finally, we can start training # 8. Finally, we can start training