[docs] add the missing tokenizer when pushing models to huggingface hub (#33428)
* add tokenizer * typo
This commit is contained in:
@@ -253,6 +253,7 @@ At this point, only three steps remain:
|
||||
... train_dataset=lm_dataset["train"],
|
||||
... eval_dataset=lm_dataset["test"],
|
||||
... data_collator=data_collator,
|
||||
... tokenizer=tokenizer,
|
||||
... )
|
||||
|
||||
>>> trainer.train()
|
||||
|
||||
@@ -245,6 +245,7 @@ At this point, only three steps remain:
|
||||
... train_dataset=lm_dataset["train"],
|
||||
... eval_dataset=lm_dataset["test"],
|
||||
... data_collator=data_collator,
|
||||
... tokenizer=tokenizer,
|
||||
... )
|
||||
|
||||
>>> trainer.train()
|
||||
|
||||
Reference in New Issue
Block a user