Use real tokenizers if tiny version(s) creation has issue(s) (#22428)

Browse Source

Fix some tiny model creation issues

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

...

This commit is contained in:

Yih-Dar

2023-03-29 16:16:23 +02:00

committed by GitHub

parent 9b494a1537

commit 8894b81742

6 changed files with 336 additions and 139 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

256

tests/utils/tiny_model_summary.json

File diff suppressed because it is too large Load Diff