[pegasus] Faster tokenizer tests (#7672)

Browse Source

...

This commit is contained in:

Stas Bekman

2020-10-09 08:10:32 -07:00

committed by GitHub

parent bc00b37a0d

commit b0f05e0c4c

8 changed files with 51 additions and 29 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

tests/fixtures/test_sentencepiece_no_bos.model vendored Normal file

Binary file not shown.