SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
4,651 Commits 5 Branches 239 Tags
1e00ef681d213938cfafd678b9ec11c786405bbf
Commit Graph

3 Commits

Author SHA1 Message Date
Sam Shleifer
4302ace5bd [pack_dataset] don't sort before packing, only pack train (#5954) 2020-07-27 12:14:23 -04:00
Sam Shleifer
f1a4e06f1f [Fix] seq2seq pack_dataset.py actually packs (#5913) 
Huge MT speedup!
 2020-07-20 15:18:26 -04:00
Sam Shleifer
283500ff9f [seq2seq] pack_dataset.py rewrites dataset in max_tokens format (#5819) 2020-07-16 14:06:49 -04:00