Upstream (and rename) sortish sampler (#9574)

* Upstream (and rename) sortish sampler * Use proper sampler * Update src/transformers/trainer_pt_utils.py Co-authored-by: Lysandre Debut <lysandre@huggingface.co> Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
2021-01-14 10:38:14 -05:00
parent 3f40070c88
commit 329fe2746a
5 changed files with 202 additions and 12 deletions
--- a/examples/seq2seq/test_finetune_trainer.py
+++ b/examples/seq2seq/test_finetune_trainer.py
@@ -169,7 +169,7 @@ class TestFinetuneTrainer(TestCasePlus):
            --logging_steps 0
            --save_steps {str(eval_steps)}
            --eval_steps {str(eval_steps)}
-            --sortish_sampler
+            --group_by_length
            --label_smoothing_factor 0.1
            --adafactor
            --task translation