MBART: support summarization tasks where max_src_len > max_tgt_len (#6003)

* MBART: support summarization tasks * fix test * Style * add tokenizer test
2020-07-28 08:18:11 -04:00
parent 842eb45606
commit 3c7fbf35a6
7 changed files with 38 additions and 15 deletions
--- a/examples/seq2seq/README.md
+++ b/examples/seq2seq/README.md
@@ -180,6 +180,8 @@ python run_eval.py sshleifer/distilbart-cnn-12-6 $DATA_DIR/val.source dbart_val_
    --task summarization \
    --n_obs 100 \
    --device cuda \
+    --max_source_length 1024 \
+    --max_target_length 56 \
    --fp16 \
    --bs 32
 ```