From 60698936fcf98146dd0d23b47b1211a25ed0d783 Mon Sep 17 00:00:00 2001
From: Patrick von Platen <patrick.v.platen@gmail.com>
Date: Thu, 10 Sep 2020 17:00:10 +0200
Subject: [PATCH] Create README.md

---
 .../google/bert2bert_L-24_wmt_de_en/README.md | 37 +++++++++++++++++++
 1 file changed, 37 insertions(+)
 create mode 100644 model_cards/google/bert2bert_L-24_wmt_de_en/README.md

diff --git a/model_cards/google/bert2bert_L-24_wmt_de_en/README.md b/model_cards/google/bert2bert_L-24_wmt_de_en/README.md
new file mode 100644
index 0000000000..f3abe08d9a
--- /dev/null
+++ b/model_cards/google/bert2bert_L-24_wmt_de_en/README.md
@@ -0,0 +1,37 @@
+---
+language: 
+- en
+- de
+license: apache-2.0
+datasets:
+- wmt14
+---
+
+# bert2bert_L-24_wmt_de_en EncoderDecoder model
+
+The model was introduced in 
+[this paper](https://arxiv.org/abs/1907.12461) by Sascha Rothe, Shashi Narayan, Aliaksei Severyn and first released in [this repository](https://tfhub.dev/google/bertseq2seq/bert24_de_en/1). 
+
+The model is an encoder-decoder model that was initialized on the `bert-large` checkpoints for both the encoder 
+and decoder and fine-tuned on German to English translation on the WMT dataset, which is linked above.
+
+Disclaimer: The model card has been written by the Hugging Face team.
+
+## How to use
+
+You can use this model for sentence fusion, *e.g.*
+
+```python
+from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
+
+tokenizer = AutoTokenizer.from_pretrained("google/bert2bert_L-24_wmt_de_en", pad_token="<pad>", eos_token="</s>", bos_token="<s>")
+model = AutoModelForSeq2SeqLM.from_pretrained("google/bert2bert_L-24_wmt_de_en")
+
+sentence = "Willst du einen Kaffee trinken gehen mit mir?"
+
+input_ids = tokenizer(sentence, return_tensors="pt", add_special_tokens=False).input_ids
+output_ids = model.generate(input_ids)[0]
+print(tokenizer.decode(output_ids, skip_special_tokens=True))
+# should output
+# Want to drink a kaffee go with me? .
+```