add open-llama model with ckpt (#22795)

* update Open-Llama model * update * update format * update doc * update * update stable embedding test * update test case * update format * update readme * fix typo * update name * remove tokenizer and update format * remove convert_open_llama_weights_to_hf * update warning and doc_string --------- Co-authored-by: songliang.bayesian <songliang.bayesian@bytedance.com>
2023-04-28 23:01:32 +08:00
parent 0bf34b1c9f
commit c2c99dc7ef
22 changed files with 1592 additions and 2 deletions
--- a/docs/source/en/_toctree.yml
+++ b/docs/source/en/_toctree.yml
@@ -363,6 +363,8 @@
        title: NLLB-MoE
      - local: model_doc/nystromformer
        title: Nyströmformer
+      - local: model_doc/open-llama
+        title: Open-Llama
      - local: model_doc/opt
        title: OPT
      - local: model_doc/pegasus