@@ -64,7 +64,7 @@ for you, allowing you to write universal code that works for any model.
|
|||||||
|
|
||||||
<Tip>
|
<Tip>
|
||||||
|
|
||||||
Chat templates are a critical component of our [`transformers-cli chat` CLI](quicktour#chat-with-text-generation-models).
|
Chat templates are a critical component of our [chat CLI](quicktour#chat-with-text-generation-models).
|
||||||
You can apply the learnings of this guide there as well.
|
You can apply the learnings of this guide there as well.
|
||||||
|
|
||||||
</Tip>
|
</Tip>
|
||||||
|
|||||||
@@ -43,7 +43,7 @@ This guide describes:
|
|||||||
|
|
||||||
<Tip>
|
<Tip>
|
||||||
|
|
||||||
`generate()` is a critical component of our [`transformers-cli chat` CLI](quicktour#chat-with-text-generation-models).
|
`generate()` is a critical component of our [chat CLI](quicktour#chat-with-text-generation-models).
|
||||||
You can apply the learnings of this guide there as well.
|
You can apply the learnings of this guide there as well.
|
||||||
|
|
||||||
</Tip>
|
</Tip>
|
||||||
|
|||||||
@@ -25,7 +25,7 @@ Autoregressive generation is the inference-time procedure of iteratively calling
|
|||||||
|
|
||||||
<Tip>
|
<Tip>
|
||||||
|
|
||||||
If you want to jump straight to chatting with a model, [try our `transformers-cli chat` CLI](quicktour#chat-with-text-generation-models).
|
If you want to jump straight to chatting with a model, [try our chat CLI](quicktour#chat-with-text-generation-models).
|
||||||
|
|
||||||
</Tip>
|
</Tip>
|
||||||
|
|
||||||
|
|||||||
@@ -564,13 +564,13 @@ This CLI is implemented on top of our `AutoClass` abstraction, leveraging our [t
|
|||||||
[chat](chat_templating.md) tooling, and thus will be compatible with any 🤗 Transformers model. If you have the library
|
[chat](chat_templating.md) tooling, and thus will be compatible with any 🤗 Transformers model. If you have the library
|
||||||
[installed](installation.md), you can launch the chat session on your terminal with
|
[installed](installation.md), you can launch the chat session on your terminal with
|
||||||
|
|
||||||
```
|
```bash
|
||||||
transformers-cli chat --model_name_or_path Qwen/Qwen2.5-0.5B-Instruct
|
transformers-cli chat --model_name_or_path Qwen/Qwen2.5-0.5B-Instruct
|
||||||
```
|
```
|
||||||
|
|
||||||
For a full list of options to launch the chat, type
|
For a full list of options to launch the chat, type
|
||||||
|
|
||||||
```
|
```bash
|
||||||
transformers-cli chat -h
|
transformers-cli chat -h
|
||||||
```
|
```
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user