SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Add a warning to the chat template docs about the tool_calls format (#33277)

Browse Source 
* Add a warning to the chat template docs

* Add a warning to the chat template docs

* Add a warning to the chat template docs
This commit is contained in:
Matt
2024-09-04 17:13:34 +01:00
committed by GitHub
parent 2cb543db77
commit 01c8c6c419
1 changed files with 6 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/en/chat_templating.md
View File

@@ -441,6 +441,12 @@ tool_call = {"name": "get_current_temperature", "arguments": {"location": "Paris
messages.append({"role": "assistant", "tool_calls": [{"type": "function", "function": tool_call}]}) messages.append({"role": "assistant", "tool_calls": [{"type": "function", "function": tool_call}]})
``` ```
<Tip warning={true}>
If you're familiar with the OpenAI API, you should pay attention to an important difference here - the `tool_call` is
a dict, but in the OpenAI API it's a JSON string. Passing a string may cause errors or strange model behaviour!
</Tip>
Now that we've added the tool call to the conversation, we can call the function and append the result to the Now that we've added the tool call to the conversation, we can call the function and append the result to the
conversation. Since we're just using a dummy function for this example that always returns 22.0, we can just append conversation. Since we're just using a dummy function for this example that always returns 22.0, we can just append