SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

fix docs serving typos. (#37936)

Browse Source 
Signed-off-by: zhanluxianshen <zhanluxianshen@163.com>
This commit is contained in:
湛露先生
2025-05-06 21:32:44 +08:00
committed by GitHub
parent b1375177fc
commit cc68070d41
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/en/serving.md
View File

@@ -51,7 +51,7 @@ By default, vLLM serves the native implementation and if it doesn't exist, it fa
```shell ```shell
vllm serve Qwen/Qwen2.5-1.5B-Instruct \ vllm serve Qwen/Qwen2.5-1.5B-Instruct \
--task generate \ --task generate \
--model-impl transformers \ --model-impl transformers
``` ```
Add the `trust-remote-code` parameter to enable loading a remote code model. Add the `trust-remote-code` parameter to enable loading a remote code model.
@@ -60,5 +60,5 @@ Add the `trust-remote-code` parameter to enable loading a remote code model.
vllm serve Qwen/Qwen2.5-1.5B-Instruct \ vllm serve Qwen/Qwen2.5-1.5B-Instruct \
--task generate \ --task generate \
--model-impl transformers \ --model-impl transformers \
--trust-remote-code \ --trust-remote-code
``` ```