Generate: legacy mode is only triggered when generation_config is untouched (#25962)

This commit is contained in:
Joao Gante
2023-09-12 12:08:17 +01:00
committed by GitHub
parent 18abc756c5
commit 3319eb5490
6 changed files with 53 additions and 29 deletions

View File

@@ -55,12 +55,10 @@ When you load a model explicitly, you can inspect the generation configuration t
>>> from transformers import AutoModelForCausalLM
>>> model = AutoModelForCausalLM.from_pretrained("distilgpt2")
>>> model.generation_config # doctest: +IGNORE_RESULT
>>> model.generation_config
GenerationConfig {
"_from_model_config": true,
"bos_token_id": 50256,
"eos_token_id": 50256,
"transformers_version": "4.26.0.dev0"
}
```