@@ -80,7 +80,7 @@ Run inference with decoder-only models with the `text-generation` pipeline:
|
||||
>>> prompt = "Hello, I'm a language model"
|
||||
|
||||
>>> generator(prompt, max_length = 30)
|
||||
[{'generated_text': "Hello, I'm a language model programmer so you can use some of my stuff. But you also need some sort of a C program to run."}]
|
||||
[{'generated_text': "Hello, I'm a language model. Not a programming language at all: it's pretty simple.\n\nWhen I write a function, I mean"}]
|
||||
```
|
||||
|
||||
To run inference with an encoder-decoder, use the `text2text-generation` pipeline:
|
||||
@@ -258,7 +258,7 @@ also be a suitable location for instructions. Typically, it's better to place th
|
||||
|
||||
>>> for seq in sequences:
|
||||
... print(f"{seq['generated_text']}")
|
||||
Permaculture is an ecological design mimicking natural ecosystems to meet basic needs and prepare for climate change. It is based on traditional knowledge and scientific understanding.
|
||||
"Permaculture is an ecological design method that mimics natural ecosystems' diversity, functionality, and resilience using modern technology and indigenous knowledge. It aims to help"
|
||||
```
|
||||
|
||||
#### Question answering
|
||||
@@ -284,7 +284,7 @@ the leading word or phrase (`"Answer:"`) to nudge the model to start generating
|
||||
|
||||
>>> for seq in sequences:
|
||||
... print(f"Result: {seq['generated_text']}")
|
||||
Result: Modern tools often used to make gazpacho include
|
||||
"Result: Modern tools are used, such as immersion blenders"
|
||||
```
|
||||
|
||||
#### Reasoning
|
||||
@@ -309,7 +309,7 @@ Let's try if we can make a model reason about a simple arithmetics task with a b
|
||||
>>> for seq in sequences:
|
||||
... print(f"Result: {seq['generated_text']}")
|
||||
Result:
|
||||
There are a total of 5 groups, so there are 5 x 4=20 students in the class.
|
||||
There are a total of 50 students in the class (5 groups x 4 students per group = 20 groups, and
|
||||
```
|
||||
|
||||
Correct! Let's increase the complexity a little and see if we can still get away with a basic prompt:
|
||||
|
||||
Reference in New Issue
Block a user