SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Uniformize kwargs for Paligemma processor and update docs (#33571)

Browse Source 
* Uniformize paligemma processor

* nit
This commit is contained in:
Yoni Gozlan
2024-09-19 14:14:06 -04:00
committed by GitHub
parent 52920b5dd5
commit f111d5b783
5 changed files with 152 additions and 73 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/source/en/model_doc/paligemma.md
View File

@@ -41,7 +41,7 @@ processor = AutoProcessor.from_pretrained(model_id)
prompt = "What is on the flower?"
image_file = "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/bee.jpg?download=true"
raw_image = Image.open(requests.get(image_file, stream=True).raw)
inputs = processor(prompt, raw_image, return_tensors="pt")
inputs = processor(raw_image, prompt, return_tensors="pt")
output = model.generate(**inputs, max_new_tokens=20)
print(processor.decode(output[0], skip_special_tokens=True)[len(prompt):])
@@ -53,7 +53,7 @@ print(processor.decode(output[0], skip_special_tokens=True)[len(prompt):])
```python
prompt = "What is on the flower?"
answer = "a bee"
inputs = processor(text=prompt, images=raw_image, suffix=answer, return_tensors="pt")
inputs = processor(images=raw_image, text=prompt, suffix=answer, return_tensors="pt")
```
## Resources