SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

BLIP: fix generation after hub update (#34876)

Browse Source 
* fix blip generation

* dont remove it yet

* Update src/transformers/models/blip_2/modeling_blip_2.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* address comments

* modular

---------

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
This commit is contained in:
Raushan Turganbay
2024-11-25 10:41:55 +01:00
committed by GitHub
parent c1a8520419
commit 098962dac2
7 changed files with 42 additions and 35 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
tests/models/instructblip/test_modeling_instructblip.py
View File

@@ -945,7 +945,7 @@ class InstructBlipModelIntegrationTest(unittest.TestCase):
# Add args to the config to trigger new logic when inputs are expanded in processing file
processor.num_query_tokens = model.config.num_query_tokens
processor.tokenizer.add_special_tokens({"additional_special_tokens": ["<image>"]})
model.config.image_token_index = len(processor.tokenizer) - 1
model.config.image_token_index = len(processor.tokenizer) - 2
model.resize_token_embeddings(processor.tokenizer.vocab_size, pad_to_multiple_of=64)
# Generate again with new inputs