Joao Gante
be2ac0916a
[generate] shape checks in tests compatible with fixed-length caches (+ some minor fixes) (#35993)
* shape checks compatible with static cache
* add test
* tmp
* manually turn on eager attn when we want to output attn
* typo
* generalize to encoder-decoder models
* force compilation on cpu
* tmp commit
* fix static cache shape checks
* models with odd caches
* fix copies
* shorter cache search loop
* use decoder_past_key_values everywhere
* better test variable names and comments
* signature
* rename _check_outputs into _check_generate_outputs
* add comments
* HybridCache future test note
2025-02-10 17:50:54 +00:00
..
2023-08-18 14:12:28 -07:00
2024-12-13 14:33:45 +01:00
2025-02-10 17:50:54 +00:00
2024-05-22 06:40:15 +02:00
2024-10-03 18:08:24 +02:00