Joao Gante
be2ac0916a
[generate] shape checks in tests compatible with fixed-length caches (+ some minor fixes) (#35993)
* shape checks compatible with static cache
* add test
* tmp
* manually turn on eager attn when we want to output attn
* typo
* generalize to encoder-decoder models
* force compilation on cpu
* tmp commit
* fix static cache shape checks
* models with odd caches
* fix copies
* shorter cache search loop
* use decoder_past_key_values everywhere
* better test variable names and comments
* signature
* rename _check_outputs into _check_generate_outputs
* add comments
* HybridCache future test note
2025-02-10 17:50:54 +00:00
..
2022-02-23 15:46:28 -05:00
2022-11-09 15:34:08 +00:00
2023-03-21 19:22:01 +01:00
2024-12-12 15:47:05 +01:00
2025-01-16 17:04:54 +00:00
2024-04-02 11:39:33 +02:00
2024-10-29 08:26:04 +01:00
2024-06-06 15:21:32 +05:00
2024-10-10 14:09:04 -04:00
2025-01-24 16:55:28 +01:00
2025-02-06 16:53:28 +00:00
2025-02-10 13:36:20 +01:00
2024-08-27 11:44:09 +02:00
2024-04-09 11:04:18 +01:00
2025-02-10 17:50:54 +00:00