Anton Vlasjuk 3bfd3e4803 Fix: Jamba batched generation (#32914) ...

* init fix

* fix mask during cached forward, move mask related stuff to own function

* adjust tests as left padding does not change logits as much anymore + batch gen (with todo on logits comp)

* revert overwriting new integration tests

* move some comments to docstring

2024-08-28 09:24:06 +02:00

..

__init__.py

Add jamba (#29943)

2024-04-18 11:04:02 +02:00

test_modeling_jamba.py

Fix: Jamba batched generation (#32914)

2024-08-28 09:24:06 +02:00