DanielHesslow 607acd4fbd Add Gated-SiLU to T5 (#17420) ...

* Add gated-silu to t5 architecture to support UL2

* Fix error message

* formatting

* formatting again

* refactor

* fix classnames in _init_weights

* remove is_gated

* add test

* fix test

* Try without the test?

* Add back the test.

* Improve error message.

Co-authored-by: Daniel Hesslow <daniel@lighton.ai>

2022-06-03 10:56:37 +02:00

..

__init__.py

Move test model folders (#17034)

2022-05-03 14:42:02 +02:00

test_modeling_flax_t5.py

Black preview (#17217)

2022-05-12 16:25:55 -04:00

test_modeling_t5.py

Add Gated-SiLU to T5 (#17420)

2022-06-03 10:56:37 +02:00

test_modeling_tf_t5.py

Fix test_t5_decoder_model_past_large_inputs (#17320)

2022-05-18 17:57:23 +02:00

test_tokenization_t5.py

Move test model folders (#17034)

2022-05-03 14:42:02 +02:00