Stas Bekman bee361c6f1 [t5/t0/mt5 models] faster/leaner custom layer norm (#14656) ...

* [t5] faster/leaner custom layer norm

* wip

* apex.normalization.FusedRMSNorm

* cleanup

* cleanup

* add doc

* add catch all

* Trigger CI

* expand

2022-02-15 16:49:57 -08:00

16 KiB

Raw Blame History

View Raw