Files
HuggingFace_transformer/docs/source/en
JB (Don) dfa7b580e9 [BERT] Add support for sdpa (#28802)
* Adding SDPA support for BERT

* Using the proper input name for testing model input in inference()

* Adding documentation for SDPA in BERT model page

* Use the stable link for the documentation

* Adding a gate to only call .contiguous() for torch < 2.2.0

* Additions and fixes to the documentation

* Minor updates to documentation

* Adding extra requirements needed for the contiguous() bug

* Adding "Adapted from" in plcae of the "Copied from"

* Add benchmark speedup tables to the documentation

* Minor fixes to the documentation

* Use ClapText as a replacemenet for Bert in the Copied-From

* Some more fixes for the fix-copies references

* Overriding the test_eager_matches_sdpa_generate in bert tests to not load with low_cpu_mem_usage

[test all]

* Undo changes to separate test

* Refactored SDPA self attention code for KV projections

* Change use_sdpa to attn_implementation

* Fix test_sdpa_can_dispatch_on_flash by preparing input (required for MultipleChoice models)
2024-04-26 16:23:44 +01:00
..
2024-03-07 10:44:43 +00:00
2024-04-25 12:07:21 +01:00
2023-09-04 11:15:12 +01:00
2022-04-04 10:25:46 -04:00
2023-12-20 10:37:23 -08:00
2023-11-13 14:20:54 +01:00
2024-04-24 17:32:09 +02:00
2024-04-22 12:41:51 -07:00
2024-04-18 12:49:43 -04:00
2022-04-04 10:25:46 -04:00
2024-04-18 12:49:43 -04:00
2024-04-18 12:49:43 -04:00