SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Add ONNX support for Longformer (#17176)

Browse Source 
* Implement ONNX support for Longformer

Fix repo consistency check complaints

Fix value mismatches

Add pooler output for default model

Increase validation atol to accommodate multiple-choice error

Fix copies

Fix chunking for longer sequence lengths

Add future comment

* Fix issue in mask_invalid_locations

* Remove torch imports in configuration_longformer

* Change config access to fix LED

* Push opset version to support tril

* Work in review comments (mostly style)

* Add Longformer to ONNX tests
This commit is contained in:
Patrick Deutschmann
2022-08-25 08:34:42 +02:00
committed by GitHub
parent c55d6e4e10
commit 3223d49354
6 changed files with 212 additions and 52 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
docs/source/en/serialization.mdx
View File

@@ -74,6 +74,7 @@ Ready-made configurations include the following architectures:
- LayoutLM
- LayoutLMv3
- LeViT
- Longformer
- LongT5
- M2M100
- Marian