SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

fix: typo spelling grammar (#13212)

Browse Source 
* fix: typo spelling grammar

* fix: make fixup
This commit is contained in:
arfy slowy
2021-08-30 19:09:14 +07:00
committed by GitHub
parent ef83dc4f0c
commit 01977466f4
24 changed files with 32 additions and 32 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/model_doc/deberta_v2.rst
View File

@@ -53,7 +53,7 @@ New in v2:
transformer layer to better learn the local dependency of input tokens.
- **Sharing position projection matrix with content projection matrix in attention layer** Based on previous
experiments, this can save parameters without affecting the performance.
- **Apply bucket to encode relative postions** The DeBERTa-v2 model uses log bucket to encode relative positions
- **Apply bucket to encode relative positions** The DeBERTa-v2 model uses log bucket to encode relative positions
similar to T5.
- **900M model & 1.5B model** Two additional model sizes are available: 900M and 1.5B, which significantly improves the
performance of downstream tasks.