SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[prophetnet] wrong import (#9349)

Browse Source 
```
python -c "from apex.normalization import FusedProphetNetLayerNorm"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ImportError: cannot import name 'FusedProphetNetLayerNorm' from 'apex.normalization' (/home/stas/anaconda3/envs/main-38/lib/python3.8/site-packages/apex/normalization/__init__.py)
```
It looks like this code has never been tested, so it silently fails inside try/except.

Discovered this by accident in https://github.com/huggingface/transformers/issues/9338#issuecomment-752217708
This commit is contained in:
Stas Bekman
2020-12-29 13:32:07 -08:00
committed by GitHub
parent 912f6881d2
commit 8217d4e37f
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
src/transformers/models/prophetnet/modeling_prophetnet.py
View File

@@ -513,9 +513,9 @@ class ProphetNetDecoderLMOutput(ModelOutput):
def ProphetNetLayerNorm(normalized_shape, eps=1e-5, elementwise_affine=True): def ProphetNetLayerNorm(normalized_shape, eps=1e-5, elementwise_affine=True):
if torch.cuda.is_available(): if torch.cuda.is_available():
try: try:
from apex.normalization import FusedProphetNetLayerNorm from apex.normalization import FusedLayerNorm
return FusedProphetNetLayerNorm(normalized_shape, eps, elementwise_affine) return FusedLayerNorm(normalized_shape, eps, elementwise_affine)
except ImportError: except ImportError:
pass pass
return torch.nn.LayerNorm(normalized_shape, eps, elementwise_affine) return torch.nn.LayerNorm(normalized_shape, eps, elementwise_affine)