SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Bug fix for modeling utilities function: apply_chunking_to_forward, chunking should be in the chunking dimension, an exception was raised if the complete shape of the inputs was not the same rather than only the chunking dimension (#8391)

Browse Source 
Co-authored-by: pedro <pe25171@mit.edu>
This commit is contained in:
Pedro
2020-11-10 15:33:11 -05:00
committed by GitHub
parent 70708cca1a
commit eb3bd73ce3
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
src/transformers/modeling_utils.py
View File

@@ -1668,9 +1668,9 @@ def apply_chunking_to_forward(
""" """
assert len(input_tensors) > 0, "{} has to be a tuple/list of tensors".format(input_tensors) assert len(input_tensors) > 0, "{} has to be a tuple/list of tensors".format(input_tensors)
tensor_shape = input_tensors[0].shape tensor_shape = input_tensors[0].shape[chunk_dim]
assert all( assert all(
input_tensor.shape == tensor_shape for input_tensor in input_tensors input_tensor.shape[chunk_dim] == tensor_shape for input_tensor in input_tensors
), "All input tenors have to be of the same shape" ), "All input tenors have to be of the same shape"
# inspect.signature exist since python 3.5 and is a python method -> no problem with backward compatibility # inspect.signature exist since python 3.5 and is a python method -> no problem with backward compatibility