SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

[FeatureExtractorSavingUtils] Refactor PretrainedFeatureExtractor (#10594)

Browse Source 
* save first version

* finish refactor

* finish refactor

* correct naming

* correct naming

* shorter names

* Update src/transformers/feature_extraction_common_utils.py

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* change name

* finish

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
This commit is contained in:
Patrick von Platen
2021-03-09 12:16:59 +03:00
committed by GitHub
parent b6a28e9ac9
commit 9a06b6b11b
10 changed files with 638 additions and 572 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
src/transformers/tokenization_utils_base.py
View File

@@ -727,8 +727,7 @@ class BatchEncoding(UserDict):
device (:obj:`str` or :obj:`torch.device`): The device to put the tensors on.
Returns:
:class:`~transformers.BatchEncoding`: The same instance of :class:`~transformers.BatchEncoding` after
modification.
:class:`~transformers.BatchEncoding`: The same instance after modification.
"""
# This check catches things like APEX blindly calling "to" on all inputs to a module