SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Avoid OOM in doctest CI (#24139)

Browse Source 
* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
This commit is contained in:
Yih-Dar
2023-06-10 09:47:38 +02:00
committed by GitHub
parent 0d217f428f
commit 8f093fb799
1 changed files with 9 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
src/transformers/testing_utils.py
View File

@@ -1870,9 +1870,18 @@ def preprocess_string(string, skip_cuda_tests):
): ):
is_cuda_found = True is_cuda_found = True
break break
modified_string = "" modified_string = ""
if not is_cuda_found: if not is_cuda_found:
modified_string = "".join(codeblocks) modified_string = "".join(codeblocks)
if ">>>" in modified_string:
lines = modified_string.split("\n")
indent = len(lines[-1]) - len(lines[-1].lstrip())
cleanup = ">>> import gc; gc.collect() # doctest: +IGNORE_RESULT"
modified_string += "\n" + " " * indent + cleanup
return modified_string return modified_string