SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

TF GPU CI (#3085)

Browse Source 
* debug env

* Restrict TF GPU memory

* Fixup

* One more test

* rm debug logs

* Fixup
This commit is contained in:
Julien Chaumond
2020-03-02 15:45:25 -05:00
committed by GitHub
parent d3eb7d23a4
commit f169957d0c
5 changed files with 35 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
utils/link_tester.py
View File

@@ -14,6 +14,9 @@ import requests
REGEXP_FIND_S3_LINKS = r"""([\"'])(https:\/\/s3)(.*)?\1"""
S3_BUCKET_PREFIX = "https://s3.amazonaws.com/models.huggingface.co/bert"
def list_python_files_in_repository():
""" List all python files in the repository.
@@ -36,7 +39,7 @@ def find_all_links(file_paths):
for path in file_paths:
links += scan_code_for_links(path)
return links
return [link for link in links if link != S3_BUCKET_PREFIX]
def scan_code_for_links(source):