SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
10,563 Commits 5 Branches 239 Tags
ecdf9b06bc03af272ceb8d6951e30e677fdfd35c
Commit Graph

101 Commits

Author SHA1 Message Date
Yih-Dar
ecdf9b06bc Remove cached torch_extensions on CI runners (#18868) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-09-02 18:17:58 +02:00
Yih-Dar
0ab465a5d2 pin Slack SDK to 3.18.1 to avoid failing issue (#18869) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-09-02 16:49:08 +02:00
Yih-Dar
81ab11124f Add checks for some workflow jobs (#18583) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-08-16 13:53:47 +02:00
Yih-Dar
8d634b70e0 Fix push CI artifact path (#17788) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-06-23 12:31:22 +02:00
Yih-Dar
6589e510fa Attempt to change Push CI to workflow_run (#17753) 
* Use workflow_run event for push CI

* change to workflow_run

* Add comments

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-06-18 08:35:03 +02:00
Yih-Dar
ca169dbdf1 Enable PyTorch nightly build CI (#17335) 
* nightly build pytorch CI

* fix working dir

* change time and event name

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-06-17 16:42:27 +02:00
Yih-Dar
50415b84d6 Revert "Change push CI to run on workflow_run event (#17692)" (#17717) 
This reverts commit b76290f44c.
 2022-06-15 18:42:43 +02:00
Yih-Dar
b76290f44c Change push CI to run on workflow_run event (#17692) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-06-15 17:43:31 +02:00
Yih-Dar
da0bed5f4a Pre-build DeepSpeed (#17607) 
* pre-build deepspeed

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-06-09 23:02:33 +02:00
Yih-Dar
9aa230aa2f Use latest stable PyTorch/DeepSpeed for Push & Scheduled CI (#17417) 
* update versions

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-06-07 11:53:05 +02:00
Yih-Dar
659b27fd26 Print more library versions in CI (#17384) 
* print more lib. versions and just befor test runs

* update print_env_pt.py

* rename to print_env

* Disable warning + better job name

* print python version

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-06-02 10:24:16 +02:00
Yih-Dar
0932adb3e8 Split push CI into 2 workflows (#17369) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-06-02 10:19:26 +02:00
Yih-Dar
1ac2b8fa7f Fix missing job action button in CI report (#17270) 
* use matrix.machine_type

* fix job names used in job_link

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-05-17 08:31:06 +02:00
Yih-Dar
50d1867cf8 Add PR title to push CI report (#17246) 
* add PR title to push CI report

* add link

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-05-13 21:50:40 +02:00
Yih-Dar
506899d147 Fix push CI channel (#17242) 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-05-13 20:59:56 +02:00
Yih-Dar
38043d8453 Update self-push workflow (#17177) 
* update push ci

* install git-python

* update comment

* update deepspeed jobs

* fix report

* skip 2 more tests that require fairscale

* Fix changes in test_fetcher.py (to deal with `setup.py` is changed)

* set RUN_PT_TF_CROSS_TESTS=1 and final clean-up

* remove SIGOPT_API_TOKEN

* remove echo "$matrix_folders"

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-05-13 16:28:00 +02:00
Yih-Dar
351cdbdfdc Fix self-push CI report path in cat (#17111) 
* fix report cat path

* fix report cat path

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2022-05-06 07:45:17 -07:00
Sylvain Gugger
4be8b95a9f Disable Flax GPU tests on push (#17042) 2022-05-02 10:25:53 -04:00
Stas Bekman
ce2fef2ad2 [trainer / deepspeed] fix hyperparameter_search (#16740) 
* [trainer / deepspeed] fix hyperparameter_search

* require optuna

* style

* oops

* add dep in the right place

* create deepspeed-testing dep group

* Trigger CI
 2022-04-14 17:24:38 -07:00
Lysandre Debut
eca77f4719 Updates the default branch from master to main (#16326) 
* Updates the default branch from master to main

* Links from `master` to `main`

* Typo

* Update examples/flax/README.md

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2022-03-23 03:46:59 -04:00
Suraj Patil
afca0d5192 use python 3.7 for flax self-push tests (#15865) 
* set python 3.7 for flax tests

* setup-python@v2

* python-dev

* install -y

* python3-dev

* install kenlm from source

* install cython

* cd to kenlm

* kenlm install

* don't install kenlm

* change flax pretrained to run flax tests

* cleanup

* remove python-dev
 2022-03-01 18:26:30 +01:00
Lysandre Debut
b7e292aebd Fix the push run (#15807) 2022-02-24 19:30:17 +01:00
Patrick von Platen
c4a96cecbc Wav2Vec2 meets phonemes (#14353) 
* up

* add tokenizer

* improve more

* finish tokenizer

* finish

* adapt speech recognition script

* adapt convert

* more fixes

* more fixes

* update phonemizer wav2vec2

* better naming

* fix more tests

* more fixes swedish

* correct tests

* finish

* improve script

* remove file

* up

* lets get those 100 model architectures until the end of the month

* make fix-copies

* correct more

* correct script

* more fixes

* more fixes

* add to docs

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* replace assert

* fix copies

* fix docs

* new try docs

* boom boom

* update

* add phonemizer to audio tests

* make fix-copies

* up

* upload models

* some changes

* Update tests/test_tokenization_wav2vec2_phoneme.py

Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>

* more fixes

* remove @

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
 2021-12-17 19:56:44 +01:00
Patrick von Platen
961732c276 [Wav2Vec2] PyCTCDecode Integration to support language model boosted decoding (#14339) 
* up

* up

* up

* make it cleaner

* correct

* make styhahalal

* add more tests

* finish

* small fix

* make style

* up

* tryout to solve cicrle ci

* up

* fix more tests

* fix more tests

* apply sylvains suggestions

* fix import

* correct docs

* add pyctcdecode only to speech tests

* fix more tests

* add tf, flax and pt tests

* add pt

* fix last tests

* fix more tests

* Apply suggestions from code review

* change lines

* Apply suggestions from code review

Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>

* correct tests

* correct tests

* add doc string

Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com>
 2021-12-08 12:07:54 +01:00
Stas Bekman
e62091d5a7 [CI] move env print to util, add pt, nccl versions (#14607) 
* move env print to util, add pt, nccl versions

* style

* version

* align
 2021-12-03 08:18:36 -05:00
Stas Bekman
d1fd64e7aa clear ~/.cache/torch_extensions between builds (#14520) 2021-11-25 03:15:35 -05:00
Patrick von Platen
8e20887886 Update self-push.yml (#13364) 2021-09-01 03:37:51 -04:00
Patrick von Platen
642e1936e3 [GitHub Runner] Fix flax runner (#13357) 
* correct

* also comment out multi-gpu test push
 2021-08-31 09:01:35 -04:00
Lysandre
aa08a34669 [Flax tests] NVIDIA-SMI failure should continue 2021-08-31 14:18:20 +02:00
Patrick von Platen
062300ba7f [Testing] Add Flax Tests on GPU, Add Speech and Vision to Flax & TF tests (#13313) 
* up

* finish

* Apply suggestions from code review

* apply Lysandres suggestions

* adapt circle ci as well

* finish

* Update setup.py
 2021-08-31 11:08:22 +02:00
Lysandre Debut
e2f07c01e9 Ci continue through smi failure (#13140) 
* Continue on error

* Specific

* Temporary patch
 2021-08-16 11:40:38 -04:00
Sylvain Gugger
b9962b8656 Ci last fix (#13103) 
* Only report failures on failures

* Fix typo

* Put it everywhere
 2021-08-12 10:45:06 -04:00
Sylvain Gugger
be323d5152 Reactive test fecthers on scheduled test with proper git install (#13097) 
* Reactive test fecthers on scheduled test with proper git install

* Proper fetch-depth
 2021-08-12 11:38:14 +02:00
Lysandre Debut
c89180a9de Install git (#13091) 
* Install git

* Add TF tests

* And last TF test

* Add in commented code too

Co-authored-by: Sylvain Gugger <sylvain.gugger@gmail.com>
 2021-08-11 18:09:41 +02:00
Sylvain Gugger
bfc885091b Fix last one 2021-08-10 13:48:26 -04:00
Sylvain Gugger
95e2e14f9d Revert to all tests whil we debug what's wrong (#13072) 2021-08-10 18:37:01 +02:00
Sylvain Gugger
477480ce2a Trigger GPU tests 2021-08-10 10:26:06 -04:00
Sylvain Gugger
4dd857244c Merge branch 'master' of github.com:huggingface/transformers 2021-08-10 09:40:38 -04:00
Sylvain Gugger
bd5593b6c4 Try fecthing the last two commits 2021-08-10 09:40:16 -04:00
Sylvain Gugger
9e9b8f1d99 Roll out the test fetcher on push tests (#13055) 
* Use test fetcher for push tests as well

* Force diff with last commit for circleCI on master

* Fix syntax error

* Style

* Schedule nightly tests
 2021-08-10 14:54:52 +02:00
Lysandre Debut
83f025125d Add timeout to CI. (#12684) 
* Global 60-300 seconds timeout

* Add verbose option

* [skip ci] typo
 2021-07-13 15:13:18 -04:00
Lysandre Debut
2a501ac954 Comment fast GPU TF tests (#12452) 2021-07-01 09:26:46 -04:00
Lysandre Debut
3a960c4857 Support for torch 1.9.0 (#12224) 
* Support for torch 1.9.0

* Torch scatter for 1.9.0

* Github Actions run on 1.9.0
 2021-06-17 11:29:01 -04:00
NielsRogge
d3eacbb829 Add DETR (#11653) 
* Squash all commits of modeling_detr_v7 branch into one

* Improve docs

* Fix tests

* Style

* Improve docs some more and fix most tests

* Fix slow tests of ViT, DeiT and DETR

* Improve replacement of batch norm

* Restructure timm backbone forward

* Make DetrForSegmentation support any timm backbone

* Fix name of output

* Address most comments by @LysandreJik

* Give better names for variables

* Conditional imports + timm in setup.py

* Address additional comments by @sgugger

* Make style, add require_timm and require_vision to testsé

* Remove train_backbone attribute of DetrConfig, add methods to freeze/unfreeze backbone

* Add png files to fixtures

* Fix type hint

* Add timm to workflows

* Add `BatchNorm2d` to the weight initialization

* Fix retain_grad test

* Replace model checkpoints by Facebook namespace

* Fix name of checkpoint in test

* Add user-friendly message when scipy is not available

* Address most comments by @patrickvonplaten

* Remove return_intermediate_layers attribute of DetrConfig and simplify Joiner

* Better initialization

* Scipy is necessary to get sklearn metrics

* Rename TimmBackbone to DetrTimmConvEncoder and rename DetrJoiner to DetrConvModel

* Make style

* Improve docs and add 2 community notebooks

Co-authored-by: Lysandre <lysandre.debut@reseau.eseo.fr>
 2021-06-09 11:51:13 -04:00
Lysandre
985d708842 Run the integration tests on schedule tests instead of master tests 2021-06-01 15:58:31 +02:00
Lysandre
04a9709c27 Remove datasets submodule 2021-05-31 09:18:49 +02:00
Stas Bekman
cd9b8d7efe [self-push CI] sync with self-scheduled (#11637) 
forgot to add the missing `libaio-dev` to this workflow
 2021-05-07 14:06:33 -07:00
Lysandre Debut
da37eb8e43 Reduce to 1 worker and set timeout for GPU TF tests (#11633) 2021-05-07 11:55:20 -04:00
Lysandre
e783ea7304 Fix failing workflows 2021-04-16 08:09:51 -04:00
Lysandre Debut
5254220e7f Workflow fixes (#11270) 2021-04-15 23:21:17 -04:00