Joao Gante
ebc4edfe7a
update from keras2onnx to tf2onnx ( #15162 )
2022-01-14 17:35:39 +00:00
Nicolas Patry
08cb5718ec
Enabling tokenizers upgrade. ( #14941 )
...
* Enabling `tokenizers` upgrade.
* Moved ugly comment.
* Tokenizers==0.11.1 needs an update to keep borrow checker
happy in highly contiguous calls.
* Support both 0.11.1 and 0.11.0
2021-12-30 17:30:58 +01:00
Patrick von Platen
fa39ff9fc4
Docs for v4.16.0dev0
2021-12-22 20:39:44 +01:00
Patrick von Platen
05fa1a7ac1
Release: v4.15.0
Release - Conda / build_and_package (push) Has been cancelled
2021-12-22 18:43:15 +01:00
Patrick von Platen
c4a96cecbc
Wav2Vec2 meets phonemes ( #14353 )
...
* up
* add tokenizer
* improve more
* finish tokenizer
* finish
* adapt speech recognition script
* adapt convert
* more fixes
* more fixes
* update phonemizer wav2vec2
* better naming
* fix more tests
* more fixes swedish
* correct tests
* finish
* improve script
* remove file
* up
* lets get those 100 model architectures until the end of the month
* make fix-copies
* correct more
* correct script
* more fixes
* more fixes
* add to docs
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
* replace assert
* fix copies
* fix docs
* new try docs
* boom boom
* update
* add phonemizer to audio tests
* make fix-copies
* up
* upload models
* some changes
* Update tests/test_tokenization_wav2vec2_phoneme.py
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com >
* more fixes
* remove @
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com >
2021-12-17 19:56:44 +01:00
Sylvain Gugger
5061a9fd55
Post sphinx-clean up and contributing guide updates ( #14790 )
...
* Clean up sphinx
* Update contributing guide
* Update docs README
* No example title
* Fix copies
* Update CONTRIBUTING.md
Co-authored-by: Lysandre Debut <lysandre@huggingface.co >
Co-authored-by: Lysandre Debut <lysandre@huggingface.co >
2021-12-16 09:29:26 -05:00
Lysandre
7c9c41f43c
Docs for v4.14.0
2021-12-15 18:29:53 +01:00
Lysandre
960d8cb41d
Release: v4.14.0
Release - Conda / build_and_package (push) Has been cancelled
2021-12-15 18:20:35 +01:00
Lysandre
ab31b3e41b
Docs for v4.14.0dev0
2021-12-09 17:09:23 +01:00
Lysandre
4da3a696e4
Release: v4.13.0
Release - Conda / build_and_package (push) Has been cancelled
2021-12-09 16:55:21 +01:00
Patrick von Platen
961732c276
[Wav2Vec2] PyCTCDecode Integration to support language model boosted decoding ( #14339 )
...
* up
* up
* up
* make it cleaner
* correct
* make styhahalal
* add more tests
* finish
* small fix
* make style
* up
* tryout to solve cicrle ci
* up
* fix more tests
* fix more tests
* apply sylvains suggestions
* fix import
* correct docs
* add pyctcdecode only to speech tests
* fix more tests
* add tf, flax and pt tests
* add pt
* fix last tests
* fix more tests
* Apply suggestions from code review
* change lines
* Apply suggestions from code review
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com >
* correct tests
* correct tests
* add doc string
Co-authored-by: Anton Lozhkov <aglozhkov@gmail.com >
2021-12-08 12:07:54 +01:00
Stas Bekman
956a483173
[deepspeed] zero inference ( #14253 )
...
* [deepspeed] zero inference
* only z3 makes sense for inference
* fix and style
* docs
* rework
* fix test
* Apply suggestions from code review
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
* responding to suggestions
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
2021-11-23 14:09:15 -08:00
Lysandre Debut
331c3d2aa0
Add GitPython to quality tools ( #14459 )
...
* Update setup.py
* Update setup.py
* Update setup.py
* Remove GitPython install
2021-11-19 08:43:48 -05:00
Sylvain Gugger
b567510cff
Debug doc ( #14424 )
...
* Create branch for tests
* Pin first upgrade
* Really pin
* Polish fix
2021-11-16 18:58:07 -05:00
Sylvain Gugger
46d0cdae40
Support for TF >= 2.7 ( #14345 )
2021-11-09 18:49:29 -05:00
Suraj Patil
85a4bda4f4
bump flax version ( #14343 )
2021-11-09 22:15:22 +05:30
Sylvain Gugger
a14d62b0b1
Pin TF until tests are fixed ( #14283 )
...
* Pin TF until tests are fixed
* Also pin TF CPU
2021-11-04 21:15:42 -04:00
Matt
b90a48f654
Removing Keras version pinning ( #14280 )
...
* Removing Keras version pinning
* make fixup
2021-11-04 17:58:28 +00:00
Sylvain Gugger
1a674ce679
Add more instructions to the release guide ( #14263 )
...
* Add more instructions to the release guide
* Apply suggestions from code review
Co-authored-by: Lysandre Debut <lysandre@huggingface.co >
* Address review comment
Co-authored-by: Lysandre Debut <lysandre@huggingface.co >
2021-11-03 17:45:41 -04:00
Sylvain Gugger
a1c15ea855
Pin Keras cause they messed their release ( #14262 )
...
* Pin Keras cause they messed their release
* Put != instead of <
* Try this way
* Back to the beginning but more agressive
2021-11-03 15:03:09 -04:00
Sylvain Gugger
558f8543ba
Update Transformers to huggingface_hub >= 0.1.0 ( #14251 )
...
* Update Transformers to huggingface_hub >= 0.1.0
* Forgot to save...
* Style
* Fix test
2021-11-02 18:58:42 -04:00
Lysandre Debut
63d91f449c
Torch 1.10 ( #14169 )
...
* Torch 1.10
* torch scatter for 1.10
* style
* Skip tests
ok
2021-10-29 13:43:43 -04:00
Lysandre
b8fad022a0
v4.13.0.dev0
2021-10-28 12:56:46 -04:00
Lysandre
62bf536631
Release v4.12.0
Release - Conda / build_and_package (push) Has been cancelled
2021-10-28 12:09:49 -04:00
Sylvain Gugger
0f502682fb
Pin PyTorch to make CI green
2021-10-21 11:59:23 -04:00
Patrick von Platen
bdf31d6e0a
[Speech] Move all examples to new audio feature ( #14045 )
...
* up
* up
* up
* finish
2021-10-18 12:52:40 +02:00
Lysandre
11c69b8045
Docs for version v4.11.0
2021-09-27 14:19:38 -04:00
Lysandre
dc193c906d
Release: v4.11.0
Release - Conda / build_and_package (push) Has been cancelled
2021-09-27 14:14:09 -04:00
kding1
6a3a197fcd
Add SigOpt HPO to transformers trainer api ( #13572 )
...
* add sigopt hpo to transformers.
Signed-off-by: Ding, Ke <ke.ding@intel.com >
* extend sigopt changes to test code and others..
Signed-off-by: Ding, Ke <ke.ding@intel.com >
* Style.
* fix style for sigopt integration.
Signed-off-by: Ding, Ke <ke.ding@intel.com >
* Add necessary information to run unittests on SigOpt.
Co-authored-by: Morgan Funtowicz <funtowiczmo@gmail.com >
2021-09-23 17:01:51 +02:00
Stas Bekman
bec2e3f55c
[deepspeed] replaced deprecated init arg ( #13587 )
...
* [deepspeed] replaced deprecated init arg
* Trigger CI
2021-09-16 12:12:16 -07:00
elishowk
c783e14887
upgrade sentencepiece version ( #13564 )
2021-09-15 15:25:03 +02:00
Sylvain Gugger
3081d3868e
Push to hub when saving checkpoints ( #13503 )
...
* Push to hub when saving checkpoints
* Add model card
* Revert partial model card
* Small fix for checkpoint
* Add tests
* Add documentation
* Fix tests
* Bump huggingface_hub
* Fix test
2021-09-14 08:02:15 -04:00
Anurag Kumar
92d4ef9ab0
Update setup.py ( #13421 )
2021-09-06 17:32:24 -04:00
Shiv Dhar
75858ca156
Update version of packaging package ( #13454 )
2021-09-06 17:19:02 -04:00
Li-Huai (Allan) Lin
85cb447766
Revert "Correct wrong function signatures on the docs website ( #13198 )"
...
This reverts commit ffecfea949
2021-09-01 09:17:08 -04:00
Lysandre
5ee67a4412
Docs for v4.10.0
2021-08-31 16:02:31 +02:00
Lysandre
d12bbe4942
Release: v4.10.0
Release - Conda / build_and_package (push) Has been cancelled
2021-08-31 15:53:10 +02:00
Patrick von Platen
062300ba7f
[Testing] Add Flax Tests on GPU, Add Speech and Vision to Flax & TF tests ( #13313 )
...
* up
* finish
* Apply suggestions from code review
* apply Lysandres suggestions
* adapt circle ci as well
* finish
* Update setup.py
2021-08-31 11:08:22 +02:00
Olatunji Ruwase
42f359d015
Use DS callable API to allow hf_scheduler + ds_optimizer ( #13216 )
...
* Use DS callable API to allow hf_scheduler + ds_optimizer
* Preserve backward-compatibility
* Restore backward compatibility
* Tweak arg positioning
* Tweak arg positioning
* bump the required version
* Undo indent
* Update src/transformers/trainer.py
* style
Co-authored-by: Stas Bekman <stas@stason.org >
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com >
2021-08-30 10:01:06 -07:00
Li-Huai (Allan) Lin
ffecfea949
Correct wrong function signatures on the docs website ( #13198 )
...
* Correct outdated function signatures on website.
* Upgrade sphinx to 3.5.4 (latest 3.x)
* Test
* Test
* Test
* Test
* Test
* Test
* Revert unnecessary changes.
* Change sphinx version to 3.5.4"
* Test python 3.7.11
2021-08-30 11:40:25 -04:00
Will Frey
d8fb278a2c
Create py.typed ( #12893 )
...
* Create py.typed
This creates a [py.typed as per PEP 561](https://www.python.org/dev/peps/pep-0561/#packaging-type-information ) that should be distributed to mark that the package includes (inline) type annotations.
* Update setup.py
Include py.typed as package data
* Update setup.py
Call `setup(...)` with `zip_safe=False`.
2021-08-13 04:12:59 -04:00
Sylvain Gugger
2e0d767ab2
Pin sacrebleu
2021-08-10 06:27:49 -04:00
lewtun
7390d9de63
Use min version for huggingface-hub dependency ( #12961 )
...
* Use min version for huggingface-hub dependency
* Update dependency version table
2021-08-08 09:06:05 -05:00
Kevin Canwen Xu
8ff619d95e
Add multilingual documentation support ( #12952 )
...
* Add multilingual documentation support
* Add multilingual documentation support
* make style
* make style
* revert
2021-07-30 20:56:14 +08:00
Patrick von Platen
e218249b02
Pin git python to <3.10.0 ( #12858 )
...
* fix_torch_device_generate_test
* remove @
* pin git python
* make style
* typo
2021-07-23 14:16:04 +02:00
Lysandre
40de2d5a4f
Docs for v4.10.0dev0
2021-07-22 12:52:25 +02:00
Lysandre
72aee83ced
Release: v4.9.0
Release - Conda / build_and_package (push) Has been cancelled
2021-07-22 12:11:55 +02:00
Sylvain Gugger
084873b025
Only test the files impacted by changes in the diff ( #12644 )
...
* Base test
* More test
* Fix mistake
* Add a docstring change
* Add doc ignore
* Add changes
* Add recursive dep search
* Add recursive dep search
* save
* Finalize test mapping
* Fix bug
* Print prettier
* Ignore comments and empty lines
* Make script runnable from anywhere
* Need dev install
* Like that
* Adapt
* Add as artifact
* Try on torch tests
* Fix yaml error
* Install GitPython
* Apply everywhere
* Be more defensive
* Revert to all tests if something is wrong
* Install GitPython
* Test if there are tests before launching.
* Fixes
* Fixes
* Fixes
* Fixes
* Bash syntax is horrible
* Be less stupid
* Try differently
* Typo
* Typo
* Typo
* Style
* Better name
* Escape quotes
* Ignore black unhelpful re-formatting
* Not a docstring
* Deal with inits in dependency map
* Run all tests once PR is merged.
* Add last job
* Apply suggestions from code review
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com >
* Stronger dependencies gather
* Ignore empty lines too!
* Clean up
* Fix quality
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com >
2021-07-14 10:56:55 -04:00
Lysandre Debut
83f025125d
Add timeout to CI. ( #12684 )
...
* Global 60-300 seconds timeout
* Add verbose option
* [skip ci] typo
2021-07-13 15:13:18 -04:00
Stas Bekman
78f5fe1416
[Deepspeed] adapt multiple models, add zero_to_fp32 tests ( #12477 )
...
* zero_to_fp32 tests
* args change
* remove unnecessary work
* use transformers.trainer_utils.get_last_checkpoint
* document the new features
* cleanup
* wip
* fix fsmt
* add bert
* cleanup
* add xlm-roberta
* electra works
* cleanup
* sync
* split off the model zoo tests
* cleanup
* cleanup
* cleanup
* cleanup
* reformat
* cleanup
* casing
* deepspeed>=0.4.3
* adjust distilbert
* Update docs/source/main_classes/deepspeed.rst
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
* style
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com >
2021-07-13 12:07:32 -07:00
