SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
11,940 Commits 5 Branches 239 Tags
6c62cfb2eff095c181481d8ae86c7f836b65d2d7
Commit Graph

11940 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Steven Liu
f58248b824 Update task summary part 1 (#21014) 
* first draft of new task summary

* make style

* review

* apply feedback

* apply feedbacks

* final touches
 2023-01-13 11:01:53 -08:00
Arthur
95f0dd2123 [Tokenizers] Fix a small typo (#21104) 
* typo

* change name in `__repr__`

* fix my mistake
 2023-01-13 16:21:34 +01:00
Yih-Dar
b210c83a78 Fix torchscript tests for AltCLIP (#21102) 
fix torchscript tests for AltCLIP

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-01-13 10:03:19 +01:00
Yih-Dar
b3a0aad37d Fix past CI (#20967) 
* Fix for Past CI

* make style

* clean up

* unindent 2 blocks

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-01-12 18:04:21 +01:00
Stas Bekman
41b0564b35 [bnb optim] fixing test (#21030) 
* [bnb optim] fixing test

* force 1 gpu

* fix

* fix

* fix

* finalize

* improve commentary

* fix

* cleanup

* more fixes
 2023-01-12 08:52:54 -08:00
Yih-Dar
212829ade6 Remove more unused attributes in config classes (#21000) 
* Remove gradient_checkpointing from MarkupLMConfig

* Remove predict_special_tokens from OpenAIGPTConfig

* Remove enable_cls from RoCBertConfig

* Remove batch_size from TrajectoryTransformerConfig

* Remove searcher_seq_len from RealmConfig

* Remove feat_quantizer_dropout from WavLMConfig

* Remove position_biased_input from SEWDConfig

* Remove max_source_positions from Speech2Text2Config

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-01-12 13:32:04 +01:00
Susnato Dhar
b5be744d3c Fixed issue #21039 (#21062) 
Fixed issue #21039 and added test for low_cpu_mem_usage
 2023-01-12 10:03:13 +01:00
Wang, Yi
e849e5bb4a Optimize inference only mode memory if ipex is used (#21083) 
* Optimize inference only mode memory if ipex is used

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* fix code style

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
 2023-01-12 10:01:17 +01:00
zzz
6767ce71d6 fix typo in comment (#21088) 
fix typo

Signed-off-by: xiaoyang zhu <zhuxiaoyang1996@gmail.com>

Signed-off-by: xiaoyang zhu <zhuxiaoyang1996@gmail.com>
 2023-01-11 17:51:41 +01:00
Ying Zhang
64b6b2b273 Update docstring for CLIPConfig (#21066) 
Update doc for CLIPConfig
 2023-01-11 14:22:26 +01:00
Steven Liu
8f796960f6 Fix header level (#21072) 
fix header level
 2023-01-10 10:24:10 -08:00
Bharat Ramanathan
07cde58bdb feature: update wandb callback to upload checkpoints (#21035) 
* docs: add wandb metrics and model checkpointing to callback docstrings

* docs: update reference to wandb documentation

* fix: change default of `"WANDB_WATCH"` from ``"gradients"` to ``"false"`

* feature: add `on_save` method and update `"WANDB_LOG_MODEL` behaviour

* fix: use default wandb run names instead of `output_dir`

- removes duplicated run names from wandb workspace
- models can be logged with corresponding run names

* fix: edit deprecation warning based on review suggestions

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* fix: change indentation of docstrings

* fix: change indentation of docstrings and run fixup

* fix: empty commit for circleci permissions issue

* fix: format deprecation doc strings review suggestion

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* docs: Highlight WANDB_DISABLED arg in documentaion

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* fix: run fixup after updating docstrings

Co-authored-by: Bharat Ramanathan <ramanathan.parameshwaran@gohuddl.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2023-01-10 18:43:22 +01:00
KarlFelixJoehnk
a3c37825cc Make the attention_head_size in distilbert an object attribute (#20970) 
* [Fix] Make the attention head size in distilbert an object attribute

* Fix code style

Co-authored-by: Felix Joehnk <fjoehnk@N73GCH2NDH.corp.proofpoint.com>
 2023-01-09 18:17:16 +01:00
Arthur
e3ecbaa4ab Patch-past-refactor (#21050) 
* small patches, forgot a line

* refactor PT

* the actual fix
 2023-01-09 18:12:13 +01:00
Yih-Dar
48d4e147d8 remove flax file from documentation_tests.txt (#21036) 
remove flax file from `documentation_tests.txt`

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-01-08 12:33:25 +01:00
Sylvain Gugger
d0f324f1e1 Fix warning for MCTC model (#21049) 2023-01-08 10:55:23 +01:00
Sylvain Gugger
9a046cc14e Skip failing test until Athur looks at it. 2023-01-08 04:53:20 -05:00
Arthur
f0577df6de Replace past with past_key_values (#20944) 
* start cleanup

* more updates

* more models are affected

* more updates

* update generation utils

* style

* revert change that removed reorder cachce

* update generation utils

* style

* style

* remove reorder cache
 2023-01-08 10:21:40 +01:00
SABA UL HAQUE
7cb596fa22 fix typo (#21048) 
Typo fix: Corrected the word metada --> metadata
 2023-01-08 10:03:01 +01:00
Kaito Sugimoto
bd9d51263a fix typo (#21042) 2023-01-07 10:13:26 +01:00
Bartosz Szmelczynski
f93c90d217 fix levit timm conversion file (#20938) 
* fix levit timm conversion file

* remove set_defaults
 2023-01-06 13:27:30 +01:00
Ceyda Cinarel
c29bec485e fix parameter name in docstring (#21032) 2023-01-06 07:23:16 -05:00
Dudu Lasry
61e068e5a2 Support turning off the model uploading in ClearML (#20969) 
* Add support for turning off the model uploading in ClearML

* Add documentation for the CLEARML_LOG_MODEL environment variable

* Adjust new doc addition to the new style

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

Co-authored-by: Dudu Lasry <dudu.lasry@viz.ai>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
 2023-01-06 07:22:19 -05:00
Observer46
ff8dcb5efa Fix arguments passed to predict function in QA Seq2seq training script (#21026) 
fix args passed to predict function
 2023-01-06 07:19:42 -05:00
Roy Hvaara
35a7052b61 [NumPy] Remove references to deprecated NumPy type aliases (#21022) 
[NumPy] Remove references to deprecated NumPy type aliases.

This change replaces references to a number of deprecated NumPy type aliases (np.bool, np.int, np.float, np.complex, np.object, np.str) with their recommended replacement (bool, int, float, complex, object, str).

NumPy 1.24 drops the deprecated aliases, so we must remove uses before updating NumPy.

Co-authored-by: Peter Hawkins <phawkins@google.com>

Co-authored-by: Peter Hawkins <phawkins@google.com>
 2023-01-05 13:02:10 -05:00
Magnus Pierrau
1d21471c78 Added mask_time_prob and mask_time_length arguments to wav2vec2 pretraining script (#20985) 
Added mask_time_prob and mask_time_length arguments to wav2vec2 pretraining script and readme - new branch
 2023-01-05 16:24:55 +00:00
Joao Gante
bc53fc6265 Generate: FLAX uses GenerationConfig as the basis for .generate() parametrization (#21007) 2023-01-05 15:41:37 +00:00
NielsRogge
4f1c9d162e [CLIPSeg] Fix integration test (#20995) 
Fix integration test

Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
 2023-01-05 14:30:32 +01:00
Sylvain Gugger
12313838d3 Make sure dynamic objects can be saved and reloaded (#21008) 
* Make sure dynamic objects can be saved and reloaded

* Remove processor test
 2023-01-05 07:30:25 -05:00
Younes Belkada
bf82c9b74f [BLIP] Fix daily CI failing test (#20877) 2023-01-05 13:24:31 +01:00
Joao Gante
beb24f2a36 Generate: FLAX infers pad token in its absence and has functional example (#21009) 2023-01-05 11:52:58 +00:00
Joao Gante
480799f718 Generate: post-generate config TF doctest fix (#21018) 2023-01-05 11:38:37 +00:00
Steven Liu
8fb4d0e4b4 Fix callback docstrings (#21005) 
* fix callback docstrings

* format as markdown list

* apply feedback
 2023-01-04 12:59:23 -08:00
dependabot[bot]
b7417bee87 Bump gitpython from 3.0.2 to 3.1.30 in /examples/research_projects/distillation (#21011) 
Bump gitpython in /examples/research_projects/distillation

Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.0.2 to 3.1.30.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.0.2...3.1.30)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-01-04 15:36:42 -05:00
dependabot[bot]
05b736c16e Bump gitpython from 3.1.18 to 3.1.30 in /examples/research_projects/decision_transformer (#21010) 
Bump gitpython in /examples/research_projects/decision_transformer

Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.18 to 3.1.30.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.1.18...3.1.30)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-01-04 15:36:33 -05:00
Yih-Dar
94db82573e Fix (DeepSpeed) docker image build issue (#21002) 
* Fix docker image build issue

* remove comment

* Add comment

* Update docker/transformers-pytorch-deepspeed-latest-gpu/Dockerfile

Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Stas Bekman <stas00@users.noreply.github.com>
 2023-01-04 21:28:33 +01:00
Joao Gante
b91048968b Generate: Fix CI related to #20727 (#21003) 2023-01-04 20:26:56 +00:00
Sayak Paul
263fd3c4c7 add: task guide on video classification model fine-tuning. (#20827) 
* add: task guide on video classification model fine-tuning.

* apply make style from hf-formatting.

* add: toc entry.

* chore: address PR comments.

Co-authored-by Maria Khalusova

* Reflect Maria's contributions.

Co-authored-by: Maria Khalusova <1065417+MKhalusova@users.noreply.github.com>

* chore: minor correction.

* Apply suggestions from code review

Co-authored-by: Nathan Raw <nxr9266@g.rit.edu>

* PyTorch Video -> PyTorchVideo.

* Apply suggestions from code review

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* change licensing year.

* minor rewording.

* apply make style.

* address Sylvain's comments.

* replace links.

Co-authored-by: Maria Khalusova <1065417+MKhalusova@users.noreply.github.com>
Co-authored-by: Nathan Raw <nxr9266@g.rit.edu>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
 2023-01-05 00:43:40 +05:30
Steven Liu
d53f329d88 Update PR template (#21006) 
add maria to pr template
 2023-01-04 11:01:52 -08:00
Sylvain Gugger
7804177af9 Fix repo consistency 2023-01-04 14:00:45 -05:00
Sujay
15e17c99f9 Remove T5 dependency from mT5 model (#20949) 
make mt5 independent from t5
 2023-01-04 13:51:54 -05:00
Steven Liu
9dcc881fa6 Update bug report template (#21004) 
add maria to bug report
 2023-01-04 10:33:15 -08:00
Joao Gante
a6c850e4f4 Generate: TF uses GenerationConfig as the basis for .generate() parametrization (#20994) 2023-01-04 18:23:20 +00:00
milyiyo
3b309818e7 Refactor the function get_results (#20999) 2023-01-04 12:05:36 -05:00
İdil Sülo
926452298d Fix model hub link (#20998) 2023-01-04 12:04:33 -05:00
amyeroberts
56397471b4 Don't call deprecated method (#20904) 2023-01-04 16:59:11 +00:00
Alara Dirik
52c9e6af29 Fix bug in segmentation postprocessing (#20198) 
* Fix post_process_instance_segmentation
* Add test for label fusing
 2023-01-04 18:34:58 +03:00
amyeroberts
292acd71d6 Update image processor parameters if creating with kwargs (#20866) 
* Update parameters if creating with kwargs

* Shallow copy to prevent mutating input

* Pass all args in constructor dict - warnings in init

* Fix typo
 2023-01-04 14:29:48 +00:00
JeongYeon Nam
f9e977be70 auxiliary_loss works for Deformable Detr (#20959) 
fix: auxiliary_loss works

Co-authored-by: Jeongyeon Nam <jy.nam@navercorp.com>
 2023-01-04 09:01:08 -05:00
Maria Khalusova
b493fee958 Add: doc page for the object detection task (#20925) 
* Added Object Detection task guide (new branch)

* Polished code examples after running make style

* Update docs/source/en/tasks/object_detection.mdx

Rephrasing suggestion from Sayak

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/tasks/object_detection.mdx

A rephrasing suggestion from Sayak

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/tasks/object_detection.mdx

typo

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Applied reviewers suggestions
>
>
Co-authored-by: sayakpaul <spsayakpaul@gmail.com>
Co-authored-by: sgugger <sylvain.gugger@gmail.com>

* polished code examples

* Added a visualization of the inference result. Slightly changed hyperparameters, and updated the results.

* polished code examples

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update docs/source/en/tasks/object_detection.mdx

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Applying Steven's review suggestions

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* minor punctuation fix

Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>
 2023-01-04 08:36:37 -05:00