SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
13,264 Commits 5 Branches 239 Tags
2898fd396831bccd71e4e7056c2ed816c4a11406
Commit Graph

2838 Commits

Author SHA1 Message Date
Yih-Dar
2898fd3968 Fix some TFWhisperModelIntegrationTests (#24428) 
* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* Update src/transformers/models/whisper/modeling_tf_whisper.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* Update src/transformers/models/whisper/modeling_tf_whisper.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* fix

* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
 2023-06-23 14:27:49 +02:00
Bowen Bao
a28325e25e Replace python random with torch.rand to enable dynamo.export (#24434) 
* Replace python random with torch.rand to enable dynamo.export

* revert changes to flax model code

* Remove unused random import

* Fix torch template

* Move torch.manual_seed(0) to right location
 2023-06-23 08:17:21 -04:00
Alex Hall
b6295b26c5 Refactor hyperparameter search backends (#24384) 
* Refactor hyperparameter search backends

* Simpler refactoring without abstract base class

* black

* review comments:
specify name in class
use methods instead of callable class attributes
name constant better

* review comments: safer bool checking, log multiple available backends

* test ALL_HYPERPARAMETER_SEARCH_BACKENDS vs HPSearchBackend in unit test, not module. format with black.

* copyright
 2023-06-22 14:28:25 -04:00
Younes Belkada
3ce3385c47 Revert "Fix gradient checkpointing + fp16 autocast for most models" (#24420) 
Revert "Fix gradient checkpointing + fp16 autocast for most models (#24247)"

This reverts commit 285a48011d.
 2023-06-22 16:11:27 +02:00
Yih-Dar
652ece0710 Skip test_conditional_generation_pt_pix2struct in Past CI (torch < 1.11) (#24417) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-22 15:34:13 +02:00
Matthijs Hollemans
cd927a4736 add word-level timestamps to Whisper (#23205) 
* let's go!

* initial implementation of token-level timestamps

* only return a single timestamp per token

* remove token probabilities

* fix return type

* fix doc comment

* strip special tokens

* rename

* revert to not stripping special tokens

* only support models that have alignment_heads

* add integration test

* consistently name it token-level timestamps

* small DTW tweak

* initial support for ASR pipeline

* fix pipeline doc comments

* resolve token timestamps in pipeline with chunking

* change warning when no final timestamp is found

* return word-level timestamps

* fixup

* fix bug that skipped final word in each chunk

* fix failing unit tests

* merge punctuations into the words

* also return word tokens

* also return token indices

* add (failing) unit test for combine_tokens_into_words

* make combine_tokens_into_words private

* restore OpenAI's punctuation rules

* add pipeline tests

* make requested changes

* PR review changes

* fix failing pipeline test

* small stuff from PR

* only return words and their timestamps, not segments

* move alignment_heads into generation config

* forgot to set alignment_heads in pipeline tests

* tiny comment fix

* grr
 2023-06-21 17:48:21 +02:00
Younes Belkada
285a48011d Fix gradient checkpointing + fp16 autocast for most models (#24247) 
* fix gc bug

* continue PoC on OPT

* fixes

* 🤯

* fix tests

* remove pytest.mark

* fixup

* forward contrib credits from discussions

* forward contrib credits from discussions

* reverting changes on untouched files.

---------

Co-authored-by: zhaoqf123 <zhaoqf123@users.noreply.github.com>
Co-authored-by: 7eu7d7 <7eu7d7@users.noreply.github.com>
 2023-06-21 17:04:59 +02:00
Joao Gante
5f0801d174 Generate: add SequenceBiasLogitsProcessor (#24334) 2023-06-21 11:14:41 +01:00
Sylvain Gugger
eb849f6604 Migrate doc files to Markdown. (#24376) 
* Rename index.mdx to index.md

* With saved modifs

* Address review comment

* Treat all files

* .mdx -> .md

* Remove special char

* Update utils/tests_fetcher.py

Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>

---------

Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
 2023-06-20 18:07:47 -04:00
Patrick von Platen
b0513b013b [Wav2Vec2 - MMS] Correct directly loading adapters weights (#24335) 
* Correct direct lang loading

* correct more

* revert black

* Use tie weights instead=

* add tests

* add tests

* make style
 2023-06-20 19:39:52 +02:00
Arthur
e5c760d636 [GPTNeoX] Nit in config (#24349) 
* add raise value error for attention size

* nits to fix test_config

* style
 2023-06-20 19:19:19 +02:00
Yih-Dar
83dc5762e7 Skip a tapas (tokenization) test in past CI (#24378) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-20 18:35:45 +02:00
Yih-Dar
297d769d0e Better test name and enable pipeline test for pix2struct (#24377) 
* best test name forever

* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-20 18:29:30 +02:00
Yih-Dar
0527c1c0ea Add a check in ImageToTextPipeline._forward (#24373) 
* fix

* fix

* fix

* Update src/transformers/pipelines/image_to_text.py

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
 2023-06-20 18:07:34 +02:00
Sylvain Gugger
dc4449918d Rename test to be more accurate (#24374) 2023-06-20 11:54:55 -04:00
Sanchit Gandhi
6c1344444a [Whisper] Make tests faster (#24105) 2023-06-20 16:01:56 +01:00
Yih-Dar
c23d131eab Update tiny models for pipeline testing. (#24364) 
* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-20 14:43:10 +02:00
Matt
56efbf4301 TensorFlow CI fixes (#24360) 
* Fix saved_model_creation_extended

* Skip the BLIP model creation test for now

* Fix TF SAM test

* Fix longformer tests

* Fix Wav2Vec2

* Add a skip for XLNet

* make fixup

* make fix-copies

* Add comments
 2023-06-20 12:59:21 +01:00
Matt
9138995025 Add test for proper TF input signatures (#24320) 
* Add test for proper input signatures

* No more signature pruning

* Test the dummy inputs are valid too

* fine-tine -> fine-tune

* Fix indent in test_dataset_conversion
 2023-06-16 17:03:13 +01:00
Sylvain Gugger
096f2cf126 Tied weights load (#24310) 
* Use tied weight keys

* More

* Fix tied weight missing warning

* Only give info on unexpected keys with different classes

* Deal with empty archs

* Fix tests

* Refine test
 2023-06-16 10:55:42 -04:00
Matt
3403712958 Big TF test cleanup (#24282) 
* Fix one BLIP arg not being optional, remove misspelled arg

* Remove the lxmert test overrides and just use the base test_saved_model_creation

* saved_model_creation fixes and re-enabling tests across the board

* Remove unnecessary skip

* Stop caching sinusoidal embeddings in speech_to_text

* Fix transfo_xl compilation

* Fix transfo_xl compilation

* Fix the conditionals in xglm

* Set the save spec only when building

* Clarify comment

* Move comment correctly

* Correct embeddings generation for speech2text

* Mark RAG generation tests as @slow

* Remove redundant else:

* Add comment to clarify the save_spec line in build()

* Fix size tests for XGLM at last!

* make fixup

* Remove one band_part operation

* Mark test_keras_fit as @slow
 2023-06-16 15:40:49 +01:00
Yih-Dar
896a58de15 Byebye pytorch 1.9 (#24080) 
byebye

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-16 16:38:23 +02:00
Matt
62d71f4083 Fix functional TF Whisper and modernize tests (#24301) 
* Revert whisper change and modify the test_compile_tf_model test

* make fixup

* Tweak test slightly

* Add functional model saving to test

* Ensure TF can infer shapes for data2vec

* Add override for efficientformer

* Mark test as slow
 2023-06-16 14:43:43 +01:00
Sanchit Gandhi
4124a09f8b [EnCodec] Changes for 32kHz ckpt (#24296) 
* [EnCodec] Changes for 32kHz ckpt

* Update src/transformers/models/encodec/convert_encodec_checkpoint_to_pytorch.py

* Update src/transformers/models/encodec/convert_encodec_checkpoint_to_pytorch.py
 2023-06-15 14:36:19 +01:00
amyeroberts
e6122c3f40 Fix image segmentation tool bug (#23897) 
* Image segmentation tool bug

* Remove resizing in the tests
 2023-06-15 08:09:31 -04:00
Sylvain Gugger
372f50030b Split common test from core tests (#24284) 2023-06-15 07:30:24 -04:00
Matthijs Hollemans
0c3fdccf2f [WIP] add EnCodec model (#23655) 
* boilerplate stuff

* messing around with the feature extractor

* fix feature extractor

* unit tests for feature extractor

* rename speech to audio

* quick-and-dirty import of Meta's code

* import weights (sort of)

* cleaning up

* more cleaning up

* move encoder/decoder args into config

* cleanup model

* rename EnCodec -> Encodec

* RVQ parameters in config

* add slow test

* add lstm init and test_init

* Add save & load

* finish EncodecModel

* remove decoder_input_values as they are ont used anywhere (not removed from doc yet)

* fix test feature extraction model name

* Add better slow test

* Fix tests

* some fixup and cleaning

* Improve further

* cleaning up quantizer

* fix up conversion script

* test don't pass, _encode_fram does not work

* update tests with output per encode and decode

* more cleanup

* rename _codebook

* remove old config cruft

* ratios & hop_length

* use ModuleList instead of Sequential

* clean up resnet block

* update types

* update tests

* fixup

* quick cleanup

* fix padding

* more styl,ing

* add patrick feedback

* fix copies

* fixup

* fix lstm

* fix shape issues

* fixup

* rename conv layers

* fixup

* fix decoding

* small conv refactoring

* remove norm_params

* simplify conv layers

* rename conv layers

* stuff

* Clean up

* Add padding logic

use padding mask

small conv refactoring

remove norm_params

simplify conv layers

rename conv layers

stuff

add batched test

update

Clean up

merge and update for padding

fix padding

fixup

* clean up more

* clean up more

* More clean ups

* cleanup convolutions

* typo

* fix typos

* fixup

* build PR doc?

* start refactoring docstring

* fix don't pad when no strid and chunk

* update docstring

* update docstring

* nits

* update going to lunch

* update config and model

* fix broken testse (becaue of the config changes)

* fix scale computation

* fixu[

* only return dict if speciefied or if config returns it

* remove todos

* update defaults in config

* update conversion script

* fix doctest

* more docstring + fixup

* nits on batched_tests

* more nits

* Apply suggestions from code review

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* update basxed on review

* fix update

* updaet tests

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* fixup

* add overlap and chunl_length_s

* cleanup feature extraction

* teste edge cases truncation and padding

* correct processor values

* update config encodec, nits

* fix tests

* fixup

* fix 24Hz test

* elle tests are green

* fix fixup

* Apply suggestions from code review

* revert readme changes

* fixup

* add example

* use facebook checkpoints

* fix typo

* no pipeline tests

* use slef.pad everywhere we can

* Apply suggestions from code review

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* update based on review

* update

* update mdx

* fix bug and tests

* fixup

* fix doctest

* remove comment

* more nits

* add more coverage for `test_truncation_and_padding`

* fixup

* add last test

* fix text

* nits

* Update tests/models/encodec/test_modeling_encodec.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* take care of the last comments

* typo

* fix test

* nits

* fixup

* Update src/transformers/models/encodec/feature_extraction_encodec.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

---------

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: arthur.zucker@gmail.com <arthur.zucker@gmail.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
 2023-06-14 18:57:23 +02:00
Yih-Dar
a04ebc8b33 Pix2StructImageProcessor requires torch>=1.11.0 (#24270) 
* fix

* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-14 17:05:40 +02:00
Joao Gante
4626df5077 TF: CTRL with native embedding layers (#23456) 2023-06-14 14:39:02 +01:00
Yih-Dar
eac8dede83 Skip some TQAPipelineTests tests in past CI (#24267) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-14 14:25:24 +02:00
Yih-Dar
233113149b Skip GPT-J fx tests for torch < 1.12 (#24256) 
* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-13 20:33:26 +02:00
Matt
3bd1fe4315 Stop storing references to bound methods via tf.function (#24146) 
* Stop storing references to bound methods in tf.functions

* Remove the gc.collect calls now that we resolved the underlying problem

* Remove the default signature from model.serving entirely, big cleanup

* Remove _prune_signature as self.input_signature can prune itself

* Restore serving docstring

* Update int support test to check the input signature

* Make sure other tests also use model.input_signature and not serving.input_signature

* Restore _prune_signature

* Remove the doctest GC now it's no longer needed

* Correct core tests to use the pruned sig

* order lines correctly in core tests

* Add eager_serving back with a deprecation warning
 2023-06-13 19:04:22 +01:00
Yih-Dar
cf561d7cf1 Add torch >=1.12 requirement for Tapas (#24251) 
* fix

* fix

* fix

* Update src/transformers/models/tapas/modeling_tapas.py

Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
 2023-06-13 19:19:40 +02:00
Joao Gante
b1ea6b4bf5 Generate: GenerationConfig can overwrite attributes at from_pretrained time (#24238) 
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>
 2023-06-13 17:59:21 +01:00
Joao Gante
7bb6933b9d TF: standardize test_model_common_attributes for language models (#23457) 2023-06-13 17:51:37 +01:00
Sylvain Gugger
695928e1e5 Tied params cleanup (#24211) 
* First test

* Add info for all models

* style

* Repo consistency

* Fix last model and cleanup prints

* Repo consistency

* Use consistent function for detecting tied weights
 2023-06-13 11:38:39 -04:00
Yih-Dar
74b846cacf Update (TF)SamModelIntegrationTest (#24199) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-13 14:28:14 +02:00
Yih-Dar
4fe9716a79 Skip RWKV test in past CI (#24204) 
* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-12 18:14:15 +02:00
Zach Mueller
ebd94b0f6f 🚨🚨🚨 Replace DataLoader logic for Accelerate in Trainer, remove unneeded tests 🚨🚨🚨 (#24028) 
* Working integration

* Fix failing test

* Revert label host logic

* Bring it back!
 2023-06-12 11:23:37 -04:00
Yih-Dar
dadc9fb427 Update GPTNeoXLanguageGenerationTest (#24193) 
* fix

* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-12 15:37:12 +02:00
Yih-Dar
e26c6f03be Fix Wav2Vec2 CI OOM (#24190) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-12 11:39:04 +02:00
Stas Bekman
0d217f428f [tests] fix bitsandbytes import issue (#24151) 
fix bitsandbytes import issue
 2023-06-09 21:53:11 -07:00
Lysandre Debut
deff5979fe Tool types (#24032) 
* Tool types

* Tests + fixes

* Isolate types

* Oops

* Review comments + docs

* Tests + docs

* soundfile -> vision
 2023-06-09 13:34:07 -04:00
Yih-Dar
d0d1632958 Fix Pipeline CI OOM issue (#24124) 
* fix

* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-09 16:49:02 +02:00
Younes Belkada
62fe753325 [SAM] Fix sam slow test (#24140) 
* fix sam test

* update pipeline typehint
 2023-06-09 16:22:09 +02:00
Yih-Dar
847b47c0ee Fix XGLM OOM on CI (#24123) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-09 15:20:59 +02:00
Yih-Dar
b8fe259f16 Fix SAM OOM issue on CI (#24125) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-09 15:07:08 +02:00
Yih-Dar
707023d155 Fix TF Rag OOM issue (#24122) 
fix

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-09 15:03:11 +02:00
Younes Belkada
a6d05d55f6 [bnb] Fix bnb config json serialization (#24137) 
* fix bnb config json serialization

* forward contrib credits from discussions

---------

Co-authored-by: Andrechang <Andrechang@users.noreply.github.com>
 2023-06-09 13:41:14 +02:00
Yih-Dar
2e2088f24b Avoid GPT-2 daily CI job OOM (in TF tests) (#24106) 
* fix

* fix

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
 2023-06-08 18:21:09 +02:00