Arthur 94a7edd938 [GenerationConfig] add additional kwargs handling (#21269) ...

* add additional kwargs handling

* fix issue when serializing

* correct order of kwargs removal for serialization in from dict

* add `dict_torch_dtype_to_str` in case a dtype is needed for generation

* add condition when adding the kwargs : not from config

* Add comment based on review

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* add test function

* default None when poping arg

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

2023-01-24 19:04:42 +01:00

..

benchmark

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

deepspeed

[examples/deepspeed] fix renamed api (#21283)

2023-01-24 09:54:33 -08:00

extended

[bnb optim] fixing test (#21030)

2023-01-12 08:52:54 -08:00

fixtures

add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629)

2022-04-11 11:06:10 +02:00

generation

[GenerationConfig] add additional kwargs handling (#21269)

2023-01-24 19:04:42 +01:00

mixed_int8

[t5] Fix T5 inference in float16 + bnb error (#21281)

2023-01-24 18:14:38 +01:00

models

Fix MaskFormerImageProcessor.post_process_instance_segmentation (#21256)

2023-01-24 18:49:29 +03:00

onnx

Add Onnx Config for PoolFormer (#20868)

2022-12-23 01:30:57 -05:00

optimization

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

pipelines

[ci-daily] Fix pipeline tests (#21257)

2023-01-23 19:32:49 +01:00

repo_utils

Repo utils test (#19696)

2022-10-18 13:47:36 -04:00

sagemaker

transformers-cli login => huggingface-cli login (#18490)

2022-08-06 09:42:55 +02:00

tokenization

fix train_new_from_iterator in the case of byte-level tokenizers (#17549)

2022-06-08 15:30:41 +02:00

trainer

Add AWS Neuron torchrun support (#20806)

2023-01-18 11:21:19 -05:00

utils

Fixing offline mode for pipeline (when inferring task). (#21113)

2023-01-17 15:24:40 +01:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_configuration_common.py

Add WhisperModel to transformers (#19166)

2022-10-05 22:28:31 +02:00

test_feature_extraction_common.py

Add test_image_processing_common.py (#20785)

2023-01-23 13:48:30 +00:00

test_image_processing_common.py

Add test_image_processing_common.py (#20785)

2023-01-23 13:48:30 +00:00

test_image_transforms.py

Move convert_to_rgb to image_transforms module (#20784)

2022-12-15 18:47:04 +00:00

test_modeling_common.py

Generate: save generation config with the models' .save_pretrained() (#21264)

2023-01-23 16:21:44 +00:00

test_modeling_flax_common.py

Generate: save generation config with the models' .save_pretrained() (#21264)

2023-01-23 16:21:44 +00:00

test_modeling_tf_common.py

Generate: save generation config with the models' .save_pretrained() (#21264)

2023-01-23 16:21:44 +00:00

test_sequence_feature_extraction_common.py

Some tests misusing assertTrue for comparisons fix (#16771)

2022-04-19 14:44:08 +02:00

test_tokenization_common.py

🚨 🚨 🚨 Fix Issue 15003: SentencePiece Tokenizers Not Adding Special Tokens in convert_tokens_to_string (#15775)

2022-11-02 15:45:38 -04:00