raghavanone 03ae1f060b change the way sentinel tokens can retrived (#20373) ...

* change the way sentinel tokens can retrived

* Fix line length for doc string

* Fix line length for doc string

* Add more stronger test for t5 tokenization

* Format file changes

* Make a stronger test for filtering sentinel tokens

* fix file format issues

2022-11-23 09:35:44 -05:00

..

benchmark

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

deepspeed

Fix tapas scatter (#20149)

2022-11-14 01:04:26 -05:00

extended

Update self-push workflow (#17177)

2022-05-13 16:28:00 +02:00

fixtures

add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629)

2022-04-11 11:06:10 +02:00

generation

Generate: model_kwargs can also be an input to prepare_inputs_for_generation (#20353)

2022-11-21 16:20:27 +00:00

mixed_int8

refactor test (#20300)

2022-11-17 15:59:22 +01:00

models

change the way sentinel tokens can retrived (#20373)

2022-11-23 09:35:44 -05:00

onnx

Use tiny models for ONNX tests - text modality (#20333)

2022-11-22 17:11:17 +01:00

optimization

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

pipelines

Add Audio Spectogram Transformer (#19981)

2022-11-21 18:58:54 +01:00

repo_utils

Repo utils test (#19696)

2022-10-18 13:47:36 -04:00

sagemaker

transformers-cli login => huggingface-cli login (#18490)

2022-08-06 09:42:55 +02:00

tokenization

fix train_new_from_iterator in the case of byte-level tokenizers (#17549)

2022-06-08 15:30:41 +02:00

trainer

Add AnyPrecisionAdamW optimizer (#18961)

2022-11-18 09:27:08 -05:00

utils

Enhance HfArgumentParser functionality and ease of use (#20323)

2022-11-21 12:33:37 -05:00

__init__.py

…

test_configuration_common.py

Add WhisperModel to transformers (#19166)

2022-10-05 22:28:31 +02:00

test_feature_extraction_common.py

Add tests for legacy load by url and fix bugs (#19078)

2022-09-16 23:20:02 +02:00

test_image_transforms.py

[Image Transformers] to_pil fix float edge cases (#20406)

2022-11-23 13:47:59 +01:00

test_modeling_common.py

Add Audio Spectogram Transformer (#19981)

2022-11-21 18:58:54 +01:00

test_modeling_flax_common.py

Allow flax subfolder (#19902)

2022-10-26 18:33:23 +02:00

test_modeling_tf_common.py

Generate: shorter XLA contrastive search tests (#20354)

2022-11-22 11:47:12 +00:00

test_sequence_feature_extraction_common.py

Some tests misusing assertTrue for comparisons fix (#16771)

2022-04-19 14:44:08 +02:00

test_tokenization_common.py

🚨 🚨 🚨 Fix Issue 15003: SentencePiece Tokenizers Not Adding Special Tokens in convert_tokens_to_string (#15775)

2022-11-02 15:45:38 -04:00