SaulLu 6667b0d7bf add warning to let the user know that the __call__ method is faster than encode + pad for a fast tokenizer (#18693) ...

* add warning to let the user know that the  method is slower that  for a fast tokenizer

* user warnings

* fix layoutlmv2

* fix layout*

* change warnings into logger.warning

2022-08-24 06:27:56 -04:00

..

benchmark

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

deepspeed

deprecate is_torch_bf16_available (#17738)

2022-06-20 08:40:11 -04:00

extended

Update self-push workflow (#17177)

2022-05-13 16:28:00 +02:00

fixtures

add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629)

2022-04-11 11:06:10 +02:00

generation

Generate: add missing **model_kwargs in sample tests (#18696)

2022-08-19 16:14:27 +01:00

mixed_int8

[bnb] Minor modifications (#18631)

2022-08-17 00:48:10 +02:00

models

add warning to let the user know that the __call__ method is faster than encode + pad for a fast tokenizer (#18693)

2022-08-24 06:27:56 -04:00

onnx

Rename second input dimension from "sequence" to "num_channels" for CV models (#17976)

2022-08-18 15:13:54 +02:00

optimization

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

pipelines

Use commit hash to look in cache instead of calling head (#18534)

2022-08-10 11:55:18 -04:00

sagemaker

transformers-cli login => huggingface-cli login (#18490)

2022-08-06 09:42:55 +02:00

tokenization

fix train_new_from_iterator in the case of byte-level tokenizers (#17549)

2022-06-08 15:30:41 +02:00

trainer

small change (#18584)

2022-08-12 20:04:38 +02:00

utils

Update feature extractor methods to enable type cast before normalize (#18499)

2022-08-17 19:57:07 +01:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_configuration_common.py

Use commit hash to look in cache instead of calling head (#18534)

2022-08-10 11:55:18 -04:00

test_feature_extraction_common.py

Use new huggingface_hub tools for download models (#18438)

2022-08-05 10:12:40 -04:00

test_modeling_common.py

Use new huggingface_hub tools for download models (#18438)

2022-08-05 10:12:40 -04:00

test_modeling_flax_common.py

Load sharded pt to flax (#18419)

2022-08-12 09:48:10 +02:00

test_modeling_tf_common.py

Use new huggingface_hub tools for download models (#18438)

2022-08-05 10:12:40 -04:00

test_sequence_feature_extraction_common.py

Some tests misusing assertTrue for comparisons fix (#16771)

2022-04-19 14:44:08 +02:00

test_tokenization_common.py

add warning to let the user know that the __call__ method is faster than encode + pad for a fast tokenizer (#18693)

2022-08-24 06:27:56 -04:00