Weiwe Shi efa889d2e4 Add RocBert (#20013) ...

* add roc_bert

* update roc_bert readme

* code style

* change name and delete unuse file

* udpate model file

* delete unuse log file

* delete tokenizer fast

* reformat code and change model file path

* add RocBertForPreTraining

* update docs

* delete wrong notes

* fix copies

* fix make repo-consistency error

* fix files are not present in the table of contents error

* change RocBert -> RoCBert

* add doc, add detail test

Co-authored-by: weiweishi <weiweishi@tencent.com>

2022-11-08 10:03:43 -05:00

..

benchmark

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

deepspeed

deprecate is_torch_bf16_available (#17738)

2022-06-20 08:40:11 -04:00

extended

Update self-push workflow (#17177)

2022-05-13 16:28:00 +02:00

fixtures

add a warning in SpmConverter for sentencepiece's model using the byte fallback feature (#16629)

2022-04-11 11:06:10 +02:00

generation

Generate: contrastive search with full optional outputs (#19963)

2022-11-01 18:15:36 +00:00

mixed_int8

[bnb] Minor modifications (#18631)

2022-08-17 00:48:10 +02:00

models

Add RocBert (#20013)

2022-11-08 10:03:43 -05:00

onnx

Added onnx config whisper (#19525)

2022-11-01 07:50:42 -04:00

optimization

[Test refactor 1/5] Per-folder tests reorganization (#15725)

2022-02-23 15:46:28 -05:00

pipelines

Now supporting pathlike in pipelines too. (#20030)

2022-11-03 09:14:45 +01:00

repo_utils

Repo utils test (#19696)

2022-10-18 13:47:36 -04:00

sagemaker

transformers-cli login => huggingface-cli login (#18490)

2022-08-06 09:42:55 +02:00

tokenization

fix train_new_from_iterator in the case of byte-level tokenizers (#17549)

2022-06-08 15:30:41 +02:00

trainer

Run torchdynamo tests (#19056)

2022-09-15 11:10:16 -07:00

utils

Add Image Processors (#19796)

2022-11-02 11:57:36 +00:00

__init__.py

GPU text generation: mMoved the encoded_prompt to correct device

2020-01-06 15:11:12 +01:00

test_configuration_common.py

Add WhisperModel to transformers (#19166)

2022-10-05 22:28:31 +02:00

test_feature_extraction_common.py

Add tests for legacy load by url and fix bugs (#19078)

2022-09-16 23:20:02 +02:00

test_image_transforms.py

Image transforms add center crop (#19718)

2022-10-19 16:15:01 +01:00

test_modeling_common.py

Fixed torch.finfo issue with torch.fx (#20040)

2022-11-03 16:14:44 +01:00

test_modeling_flax_common.py

Allow flax subfolder (#19902)

2022-10-26 18:33:23 +02:00

test_modeling_tf_common.py

Generate: TF contrastive search with XLA support (#20050)

2022-11-07 10:54:29 +00:00

test_sequence_feature_extraction_common.py

Some tests misusing assertTrue for comparisons fix (#16771)

2022-04-19 14:44:08 +02:00

test_tokenization_common.py

🚨 🚨 🚨 Fix Issue 15003: SentencePiece Tokenizers Not Adding Special Tokens in convert_tokens_to_string (#15775)

2022-11-02 15:45:38 -04:00