Joshua Lochner 6e2d04e429 Fix slow GemmaTokenizer and improve SPM slow -> fast conversion process (#32191) ...

* Remove user-defined tokens which can be obtained through merges

* Remove debug line

* formatting

* Refactor spm slow -> fast converter

* revert unnecessary refactor

* set comprehension

* remove test files

* Use `vocab_scores`

* Always replace spiece underline with space in decode

* we no longer need token filtering

* Add save fast load slow unit test

* Remove tokenizers version check

* Remove duplicate code

* Make `<start_of_turn>` and `<end_of_turn>` special tokens

* Bias merge priority with length if score is the same

* Add unit test for merge priority

* CI

2024-07-30 23:36:38 +02:00

..

albert

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

align

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

altclip

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

audio_spectrogram_transformer

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

auto

Follow up for #31973 (#32025)

2024-07-25 16:12:23 +02:00

autoformer

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

bark

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

bart

Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)

2024-07-16 09:32:01 -04:00

barthez

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

bartpho

Adds pretrained IDs directly in the tests (#29534)

2024-03-13 14:53:27 +01:00

beit

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

bert

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

bert_generation

Adds pretrained IDs directly in the tests (#29534)

2024-03-13 14:53:27 +01:00

bert_japanese

Adds pretrained IDs directly in the tests (#29534)

2024-03-13 14:53:27 +01:00

bertweet

Adds pretrained IDs directly in the tests (#29534)

2024-03-13 14:53:27 +01:00

big_bird

Fix tests skip (#32012)

2024-07-17 08:37:43 +01:00

bigbird_pegasus

Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)

2024-07-16 09:32:01 -04:00

biogpt

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

bit

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

blenderbot

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

blenderbot_small

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

blip

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

blip_2

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

bloom

🚨 No more default chat templates (#31733)

2024-07-24 17:36:32 +01:00

bridgetower

Add ViTImageProcessorFast to tests (#31424)

2024-06-25 13:36:58 +01:00

bros

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

byt5

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

camembert

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

canine

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

chameleon

Generate: end-to-end compilation (#30788)

2024-07-29 10:52:13 +01:00

chinese_clip

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

clap

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

clip

Add sdpa and FA2 for CLIP (#31940)

2024-07-18 10:30:37 +05:30

clipseg

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

clvp

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

code_llama

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

codegen

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

cohere

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

conditional_detr

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

convbert

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

convnext

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

convnextv2

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

cpm

Fix PipelineTests skip conditions (#22320)

2023-03-22 20:02:24 +01:00

cpmant

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

ctrl

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

cvt

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

data2vec

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

dbrx

Generate: end-to-end compilation (#30788)

2024-07-29 10:52:13 +01:00

deberta

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

deberta_v2

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

decision_transformer

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

deformable_detr

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

deit

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

depth_anything

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

detr

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

dinat

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

dinov2

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

distilbert

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

dit

Update old existing feature extractor references (#24552)

2023-06-29 10:17:36 +01:00

donut

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

dpr

Remove static pretrained maps from the library's internals (#29112)

2024-03-25 10:33:38 +01:00

dpt

Fast image processor (#28847)

2024-06-11 15:47:38 +01:00

efficientnet

Avoid failure TFBlipModelTest::test_pipeline_image_to_text (#31827)

2024-07-08 13:49:21 +02:00

electra

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

encodec

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

encoder_decoder

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

ernie

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

esm

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

falcon

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

fastspeech2_conformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

flaubert

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

flava

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

fnet

fix: Removed duplicate field definitions in some classes (#31888)

2024-07-10 13:46:31 +01:00

focalnet

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

fsmt

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

funnel

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

fuyu

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

gemma

Fix slow GemmaTokenizer and improve SPM slow -> fast conversion process (#32191)

2024-07-30 23:36:38 +02:00

gemma2

Gemma 2: Update slow tests (#31759)

2024-07-03 11:43:44 +02:00

git

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

glpn

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

gpt2

🚨 No more default chat templates (#31733)

2024-07-24 17:36:32 +01:00

gpt_bigcode

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

gpt_neo

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

gpt_neox

Fix mask creations of GPTNeoX and GPT2 (#31944)

2024-07-23 10:11:12 +02:00

gpt_neox_japanese

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

gpt_sw3

🚨 No more default chat templates (#31733)

2024-07-24 17:36:32 +01:00

gptj

Remove static pretrained maps from the library's internals (#29112)

2024-03-25 10:33:38 +01:00

grounding_dino

Add ViTImageProcessorFast to tests (#31424)

2024-06-25 13:36:58 +01:00

groupvit

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

herbert

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

hiera

Adding hiera (#30356)

2024-07-11 22:13:56 +01:00

hubert

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

ibert

[warnings] fix E721 warnings (#32223)

2024-07-25 15:12:23 +02:00

idefics

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

idefics2

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

imagegpt

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

informer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

instructblip

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

instructblipvideo

Add video modality for InstrucBLIP (#30182)

2024-06-25 15:45:39 +05:00

jamba

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

jetmoe

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

kosmos2

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

layoutlm

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

layoutlmv2

Return assistant generated tokens mask in apply_chat_template (#30650)

2024-07-22 18:24:43 +01:00

layoutlmv3

Return assistant generated tokens mask in apply_chat_template (#30650)

2024-07-22 18:24:43 +01:00

layoutxlm

Return assistant generated tokens mask in apply_chat_template (#30650)

2024-07-22 18:24:43 +01:00

led

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

levit

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

lilt

Remove static pretrained maps from the library's internals (#29112)

2024-03-25 10:33:38 +01:00

llama

RoPE: relaxed rope validation (#32182)

2024-07-24 15:00:48 +01:00

llava

Llava: generate without images (#32183)

2024-07-26 10:17:27 +05:00

llava_next

fix: Replaced deprecated unittest method with the correct one (#32198)

2024-07-24 18:00:21 +01:00

llava_next_video

LLaVaNeXT: pad on right if training (#32134)

2024-07-23 10:23:55 +05:00

longformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

longt5

Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)

2024-07-16 09:32:01 -04:00

luke

fix: Fixed raising TypeError instead of ValueError for invalid type (#32111)

2024-07-22 17:46:17 +01:00

lxmert

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

m2m_100

Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)

2024-07-16 09:32:01 -04:00

mamba

Add torch.compile Support For Mamba (#31247)

2024-07-18 11:54:54 -04:00

marian

Mention model_info.id instead of model_info.modelId (#32106)

2024-07-22 14:14:47 +01:00

markuplm

Return assistant generated tokens mask in apply_chat_template (#30650)

2024-07-22 18:24:43 +01:00

mask2former

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

maskformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

mbart

Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)

2024-07-16 09:32:01 -04:00

mbart50

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

megatron_bert

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

megatron_gpt2

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

mgp_str

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

mistral

Tests: remove cuda versions when the result is the same 🧹🧹 (#31955)

2024-07-16 16:49:54 +01:00

mixtral

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

mluke

fix: Fixed raising TypeError instead of ValueError for invalid type (#32111)

2024-07-22 17:46:17 +01:00

mobilebert

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

mobilenet_v1

Fast image processor (#28847)

2024-06-11 15:47:38 +01:00

mobilenet_v2

Fast image processor (#28847)

2024-06-11 15:47:38 +01:00

mobilevit

Pass datasets trust_remote_code (#31406)

2024-06-17 17:29:13 +01:00

mobilevitv2

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

mpnet

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

mpt

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

mra

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

mt5

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

musicgen

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

musicgen_melody

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

mvp

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

nllb

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

nllb_moe

Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)

2024-07-16 09:32:01 -04:00

nougat

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

nystromformer

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

olmo

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

oneformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

openai

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

opt

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

owlv2

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

owlvit

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

paligemma

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

patchtsmixer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

patchtst

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

pegasus

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

pegasus_x

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

perceiver

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

persimmon

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

phi

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

phi3

Rename Phi-3 rope scaling type (#31436)

2024-07-23 12:33:22 +02:00

phobert

Adds pretrained IDs directly in the tests (#29534)

2024-03-13 14:53:27 +01:00

pix2struct

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

plbart

Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)

2024-07-16 09:32:01 -04:00

poolformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

pop2piano

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

prophetnet

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

pvt

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

pvt_v2

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

qwen2

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

qwen2_moe

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

rag

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

recurrent_gemma

fix: Removed duplicate field definitions in some classes (#31888)

2024-07-10 13:46:31 +01:00

reformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

regnet

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

rembert

SPLIT PR: add user defined symbols and control symbols (#31305)

2024-06-21 01:48:10 -07:00

resnet

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

roberta

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

roberta_prelayernorm

Fix sentence fragment within test comments (#31218)

2024-06-04 10:09:24 +01:00

roc_bert

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

roformer

Updated ruff to the latest version (#31926)

2024-07-23 17:07:31 +02:00

rt_detr

Fix RT-DETR weights initialization (#31724)

2024-07-03 14:29:02 +01:00

rwkv

RWKV: enable generation tests (#31490)

2024-06-20 14:15:01 +01:00

sam

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

seamless_m4t

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

seamless_m4t_v2

Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)

2024-07-16 09:32:01 -04:00

segformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

seggpt

Fast image processor (#28847)

2024-06-11 15:47:38 +01:00

sew

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

sew_d

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

siglip

Add FA2 and sdpa support for SigLIP (#31499)

2024-07-08 11:10:02 +01:00

speech_encoder_decoder

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

speech_to_text

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

speecht5

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

splinter

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

squeezebert

Refactor: Removed un-necessary object base class (#32230)

2024-07-26 10:33:02 +02:00

stablelm

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

starcoder2

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

superpoint

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

swiftformer

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

swin

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

swin2sr

Fix dtype casting in swinv2 and swinv2sr to allow non-FP32 inference (#31589)

2024-06-26 18:46:48 +01:00

swinv2

Fix dtype casting in swinv2 and swinv2sr to allow non-FP32 inference (#31589)

2024-06-26 18:46:48 +01:00

switch_transformers

Speedup model init on CPU (by 10x+ for llama-3-8B as one example) (#31771)

2024-07-16 09:32:01 -04:00

t5

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

table_transformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

tapas

Return assistant generated tokens mask in apply_chat_template (#30650)

2024-07-22 18:24:43 +01:00

time_series_transformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

timesformer

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

timm_backbone

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

trocr

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

tvp

Fast image processor (#28847)

2024-06-11 15:47:38 +01:00

udop

Return assistant generated tokens mask in apply_chat_template (#30650)

2024-07-22 18:24:43 +01:00

umt5

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

unispeech

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

unispeech_sat

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

univnet

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

upernet

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

video_llava

Fix video batching to videollava (#32139)

2024-07-23 13:23:23 +03:00

videomae

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

vilt

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

vipllava

fix: Replaced deprecated unittest method with the correct one (#32198)

2024-07-24 18:00:21 +01:00

vision_encoder_decoder

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

vision_text_dual_encoder

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

visual_bert

update ruff version (#30932)

2024-05-22 06:40:15 +02:00

vit

Add ViTImageProcessorFast to tests (#31424)

2024-06-25 13:36:58 +01:00

vit_mae

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

vit_msn

Rename test_model_common_attributes -> test_model_get_set_embeddings (#31321)

2024-06-07 19:40:26 +01:00

vitdet

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

vitmatte

Use self.config_tester.run_common_tests() (#31431)

2024-06-19 10:18:08 +01:00

vits

Avoid failure TFBlipModelTest::test_pipeline_image_to_text (#31827)

2024-07-08 13:49:21 +02:00

vivit

Fast image processor (#28847)

2024-06-11 15:47:38 +01:00

wav2vec2

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

wav2vec2_bert

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

wav2vec2_conformer

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

wav2vec2_phoneme

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

wav2vec2_with_lm

Pass datasets trust_remote_code (#31406)

2024-06-17 17:29:13 +01:00

wavlm

Remove trust_remote_code when loading Libri Dummy (#31748)

2024-07-23 14:54:38 +08:00

whisper

Whisper tokenizer word level timestamps (#32197)

2024-07-29 11:19:52 +01:00

x_clip

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

xglm

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

xlm

Fix 29807 sinusoidal positional encodings in Flaubert, Informer and XLM (#29904)

2024-04-02 10:27:26 +02:00

xlm_roberta

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

xlm_roberta_xl

fix accelerate tests for roberta xl (#31288)

2024-06-06 14:44:35 +01:00

xlnet

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

xmod

Fix sentence fragment within test comments (#31218)

2024-06-04 10:09:24 +01:00

yolos

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

yoso

Skip tests properly (#31308)

2024-06-26 21:59:08 +01:00

zoedepth

Add ZoeDepth (#30136)

2024-07-08 11:43:33 +02:00

__init__.py

Move test model folders (#17034)

2022-05-03 14:42:02 +02:00