Arthur 19d58d31f1 Add MLLama (#33703) ...

* current changes

* nit

* Add cross_attenttion_mask to processor

* multi-image fixed

* Add cross_attenttion_mask to processor

* cross attn works in all cases

* WIP refactoring function for image processor

* WIP refactoring image processor functions

* Refactor preprocess to use global loops instead of list nested list comps

* Docstrings

* Add channels unification

* fix dtype issues

* Update docsrings and format

* Consistent max_image_tiles

* current script

* updates

* Add convert to rgb

* Add image processor tests

* updates!

* update

* god damn it I am dumb sometimes

* Precompute aspect ratios

* now this works, full match

* fix 😉

* nits

* style

* fix model and conversion

* nit

* nit

* kinda works

* hack for sdpa non-contiguous bias

* nits here and there

* latest c hanges

* merge?

* run forward

* Add aspect_ratio_mask

* vision attention mask

* update script and config variable names

* nit

* nits

* be able to load

* style

* nits

* there

* nits

* make forward run

* small update

* enable generation multi-turn

* nit

* nit

* Clean up a bit for errors and typos

* A bit more constant fixes

* 90B keys and shapes match

* Fix for 11B model

* Fixup, remove debug part

* Docs

* Make max_aspect_ratio_id to be minimal

* Update image processing code to match new implementation

* Adjust conversion for final checkpoint state

* Change dim in repeat_interleave (accordig to meta code)

* tmp fix for num_tiles

* Fix for conversion (gate<->up, q/k_proj rope permute)

* nits

* codestyle

* Vision encoder fixes

* pass cross attn mask further

* Refactor aspect ratio mask

* Disable text-only generation

* Fix cross attention layers order, remove q/k norm rotation for cross atention layers

* Refactor gated position embeddings

* fix bugs but needs test with new weights

* rope scaling should be llama3

* Fix rope scaling name

* Remove debug for linear layer

* fix copies

* Make mask prepare private func

* Remove linear patch embed

* Make precomputed embeddings as nn.Embedding module

* MllamaPrecomputedAspectRatioEmbedding with config init

* Remove unused self.output_dim

* nit, intermediate layers

* Rename ln and pos_embed

* vision_chunk_size -> image_size

* return_intermediate -> intermediate_layers_indices

* vision_input_dim -> hidden_size

* Fix copied from statements

* fix most tests

* Fix more copied from

* layer_id->layer_idx

* Comment

* Fix tests for processor

* Copied from for _prepare_4d_causal_attention_mask_with_cache_position

* Style fix

* Add MllamaForCausalLM

* WIP fixing tests

* Remove duplicated layers

* Remove dummy file

* Fix style

* Fix consistency

* Fix some TODOs

* fix language_model instantiation, add docstring

* Move docstring, remove todos for precomputed embeds (we cannot init them properly)

* Add initial docstrings

* Fix

* fix some tests

* lets skip these

* nits, remove print, style

* Add one more copied from

* Improve test message

* Make validate func private

* Fix dummy objects

* Refactor `data_format` a bit + add comment

* typos/nits

Co-authored-by: Pablo Montalvo <39954772+molbap@users.noreply.github.com>

* fix dummy objects and imports

* Add chat template config json

* remove num_kv_heads from vision attention

* fix

* move some commits and add more tests

* fix test

* Remove `update_key_name` from modeling utils

* remove num-kv-heads again

* some prelimiary docs

* Update chat template + tests

* nit, conversion script max_num_tiles from params

* Fix warning for text-only generation

* Update conversion script for instruct models

* Update chat template in converstion + test

* add tests for CausalLM model

* model_max_length, avoid null chat_template

* Refactor conversion script

* Fix forward

* Fix integration tests

* Refactor vision config + docs

* Fix default

* Refactor text config

* Doc fixes

* Remove unused args, fix docs example

* Squashed commit of the following:

commit b51ce5a2efffbecdefbf6fc92ee87372ec9d8830
Author: qubvel <qubvel@gmail.com>
Date:   Wed Sep 18 13:39:15 2024 +0000

    Move model + add output hidden states and output attentions

* Fix num_channels

* Add mllama text and mllama vision models

* Fixing repo consistency

* Style fix

* Fixing repo consistency

* Fixing unused config params

* Fix failed tests after refactoring

* hidden_activation -> hidden_act  for text mlp

* Remove from_pretrained from sub-configs

* Apply suggestions from code review

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Update src/transformers/models/mllama/convert_mllama_weights_to_hf.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Reuse lambda in conversion script

* Remove run.py

* Update docs/source/en/model_doc/mllama.md

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Update src/transformers/models/mllama/processing_mllama.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Remove unused LlamaTokenizerFast

* Fix logging

* Refactor gating

* Remove cycle for collecting intermediate states

* Refactor text-only check, add integration test for text-only

* Revert from pretrained to configs

* Fix example

* Add auto `bos_token` adding in processor

* Fix tips

* Update src/transformers/models/auto/tokenization_auto.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Enable supports_gradient_checkpointing model flag

* add eager/sdpa options

* don't skip attn tests and bring back GC skips (did i really remove those?)

* Fix signature, but get error with None gradient

* Fix output attention tests

* Disable GC back

* Change no split modules

* Fix dropout

* Style

* Add Mllama to sdpa list

* Add post init for vision model

* Refine config for MllamaForCausalLMModelTest and skipped tests for CausalLM model

* if skipped, say it, don't pass

* Clean vision tester config

* Doc for args

* Update tests/models/mllama/test_modeling_mllama.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* Add cross_attention_mask to test

* typehint

* Remove todo

* Enable gradient checkpointing

* Docstring

* Style

* Fixing and skipping some tests for new cache

* Mark flaky test

* Skip `test_sdpa_can_compile_dynamic` test

* Fixing some offload tests

* Add direct GenerationMixin inheritance

* Remove unused code

* Add initializer_range to vision config

* update the test to make sure we show if split

* fix gc?

* Fix repo consistency

* Undo modeling utils debug changes

* Fix link

* mllama -> Mllama

* [mllama] -> [Mllama]

* Enable compile test for CausalLM model (text-only)

* Fix TextModel prefix

* Update doc

* Docs for forward, type hints, and vision model prefix

* make sure to reset

* fix init

* small script refactor and styling

* nit

* updates!

* some nits

* Interpolate embeddings for 560 size and update integration tests

* nit

* does not suppor static cache!

* update

* fix

* nit2

* this?

* Fix conversion

* Style

* 4x memory improvement with image cache AFAIK

* Token decorator for tests

* Skip failing tests

* update processor errors

* fix split issues

* style

* weird

* style

* fix failing tests

* update

* nit fixing the whisper tests

* fix path

* update

---------

Co-authored-by: raushan <raushan@huggingface.co>
Co-authored-by: pavel <ubuntu@ip-10-90-0-11.ec2.internal>
Co-authored-by: qubvel <qubvel@gmail.com>
Co-authored-by: Pablo Montalvo <39954772+molbap@users.noreply.github.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

2024-09-25 19:56:25 +02:00

..

albert.md

Add sdpa support for Albert (#32092)

2024-09-03 14:01:00 +01:00

align.md

Uniformize kwargs for image-text-to-text processors (#32544)

2024-09-24 21:28:19 -04:00

altclip.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

audio-spectrogram-transformer.md

add sdpa to ViT [follow up of #29325] (#30555)

2024-05-16 10:56:11 +01:00

auto.md

SuperPointModel -> SuperPointForKeypointDetection (#29757)

2024-03-20 15:41:03 +00:00

autoformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

bark.md

F.scaled_dot_product_attention support (#26572)

2023-12-09 05:38:14 +09:00

bart.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

barthez.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

bartpho.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

beit.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

bert-generation.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

bert-japanese.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

bert.md

[BERT] Add support for sdpa (#28802)

2024-04-26 16:23:44 +01:00

bertweet.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

big_bird.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

bigbird_pegasus.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

biogpt.md

Add sdpa for BioGpt (#33592)

2024-09-20 14:27:32 +01:00

bit.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

blenderbot-small.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

blenderbot.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

blip-2.md

🚨 Add Blip2ForImageTextRetrieval (#29261)

2024-08-27 18:50:27 +01:00

blip.md

Blip: Deprecate BlipModel (#31235)

2024-06-04 18:29:45 +02:00

bloom.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

bort.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

bridgetower.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

bros.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

byt5.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

camembert.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

canine.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

chameleon.md

Enable BNB multi-backend support (#31098)

2024-09-24 03:40:56 -06:00

chinese_clip.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

clap.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

clip.md

Add sdpa and FA2 for CLIP (#31940)

2024-07-18 10:30:37 +05:30

clipseg.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

clvp.md

Add CLVP (#24745)

2023-11-10 13:49:10 +00:00

code_llama.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

codegen.md

Add token type ids to CodeGenTokenizer (#29265)

2024-04-17 12:19:18 +02:00

cohere.md

Cohere Model Release (#29622)

2024-03-15 14:29:11 +01:00

conditional_detr.md

Add examples for detection models finetuning (#30422)

2024-05-08 11:42:07 +01:00

convbert.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

convnext.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

convnextv2.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

cpm.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

cpmant.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

ctrl.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

cvt.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

dac.md

Add Descript-Audio-Codec model (#31494)

2024-08-19 10:21:51 +01:00

data2vec.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

dbrx.md

Follow up: Fix link in dbrx.md (#30514)

2024-05-27 14:57:43 +02:00

deberta-v2.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

deberta.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

decision_transformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

deformable_detr.md

Add examples for detection models finetuning (#30422)

2024-05-08 11:42:07 +01:00

deit.md

add sdpa to ViT [follow up of #29325] (#30555)

2024-05-16 10:56:11 +01:00

deplot.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

depth_anything_v2.md

Depth Anything: update conversion script for V2 (#31522)

2024-07-05 19:28:41 +01:00

depth_anything.md

Depth Anything: update conversion script for V2 (#31522)

2024-07-05 19:28:41 +01:00

deta.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

detr.md

Fixed typo repeated word in DETR docs (#33250)

2024-09-02 17:19:18 +02:00

dialogpt.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

dinat.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

dinov2.md

Add Flax Dinov2 (#31960)

2024-08-19 09:28:13 +01:00

distilbert.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

dit.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

donut.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

dpr.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

dpt.md

[DPT, Dinov2] Add resources (#27655)

2023-11-23 17:44:08 +00:00

efficientformer.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

efficientnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

electra.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

encodec.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

encoder-decoder.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

ernie_m.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

ernie.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

esm.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

falcon_mamba.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

falcon.md

Add proper Falcon docs and conversion script (#25954)

2023-09-04 17:18:34 +01:00

fastspeech2_conformer.md

Super tiny fix 12 typos about "with with" (#29926)

2024-03-29 14:31:31 +00:00

flan-t5.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

flan-ul2.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

flaubert.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

flava.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

fnet.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

focalnet.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

fsmt.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

funnel.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

fuyu.md

Uniformize kwargs for image-text-to-text processors (#32544)

2024-09-24 21:28:19 -04:00

gemma2.md

Gemma2: add cache warning (#32279)

2024-08-07 10:03:05 +05:00

gemma.md

Add TokenClassification for Mistral, Mixtral and Qwen2 (#29878)

2024-05-20 10:06:57 +02:00

git.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

glpn.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

gpt2.md

[GPT2] Add SDPA support (#31172)

2024-06-19 09:40:57 +02:00

gpt_bigcode.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

gpt_neo.md

F.scaled_dot_product_attention support (#26572)

2023-12-09 05:38:14 +09:00

gpt_neox_japanese.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

gpt_neox.md

[GPT-NeoX] Add SDPA support (#31031)

2024-06-26 13:56:36 +01:00

gpt-sw3.md

Fix paths to AI Sweden Models reference and model loading (#28423)

2024-01-15 09:09:22 +01:00

gptj.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

gptsan-japanese.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

granite.md

Granite language models (#31502)

2024-08-27 21:27:21 +02:00

granitemoe.md

Granitemoe (#33207)

2024-09-21 01:43:50 +02:00

graphormer.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

grounding-dino.md

Fix code snippet for Grounding DINO (#32229)

2024-07-25 19:20:47 +01:00

groupvit.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

herbert.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

hiera.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

hubert.md

Add sdpa and fa2 the Wav2vec2 family. (#30121)

2024-04-22 18:30:38 +01:00

ibert.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

idefics2.md

🚨 [Idefics2] Update ignore index (#30898)

2024-05-21 19:38:02 +02:00

idefics.md

Port IDEFICS to tensorflow (#26870)

2024-05-13 15:59:46 +01:00

imagegpt.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

informer.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

instructblip.md

Add video modality for InstrucBLIP (#30182)

2024-06-25 15:45:39 +05:00

instructblipvideo.md

Add video modality for InstrucBLIP (#30182)

2024-06-25 15:45:39 +05:00

jamba.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

jetmoe.md

Add JetMoE model (#30005)

2024-05-14 16:32:01 +02:00

jukebox.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

kosmos-2.md

[KOSMOS-2] Update docs (#27157)

2023-10-30 21:42:19 +01:00

layoutlm.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

layoutlmv2.md

[Docs] Add language identifiers to fenced code blocks (#28955)

2024-02-12 10:48:31 -08:00

layoutlmv3.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

layoutxlm.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

led.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

levit.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

lilt.md

[Docs] Add language identifiers to fenced code blocks (#28955)

2024-02-12 10:48:31 -08:00

llama2.md

Fix FA2 integration (#28142)

2023-12-20 14:25:07 +05:30

llama3.md

Docs - update formatting of llama3 model card (#33438)

2024-09-12 11:24:56 +02:00

llama.md

Add TokenClassification for Mistral, Mixtral and Qwen2 (#29878)

2024-05-20 10:06:57 +02:00

llava_next_video.md

Enable BNB multi-backend support (#31098)

2024-09-24 03:40:56 -06:00

llava_next.md

Uniformize kwargs for image-text-to-text processors (#32544)

2024-09-24 21:28:19 -04:00

llava_onevision.md

Enable BNB multi-backend support (#31098)

2024-09-24 03:40:56 -06:00

llava.md

Llava: add default chat templates (#31691)

2024-07-19 10:08:56 +05:00

longformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

longt5.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

luke.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

lxmert.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

m2m_100.md

Add SDPA support for M2M100 (#33309)

2024-09-25 18:04:42 +01:00

madlad-400.md

Add madlad-400 MT models (#27471)

2023-11-28 13:19:50 +00:00

mamba2.md

quickfix documentation (#32566)

2024-08-26 17:49:44 +02:00

mamba.md

[Mamba doc] Post merge updates (#29472)

2024-03-11 09:46:24 +01:00

marian.md

Mention model_info.id instead of model_info.modelId (#32106)

2024-07-22 14:14:47 +01:00

markuplm.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

mask2former.md

Instance segmentation examples (#31084)

2024-05-31 16:56:17 +01:00

maskformer.md

Instance segmentation examples (#31084)

2024-05-31 16:56:17 +01:00

matcha.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

mbart.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

mctct.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

mega.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

megatron_gpt2.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

megatron-bert.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

mgp-str.md

[Docs] Fix broken links and syntax issues (#28918)

2024-02-08 14:13:35 -08:00

mimi.md

Codec integration (#33565)

2024-09-18 19:23:44 +02:00

mistral.md

[Port] TensorFlow implementation of Mistral (#29708)

2024-05-23 17:48:49 +01:00

mixtral.md

Enable BNB multi-backend support (#31098)

2024-09-24 03:40:56 -06:00

mllama.md

Add MLLama (#33703)

2024-09-25 19:56:25 +02:00

mluke.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

mms.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

mobilebert.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

mobilenet_v1.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

mobilenet_v2.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

mobilevit.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

mobilevitv2.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

mpnet.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

mpt.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

mra.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

mt5.md

Adding [T5/MT5/UMT5]ForTokenClassification (#28443)

2024-02-01 03:53:49 +01:00

musicgen_melody.md

Add MusicGen Melody (#28819)

2024-03-18 13:06:12 +00:00

musicgen.md

[Docs] Add language identifiers to fenced code blocks (#28955)

2024-02-12 10:48:31 -08:00

mvp.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

nat.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

nemotron.md

Add Nemotron HF Support (#31699)

2024-08-06 15:42:05 +02:00

nezha.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

nllb-moe.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

nllb.md

Add SDPA support for M2M100 (#33309)

2024-09-25 18:04:42 +01:00

nougat.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

nystromformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

olmo.md

Add OLMo model family (#29890)

2024-04-17 17:59:07 +02:00

olmoe.md

Add paper link (#33305)

2024-09-05 15:49:28 +02:00

omdet-turbo.md

Add OmDet-Turbo (#31843)

2024-09-25 13:26:28 -04:00

oneformer.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

open-llama.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

openai-gpt.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

opt.md

F.scaled_dot_product_attention support (#26572)

2023-12-09 05:38:14 +09:00

owlv2.md

Fix OWLv2 Doc (#30794)

2024-05-14 08:36:11 +02:00

owlvit.md

Update bounding box format everywhere (#27944)

2023-12-11 18:03:42 +00:00

paligemma.md

Uniformize kwargs for Paligemma processor and update docs (#33571)

2024-09-19 14:14:06 -04:00

patchtsmixer.md

[Docs] Add resources (#28705)

2024-02-19 15:22:29 +01:00

patchtst.md

[Docs] Add resources (#28705)

2024-02-19 15:22:29 +01:00

pegasus_x.md

[Docs] Fix broken links and syntax issues (#28918)

2024-02-08 14:13:35 -08:00

pegasus.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

perceiver.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

persimmon.md

Add TokenClassification for Mistral, Mixtral and Qwen2 (#29878)

2024-05-20 10:06:57 +02:00

phi3.md

phi3 chat_template does not support system role (#30606)

2024-05-02 15:30:21 +02:00

phi.md

Fix doctest more (for docs/source/en) (#30247)

2024-04-15 14:10:59 +02:00

phobert.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

pix2struct.md

🌐 [i18n-ZH] Translate chat_templating.md into Chinese (#28790)

2024-02-26 08:42:24 -08:00

pixtral.md

[Pixtral] Improve docs, rename model (#33491)

2024-09-25 13:53:12 +02:00

plbart.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

poolformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

pop2piano.md

[Docs] Add language identifiers to fenced code blocks (#28955)

2024-02-12 10:48:31 -08:00

prophetnet.md

chore: remove duplicate words (#31853)

2024-07-09 10:38:29 +01:00

pvt_v2.md

Add PvT-v2 Model (#26812)

2024-03-13 19:05:20 +00:00

pvt.md

[Docs] Fix broken links and syntax issues (#28918)

2024-02-08 14:13:35 -08:00

qdqbert.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

qwen2_audio.md

Add Qwen2-Audio (#32137)

2024-08-08 15:47:24 +02:00

qwen2_moe.md

Add TokenClassification for Mistral, Mixtral and Qwen2 (#29878)

2024-05-20 10:06:57 +02:00

qwen2_vl.md

Qwen2-VL: clean-up and add more tests (#33354)

2024-09-12 18:24:04 +02:00

qwen2.md

Update qwen2.md (#32108)

2024-07-24 11:54:41 +01:00

rag.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

realm.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

recurrent_gemma.md

[Docs] Update recurrent_gemma.md for some minor nits (#30238)

2024-04-15 18:30:59 +02:00

reformer.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

regnet.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

rembert.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

resnet.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

retribert.md

Deprecate models (#24787)

2023-07-13 11:46:54 -04:00

roberta-prelayernorm.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

roberta.md

[RoBERTa] Minor clarifications to model doc (#31949)

2024-07-22 10:08:27 -07:00

roc_bert.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

roformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

rt_detr.md

[RT-DETR] Add resources (#31815)

2024-07-10 16:34:53 +01:00

rwkv.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

sam.md

"to be not" -> "not to be" (#32636)

2024-08-12 20:20:17 +01:00

seamless_m4t_v2.md

[Seamless] Fix links in docs (#27905)

2023-12-14 15:14:13 +00:00

seamless_m4t.md

[Seamless] Fix links in docs (#27905)

2023-12-14 15:14:13 +00:00

segformer.md

Decorators for deprecation and named arguments validation (#30799)

2024-06-10 12:35:10 +01:00

seggpt.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

sew-d.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

sew.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

siglip.md

Add FA2 and sdpa support for SigLIP (#31499)

2024-07-08 11:10:02 +01:00

speech_to_text_2.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

speech_to_text.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

speech-encoder-decoder.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

speecht5.md

add generate method to SpeechT5ForTextToSpeech (#25233)

2023-08-03 14:12:07 +01:00

splinter.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

squeezebert.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

stablelm.md

Add TokenClassification for Mistral, Mixtral and Qwen2 (#29878)

2024-05-20 10:06:57 +02:00

starcoder2.md

Add TokenClassification for Mistral, Mixtral and Qwen2 (#29878)

2024-05-20 10:06:57 +02:00

superpoint.md

[SuperPoint, PaliGemma] Update docs (#31025)

2024-05-28 13:22:06 +02:00

swiftformer.md

Add TF swiftformer (#23342)

2024-04-19 18:31:43 +01:00

swin2sr.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

swin.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

swinv2.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

switch_transformers.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

t5.md

Fix doctest more (for docs/source/en) (#30247)

2024-04-15 14:10:59 +02:00

t5v1.1.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

table-transformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

tapas.md

[docs] fixed links with 404 (#27327)

2023-11-06 19:45:03 +00:00

tapex.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

time_series_transformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

timesformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

trajectory_transformer.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

transfo-xl.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

trocr.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

tvlt.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

tvp.md

Update TVP arxiv link (#27672)

2023-11-23 17:02:16 +00:00

udop.md

[UDOP] Improve docs, add resources (#29571)

2024-04-10 16:02:50 +02:00

ul2.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

umt5.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

unispeech-sat.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

unispeech.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

univnet.md

Add UnivNet Vocoder Model for Tortoise TTS Diffusers Integration (#24799)

2023-11-22 17:21:36 +01:00

upernet.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

van.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

video_llava.md

Enable BNB multi-backend support (#31098)

2024-09-24 03:40:56 -06:00

videomae.md

add sdpa to ViT [follow up of #29325] (#30555)

2024-05-16 10:56:11 +01:00

vilt.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

vipllava.md

Llava: add default chat templates (#31691)

2024-07-19 10:08:56 +05:00

vision-encoder-decoder.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

vision-text-dual-encoder.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

visual_bert.md

Update all references to canonical models (#29001)

2024-02-16 08:16:58 +01:00

vit_hybrid.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

vit_mae.md

add sdpa to ViT [follow up of #29325] (#30555)

2024-05-16 10:56:11 +01:00

vit_msn.md

add sdpa to ViT [follow up of #29325] (#30555)

2024-05-16 10:56:11 +01:00

vit.md

Fast image processor (#28847)

2024-06-11 15:47:38 +01:00

vitdet.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

vitmatte.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

vits.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

vivit.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

wav2vec2_phoneme.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

wav2vec2-bert.md

Add new meta w2v2-conformer BERT-like model (#28165)

2024-01-18 13:37:34 +00:00

wav2vec2-conformer.md

doc: add info about wav2vec2 bert in older wav2vec2 models. (#31120)

2024-06-05 11:56:11 +01:00

wav2vec2.md

doc: add info about wav2vec2 bert in older wav2vec2 models. (#31120)

2024-06-05 11:56:11 +01:00

wavlm.md

[Docs] Fix spelling and grammar mistakes (#28825)

2024-02-02 08:45:00 +01:00

whisper.md

[docs] add quick usage snippet to Whisper. (#31289)

2024-08-27 14:11:52 +02:00

xclip.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

xglm.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

xlm-prophetnet.md

Deprecate low use models (#30781)

2024-05-28 18:07:07 +01:00

xlm-roberta-xl.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

xlm-roberta.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

xlm-v.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

xlm.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

xlnet.md

Fixed Majority of the Typos in transformers[en] Documentation (#33350)

2024-09-09 10:47:24 +02:00

xls_r.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

xlsr_wav2vec2.md

doc: add info about wav2vec2 bert in older wav2vec2 models. (#31120)

2024-06-05 11:56:11 +01:00

xmod.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

yolos.md

add sdpa to ViT [follow up of #29325] (#30555)

2024-05-16 10:56:11 +01:00

yoso.md

[Docs] Model_doc structure/clarity improvements (#26876)

2023-11-03 10:57:03 -04:00

zoedepth.md

Add ZoeDepth (#30136)

2024-07-08 11:43:33 +02:00