Sebastian 06910f5a76 [T5] Add T5ForQuestionAnswering and MT5ForQuestionAnswering (#24481) ...

* Adding T5ForQuestionAnswering

* Changed weight initialization that results in better initial loss when fine-tuning

* Update to class variables

* Running make fixup

* Running make fix-copies

* Remove model_parallel

* Adding MT5ForQuestionAnswering

* Adding docs

* Fix wrong doc

* Update src/transformers/models/mt5/modeling_mt5.py

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* Update src/transformers/models/t5/modeling_t5.py

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

* File formatting

* Undoing change

---------

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>

2023-06-27 10:07:06 -04:00

..

albert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

align.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

altclip.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

audio-spectrogram-transformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

auto.md

[AutoModel] Add AutoModelForTextEncoding (#24305)

2023-06-23 10:01:37 +01:00

autoformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bart.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

barthez.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bartpho.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

beit.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bert-generation.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bert-japanese.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bertweet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

big_bird.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bigbird_pegasus.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

biogpt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bit.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

blenderbot-small.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

blenderbot.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

blip-2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

blip.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bloom.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bort.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

bridgetower.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

byt5.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

camembert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

canine.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

chinese_clip.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

clap.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

clip.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

clipseg.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

codegen.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

conditional_detr.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

convbert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

convnext.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

convnextv2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

cpm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

cpmant.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

ctrl.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

cvt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

data2vec.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

deberta-v2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

deberta.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

decision_transformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

deformable_detr.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

deit.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

deplot.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

deta.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

detr.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

dialogpt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

dinat.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

distilbert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

dit.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

donut.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

dpr.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

dpt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

efficientformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

efficientnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

electra.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

encodec.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

encoder-decoder.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

ernie_m.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

ernie.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

esm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

flan-t5.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

flan-ul2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

flaubert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

flava.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

fnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

focalnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

fsmt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

funnel.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

git.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

glpn.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

gpt2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

gpt_bigcode.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

gpt_neo.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

gpt_neox_japanese.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

gpt_neox.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

gpt-sw3.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

gptj.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

gptsan-japanese.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

graphormer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

groupvit.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

herbert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

hubert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

ibert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

imagegpt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

informer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

instructblip.md

Add InstructBLIP (#23460)

2023-06-26 11:23:57 +02:00

jukebox.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

layoutlm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

layoutlmv2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

layoutlmv3.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

layoutxlm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

led.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

levit.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

lilt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

llama.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

longformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

longt5.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

luke.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

lxmert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

m2m_100.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

marian.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

markuplm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mask2former.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

maskformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

matcha.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mbart.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mctct.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mega.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

megatron_gpt2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

megatron-bert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mgp-str.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mluke.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mms.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mobilebert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mobilenet_v1.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mobilenet_v2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mobilevit.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mobilevitv2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mpnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

mt5.md

[T5] Add T5ForQuestionAnswering and MT5ForQuestionAnswering (#24481)

2023-06-27 10:07:06 -04:00

mvp.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

nat.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

nezha.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

nllb-moe.md

[docs] Fix NLLB-MoE links (#24388)

2023-06-20 17:34:20 -07:00

nllb.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

nystromformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

oneformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

open-llama.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

openai-gpt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

opt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

owlvit.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

pegasus_x.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

pegasus.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

perceiver.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

phobert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

pix2struct.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

plbart.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

poolformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

prophetnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

qdqbert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

rag.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

realm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

reformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

regnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

rembert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

resnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

retribert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

roberta-prelayernorm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

roberta.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

roc_bert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

roformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

rwkv.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

sam.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

segformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

sew-d.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

sew.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

speech_to_text_2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

speech_to_text.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

speech-encoder-decoder.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

speecht5.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

splinter.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

squeezebert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

swiftformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

swin2sr.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

swin.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

swinv2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

switch_transformers.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

t5.md

[T5] Add T5ForQuestionAnswering and MT5ForQuestionAnswering (#24481)

2023-06-27 10:07:06 -04:00

t5v1.1.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

table-transformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

tapas.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

tapex.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

time_series_transformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

timesformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

trajectory_transformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

transfo-xl.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

trocr.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

tvlt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

ul2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

unispeech-sat.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

unispeech.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

upernet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

van.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

videomae.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

vilt.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

vision-encoder-decoder.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

vision-text-dual-encoder.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

visual_bert.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

vit_hybrid.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

vit_mae.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

vit_msn.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

vit.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

wav2vec2_phoneme.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

wav2vec2-conformer.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

wav2vec2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

wavlm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

whisper.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xclip.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xglm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xlm-prophetnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xlm-roberta-xl.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xlm-roberta.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xlm-v.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xlm.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xlnet.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xls_r.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xlsr_wav2vec2.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

xmod.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

yolos.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00

yoso.md

Migrate doc files to Markdown. (#24376)

2023-06-20 18:07:47 -04:00