SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
28e091430eea9e0d40839e56fd0d57aec262f5f9
HuggingFace_transformer/docs/source/model_doc
History
novice 28e091430e Add Nystromformer (#14659) 
* Initial commit

* Config and modelling changes

Added Nystromformer-specific attributes to config and removed all decoder functionality from modelling.

* Modelling and test changes

Added Nystrom approximation and removed decoder tests.

* Code quality fixes

* Modeling changes and conversion script

Initial commits to conversion script, modeling changes.

* Minor modeling changes and conversion script

* Modeling changes

* Correct modeling, add tests and documentation

* Code refactor

* Remove tokenizers

* Code refactor

* Update __init__.py

* Fix bugs

* Update src/transformers/__init__.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update src/transformers/__init__.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update src/transformers/models/nystromformer/__init__.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update docs/source/model_doc/nystromformer.mdx

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update src/transformers/models/nystromformer/configuration_nystromformer.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update src/transformers/models/nystromformer/configuration_nystromformer.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update src/transformers/models/nystromformer/configuration_nystromformer.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update src/transformers/models/nystromformer/configuration_nystromformer.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update src/transformers/models/nystromformer/convert_nystromformer_original_pytorch_checkpoint_to_pytorch.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update src/transformers/models/nystromformer/configuration_nystromformer.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update modeling and test_modeling

* Code refactor

* .rst to .mdx

* doc changes

* Doc changes

* Update modeling_nystromformer.py

* Doc changes

* Fix copies

* Apply suggestions from code review

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update configuration_nystromformer.py

* Fix copies

* Update tests/test_modeling_nystromformer.py

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>

* Update test_modeling_nystromformer.py

* Apply suggestions from code review

Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Fix code style

* Update modeling_nystromformer.py

* Update modeling_nystromformer.py

* Fix code style

* Reformat modeling file

* Update modeling_nystromformer.py

* Modify NystromformerForMultipleChoice

* Fix code quality

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Code style changes and torch.no_grad()

* make style

* Apply suggestions from code review

Co-authored-by: NielsRogge <48327001+NielsRogge@users.noreply.github.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2022-01-11 14:25:49 +01:00
..
albert.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
auto.mdx
Add TFVisionEncoderDecoderModel (#14148)
2022-01-10 13:30:14 -05:00
bart.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
barthez.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
bartpho.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
beit.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
bert-generation.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
bert-japanese.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
bert.mdx
Convert rst to mdx bert (#14806)
2021-12-17 11:13:34 -05:00
bertweet.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
big_bird.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
bigbird_pegasus.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
blenderbot-small.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
blenderbot.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
bort.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
byt5.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
camembert.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
canine.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
clip.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
convbert.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
cpm.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
ctrl.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
deberta-v2.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
deberta.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
deit.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
detr.mdx
Doc new front (#14590)
2021-12-01 14:13:02 -05:00
dialogpt.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
distilbert.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
dpr.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
electra.mdx
Add ElectraForCausalLM -> Enable Electra encoder-decoder model (#14729)
2021-12-27 12:37:52 +01:00
encoder-decoder.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
flaubert.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
fnet.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
fsmt.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
funnel.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
gpt2.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
gpt_neo.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
gptj.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
herbert.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
hubert.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
ibert.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
imagegpt.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
layoutlm.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
layoutlmv2.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
layoutxlm.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
led.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
longformer.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
luke.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
lxmert.mdx
Convert model files from rst to mdx (#14865)
2021-12-22 03:27:30 -05:00
m2m_100.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
marian.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
mbart.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
megatron_gpt2.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
megatron-bert.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
mluke.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
mobilebert.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
mpnet.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
mt5.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
nystromformer.mdx
Add Nystromformer (#14659)
2022-01-11 14:25:49 +01:00
openai-gpt.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
pegasus.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
perceiver.mdx
Fix Perceiver docs (#14879)
2021-12-22 14:18:03 +01:00
phobert.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
prophetnet.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
qdqbert.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
rag.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
reformer.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
rembert.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
retribert.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
roberta.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
roformer.mdx
Add Flax RoFormer (#15005)
2022-01-04 13:23:10 +01:00
segformer.mdx
[doc] consistent True/False/None default format (#14951)
2021-12-27 14:31:40 -08:00
sew-d.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
sew.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
speech_to_text_2.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
speech_to_text.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
speech-encoder-decoder.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
splinter.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
squeezebert.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
t5.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
t5v1.1.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
tapas.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
transfo-xl.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
trocr.mdx
support the trocr small models (#14893)
2022-01-10 09:28:03 -05:00
unispeech-sat.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
unispeech.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
vision-encoder-decoder.mdx
Add TFVisionEncoderDecoderModel (#14148)
2022-01-10 13:30:14 -05:00
vision-text-dual-encoder.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
visual_bert.mdx
Doc styler examples (#14953)
2021-12-27 19:07:46 -05:00
vit.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
wav2vec2_phoneme.mdx
Wav2Vec2 meets phonemes (#14353)
2021-12-17 19:56:44 +01:00
wav2vec2.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
wavlm.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
xlm-prophetnet.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
xlm-roberta.mdx
Map model_type and doc pages names (#14944)
2022-01-03 05:08:55 -05:00
xlm.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
xlnet.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
xls_r.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00
xlsr_wav2vec2.mdx
Convert rst files (#14888)
2021-12-22 16:14:35 -05:00