SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity
Files
f3d2f7a6e08efe18debf59512325f02128394b43
HuggingFace_transformer/docs/source/en/model_doc
History
NielsRogge f3d2f7a6e0 Add MarkupLM (#19198) 
* First draft

* Make basic test work

* Fix most tokenizer tests

* More improvements

* Make more tests pass

* Fix more tests

* Fix some code quality

* Improve truncation

* Implement feature extractor

* Improve feature extractor and add tests

* Improve feature extractor tests

* Fix pair_input test partly

* Add fast tokenizer

* Improve implementation

* Fix rebase

* Fix rebase

* Fix most of the tokenizer tests.

* propose solution for fast

* add: integration test for fasttokenizer, warning for decode, fix template in slow tokenizer

* add: modify markuplmconverter

* add: some modify on converter and tokenizerfast

* Fix style, copies

* Make fixup

* Update tokenization_markuplm.py

* Update test_tokenization_markuplm.py

* Update markuplm related

* Improve processor, add integration test

* Add processor test file

* Improve processor

* Improve processor tests

* Fix more processor tests

* Fix processor tests

* Update docstrings

* Add Copied from statements

* Add more Copied from statements

* Add code examples

* Improve code examples

* Add model to doc tests

* Adding dependency check

* Add dummy file

* Add requires_backends

* Add model to toctree

* Fix more things, disable dependency check for now

* Apply more suggestions

* Add soft dependency

* Add annotators to tests

* Fix style

* Remove from_slow=True

* Remove print statements

* Add sanity check

* Fix processor test

* Fix processor tests, add more docs

* Add doc tests for mdx file

* Add more tips

* Apply suggestions

Co-authored-by: Niels Rogge <nielsrogge@Nielss-MacBook-Pro.local>
Co-authored-by: lockon-n <45759388+lockon-n@users.noreply.github.com>
Co-authored-by: SaulLu <lucilesaul.com@gmail.com>
Co-authored-by: lockon-n <dd098309@126.com>
2022-09-30 08:25:43 +02:00
..
albert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
auto.mdx
Add DocumentQuestionAnswering pipeline (#18414)
2022-09-07 13:38:49 -04:00
bart.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
barthez.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
bartpho.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
beit.mdx
Beit postprocessing (#19099)
2022-09-20 10:41:56 +03:00
bert-generation.mdx
Result of new doc style with fixes (#17015)
2022-04-29 17:42:15 -04:00
bert-japanese.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
bert.mdx
Add a TF in-graph tokenizer for BERT (#17701)
2022-06-27 12:06:21 +01:00
bertweet.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
big_bird.mdx
[FlaxBert] Add ForCausalLM (#16995)
2022-05-03 11:26:19 +02:00
bigbird_pegasus.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
blenderbot-small.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
blenderbot.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
bloom.mdx
Update BLOOM parameter counts (#18531)
2022-08-12 19:36:18 +02:00
bort.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
byt5.mdx
[Doctests] Fix all T5 doc tests (#16646)
2022-04-13 11:36:54 +02:00
camembert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
canine.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
clip.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
codegen.mdx
Add CodeGen model (#17443)
2022-06-24 17:10:38 +02:00
conditional_detr.mdx
Improve conditional detr docs (#19154)
2022-09-22 13:21:05 +02:00
convbert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
convnext.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
cpm.mdx
Allow all imports from transformers (#17050)
2022-05-02 12:47:39 -04:00
ctrl.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
cvt.mdx
Add CvT (#17299)
2022-05-18 17:47:18 +02:00
data2vec.mdx
Add TFData2VecVision for semantic segmentation (#17271)
2022-06-08 14:03:18 +01:00
deberta-v2.mdx
Add DebertaV2ForMultipleChoice (#17135)
2022-05-10 16:21:44 -04:00
deberta.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
decision_transformer.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
deformable_detr.mdx
[fix] Add DeformableDetrFeatureExtractor (#19140)
2022-09-22 09:45:24 +02:00
deit.mdx
Add TF DeiT implementation (#17806)
2022-07-13 18:04:08 +01:00
detr.mdx
Fix Automatic Download of Pretrained Weights in DETR (#17712)
2022-06-21 16:45:35 +02:00
dialogpt.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
distilbert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
dit.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
donut.mdx
Fix URLs (#18604)
2022-08-12 18:52:49 +02:00
dpr.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
dpt.mdx
Add post_process_semantic_segmentation method to DPTFeatureExtractor (#19107)
2022-09-21 15:15:26 +03:00
electra.mdx
[FlaxBert] Add ForCausalLM (#16995)
2022-05-03 11:26:19 +02:00
encoder-decoder.mdx
[EncoderDecoder] Improve docs (#18271)
2022-07-27 10:08:59 +02:00
ernie.mdx
add task_type_id to BERT to support ERNIE-2.0 and ERNIE-3.0 models (#18686)
2022-09-09 07:36:46 -04:00
flaubert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
flava.mdx
[feat] Add FLAVA model (#16654)
2022-05-11 14:56:48 -07:00
fnet.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
fsmt.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
funnel.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
glpn.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
gpt2.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
gpt_neo.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
gpt_neox_japanese.mdx
Add support for Japanese GPT-NeoX-based model by ABEJA, Inc. (#18814)
2022-09-14 10:17:40 -04:00
gpt_neox.mdx
[WIP] Adding GPT-NeoX-20B (#16659)
2022-05-24 09:31:10 -04:00
gptj.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
groupvit.mdx
[TensorFlow] Adding GroupViT (#18020)
2022-09-29 10:48:04 +01:00
herbert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
hubert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
ibert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
imagegpt.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
layoutlm.mdx
[LayoutLM] Add clarification to docs (#18716)
2022-09-02 14:48:19 +02:00
layoutlmv2.mdx
Correct & Improve Doctests for LayoutLMv2 (#17168)
2022-05-23 08:02:31 -04:00
layoutlmv3.mdx
[LayoutLMv3] Add TensorFlow implementation (#18678)
2022-08-30 11:48:11 +01:00
layoutxlm.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
led.mdx
[LED] fix global_attention_mask not being passed for generation and docs clarification about grad checkpointing (#17112)
2022-05-17 23:44:37 +02:00
levit.mdx
Adding LeViT Model by Facebook (#17466)
2022-06-01 17:06:20 +02:00
longformer.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
longt5.mdx
Update longt5.mdx (#18634)
2022-08-16 10:20:46 -05:00
luke.mdx
Adding fine-tuning models to LUKE (#18353)
2022-08-01 11:09:47 -04:00
lxmert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
m2m_100.mdx
Fix m2m_100.mdx doc example missing labels (#19149)
2022-09-29 13:27:58 +02:00
marian.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
markuplm.mdx
Add MarkupLM (#19198)
2022-09-30 08:25:43 +02:00
maskformer.mdx
update maskformer docs (#18423)
2022-08-02 18:43:58 +03:00
mbart.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
mctct.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
megatron_gpt2.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
megatron-bert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
mluke.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
mobilebert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
mobilevit.mdx
Add semantic segmentation post-processing method to MobileViT (#19105)
2022-09-23 16:24:28 +03:00
mpnet.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
mt5.mdx
Flax t5 Encoder (#17784)
2022-06-30 00:49:02 +02:00
mvp.mdx
Add MVP model (#17787)
2022-06-29 09:30:55 -04:00
nezha.mdx
Nezha Pytorch implementation (#17776)
2022-06-23 12:36:22 -04:00
nllb.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
nystromformer.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
openai-gpt.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
opt.mdx
Adding OPTForSeqClassification class (#18123)
2022-07-20 10:14:21 +02:00
owlvit.mdx
fix owlvit tests, update docstring examples (#18586)
2022-08-11 19:10:25 +03:00
pegasus_x.mdx
PEGASUS-X (#18551)
2022-09-02 19:54:02 +02:00
pegasus.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
perceiver.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
phobert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
plbart.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
poolformer.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
prophetnet.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
qdqbert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
rag.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
realm.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
reformer.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
regnet.mdx
TF implementation of RegNets (#17554)
2022-06-29 13:45:14 +01:00
rembert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
resnet.mdx
Add TF ResNet model (#17427)
2022-07-04 10:59:15 +01:00
retribert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
roberta.mdx
[FlaxBert] Add ForCausalLM (#16995)
2022-05-03 11:26:19 +02:00
roformer.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
segformer.mdx
Add post_process_semantic_segmentation method to SegFormer (#19072)
2022-09-21 11:40:35 +03:00
sew-d.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
sew.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
speech_to_text_2.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
speech_to_text.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
speech-encoder-decoder.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
splinter.mdx
Add support for pretraining recurring span selection to Splinter (#17247)
2022-05-17 23:42:14 +02:00
squeezebert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
swin.mdx
Add Tensorflow Swin model (#16988)
2022-05-16 22:19:53 +01:00
swinv2.mdx
Add swin transformer v2 (#17469)
2022-07-27 11:14:47 -04:00
t5.mdx
Fix decode_input_ids to bare T5Model and improve doc (#18791)
2022-09-06 14:12:26 +02:00
t5v1.1.mdx
[Doctests] Fix all T5 doc tests (#16646)
2022-04-13 11:36:54 +02:00
tapas.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
tapex.mdx
Add TAPEX (#16473)
2022-04-08 10:57:51 +02:00
trajectory_transformer.mdx
Add trajectory transformer (#17141)
2022-05-17 19:07:43 -04:00
transfo-xl.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
trocr.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
ul2.mdx
Add UL2 (just docs) (#17740)
2022-06-21 10:24:50 +02:00
unispeech-sat.mdx
Add Wav2Vec2Conformer (#16812)
2022-05-17 00:43:16 +02:00
unispeech.mdx
Add Wav2Vec2Conformer (#16812)
2022-05-17 00:43:16 +02:00
van.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
videomae.mdx
Add VideoMAE (#17821)
2022-08-04 18:02:55 +02:00
vilt.mdx
Add ViltForTokenClassification e.g. for Named-Entity-Recognition (NER) (#17924)
2022-07-26 10:11:32 +02:00
vision-encoder-decoder.mdx
[EncoderDecoder] Improve docs (#18271)
2022-07-27 10:08:59 +02:00
vision-text-dual-encoder.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
visual_bert.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
vit_mae.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
vit_msn.mdx
MSN (Masked Siamese Networks) for ViT (#18815)
2022-09-22 07:15:03 -04:00
vit.mdx
Improve vision models docs (#19103)
2022-09-19 19:22:34 +02:00
wav2vec2_phoneme.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
wav2vec2-conformer.mdx
[Wav2Vec2Conformer] Official release (#17709)
2022-06-15 18:34:15 +02:00
wav2vec2.mdx
Replace as_target context managers by direct calls (#18325)
2022-07-29 08:09:09 -04:00
wavlm.mdx
Add Wav2Vec2Conformer (#16812)
2022-05-17 00:43:16 +02:00
xclip.mdx
Improve vision models docs (#19103)
2022-09-19 19:22:34 +02:00
xglm.mdx
Add TF implementation of XGLMModel (#16543)
2022-08-24 10:51:05 +01:00
xlm-prophetnet.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
xlm-roberta-xl.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
xlm-roberta.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
xlm.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
xlnet.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
xls_r.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
xlsr_wav2vec2.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00
yolos.mdx
Add YOLOS (#16848)
2022-05-02 18:30:55 +02:00
yoso.mdx
Enable doc in Spanish (#16518)
2022-04-04 10:25:46 -04:00