Tanmay Laud f7f872955d Big Bird Fast Tokenizer implementation (#11075) ...

* Added Big Bird Fast Tokenizer initial file

* style fixes

* flake fixes

* Added big bird fast tokenizer to init files

* Added big bird fast to Auto tokenization

* fix styles

* minor quality fixes

* Added initial test code

* Fix SpmConverter when precompiled_charsmap doesn't exist

* fixed post processor

* minor style fix

* minor fix input names

* Actually fix identity normalization

* style

* Added token type ids to fast tokenizer

* style

* flake fix

* fix copies

Co-authored-by: Anthony MOI <m.anthony.moi@gmail.com>

2021-05-10 03:01:23 -04:00

..

_static

Document v4.5.1

2021-04-13 11:28:17 -04:00

imgs

[Templates] Add template "call-for-model" markdown and "call-for-big-bird" markdown (#9921)

2021-02-05 15:47:54 +03:00

internal

[debug utils] activation/weights underflow/overflow detector (#11274)

2021-04-30 11:15:46 -07:00

main_classes

Add the ImageClassificationPipeline (#11598)

2021-05-07 08:08:40 -04:00

model_doc

Big Bird Fast Tokenizer implementation (#11075)

2021-05-10 03:01:23 -04:00

add_new_model.rst

Indent code block in the documentation (#11233)

2021-04-13 15:36:36 -04:00

benchmarks.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

bertology.rst

Fix documentation links always pointing to master. (#9217)

2021-01-05 06:18:48 -05:00

community.md

Add LUKE (#11223)

2021-05-03 09:07:29 -04:00

conf.py

added social thumbnail for docs (#11083)

2021-04-06 14:56:18 +02:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

custom_datasets.rst

Rename NLP library to Datasets library (#10920)

2021-03-26 08:07:59 -04:00

debugging.rst

[debug utils] activation/weights underflow/overflow detector (#11274)

2021-04-30 11:15:46 -07:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

fast_tokenizers.rst

Documentation about loading a fast tokenizer within Transformers (#11029)

2021-04-05 10:51:16 -04:00

favicon.ico

Adding usage examples for common tasks (#2850)

2020-02-25 13:48:24 -05:00

glossary.rst

Indent code block in the documentation (#11233)

2021-04-13 15:36:36 -04:00

index.rst

Big Bird Fast Tokenizer implementation (#11075)

2021-05-10 03:01:23 -04:00

installation.md

fix #1149 (#11493)

2021-04-28 11:16:41 -04:00

migration.md

[docs] fix invalid class name (#11438)

2021-04-26 08:37:32 -07:00

model_sharing.rst

Trainer push to hub (#11328)

2021-04-23 09:17:37 -04:00

model_summary.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

multilingual.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

perplexity.rst

minor typo fix

2021-04-01 11:58:37 -06:00

philosophy.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

preprocessing.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

pretrained_models.rst

GPT Neo few fixes (#10968)

2021-03-30 11:15:55 -04:00

quicktour.rst

Finish Making Quick Tour respect the model object (#11467)

2021-04-27 10:04:12 -04:00

sagemaker.md

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

serialization.rst

Copyright (#8970)

2020-12-07 18:36:34 -05:00

task_summary.rst

Improve task summary docs (#11513)

2021-04-30 09:06:47 -04:00

testing.rst

[testing doc] bring doc up to date (#11359)

2021-04-21 08:51:00 -07:00

tokenizer_summary.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

training.rst

Update training tutorial (#11533)

2021-05-03 13:18:46 -04:00

troubleshooting.md

[troubleshooting] add 2 points of reference to the offline mode (#11236)

2021-04-14 08:39:23 -07:00