Gunjan Chhablani d8049331dc Add FNet (#13045) ...

* Init FNet

* Update config

* Fix config

* Update model classes

* Update tokenizers to use sentencepiece

* Fix errors in model

* Fix defaults in config

* Remove position embedding type completely

* Fix typo and take only real numbers

* Fix type vocab size in configuration

* Add projection layer to embeddings

* Fix position ids bug in embeddings

* Add minor changes

* Add conversion script and remove CausalLM vestiges

* Fix conversion script

* Fix conversion script

* Remove CausalLM Test

* Update checkpoint names to dummy checkpoints

* Add tokenizer mapping

* Fix modeling file and corresponding tests

* Add tokenization test file

* Add PreTraining model test

* Make style and quality

* Make tokenization base tests work

* Update docs

* Add FastTokenizer tests

* Fix fast tokenizer special tokens

* Fix style and quality

* Remove load_tf_weights vestiges

* Add FNet to  main README

* Fix configuration example indentation

* Comment tokenization slow test

* Fix style

* Add changes from review

* Fix style

* Remove bos and eos tokens from tokenizers

* Add tokenizer slow test, TPU transforms, NSP

* Add scipy check

* Add scipy availabilty check to test

* Fix tokenizer and use correct inputs

* Remove remaining TODOs

* Fix tests

* Fix tests

* Comment Fourier Test

* Uncomment Fourier Test

* Change to google checkpoint

* Add changes from review

* Fix activation function

* Fix model integration test

* Add more integration tests

* Add comparison steps to MLM integration test

* Fix style

* Add masked tokenization fix

* Improve mask tokenization fix

* Fix index docs

* Add changes from review

* Fix issue

* Fix failing import in test

* some more fixes

* correct fast tokenizer

* finalize

* make style

* Remove additional tokenization logic

* Set do_lower_case to False

* Allow keeping accents

* Fix tokenization test

* Fix FNet Tokenizer Fast

* fix tests

* make style

* Add tips to FNet docs

Co-authored-by: patrickvonplaten <patrick.v.platen@gmail.com>

2021-09-20 13:24:30 +02:00

..

_static

Docs for v4.10.1

2021-09-10 16:45:19 +02:00

imgs

[doc] DP/PP/TP/etc parallelism (#12524)

2021-07-09 17:39:09 -07:00

internal

Fix doc building error

2021-08-12 05:49:02 -04:00

main_classes

Push to hub when saving checkpoints (#13503)

2021-09-14 08:02:15 -04:00

model_doc

Add FNet (#13045)

2021-09-20 13:24:30 +02:00

add_new_model.rst

consistent nn. and nn.functional: part 5 docs (#12161)

2021-06-14 13:34:32 -07:00

add_new_pipeline.rst

[Large PR] Entire rework of pipelines. (#13308)

2021-09-10 14:47:48 +02:00

benchmarks.rst

[Docs] fixed broken link (#12205)

2021-06-16 15:14:53 -04:00

bertology.rst

Fix documentation links always pointing to master. (#9217)

2021-01-05 06:18:48 -05:00

community.md

docs: add HuggingArtists to community notebooks (#13050)

2021-08-10 09:36:44 +02:00

conf.py

Docs for v4.10.0

2021-08-31 16:02:31 +02:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

custom_datasets.rst

Rename NLP library to Datasets library (#10920)

2021-03-26 08:07:59 -04:00

debugging.rst

[debug] DebugUnderflowOverflow doesn't work with DP (#12816)

2021-07-21 09:36:02 -07:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

fast_tokenizers.rst

Documentation about loading a fast tokenizer within Transformers (#11029)

2021-04-05 10:51:16 -04:00

favicon.ico

Adding usage examples for common tasks (#2850)

2020-02-25 13:48:24 -05:00

glossary.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

index.rst

Add FNet (#13045)

2021-09-20 13:24:30 +02:00

installation.md

Add mention of the huggingface_hub methods for offline mode (#12320)

2021-06-23 09:45:30 -04:00

migration.md

consistent nn. and nn.functional: part 5 docs (#12161)

2021-06-14 13:34:32 -07:00

model_sharing.rst

separate model card git push from the rest (#13514)

2021-09-14 18:07:36 +02:00

model_summary.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

multilingual.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

parallelism.md

docs: fix minor typo (#13289)

2021-08-31 06:49:05 -04:00

performance.md

[doc] performance: batch sizes (#12725)

2021-07-15 09:39:34 -07:00

perplexity.rst

Small changes in perplexity.rstto make the notebook executable on google collaboratory (#13541)

2021-09-13 13:32:32 +02:00

philosophy.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

preprocessing.rst

doc mismatch fixed (#13345)

2021-08-31 06:28:37 -04:00

pretrained_models.rst

GPT Neo few fixes (#10968)

2021-03-30 11:15:55 -04:00

quicktour.rst

[Large PR] Entire rework of pipelines. (#13308)

2021-09-10 14:47:48 +02:00

sagemaker.md

remove documentation (#12657)

2021-07-12 18:02:51 +02:00

serialization.rst

Add to ONNX docs (#13048)

2021-08-09 09:51:49 -04:00

task_summary.rst

Doctests job (#13088)

2021-08-12 03:42:25 -04:00

testing.rst

[doc] testing: how to trigger a self-push workflow (#12724)

2021-07-15 16:18:56 -07:00

tokenizer_summary.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

training.rst

fix: typo spelling grammar (#13212)

2021-08-30 08:09:14 -04:00

troubleshooting.md

[troubleshooting] add 2 points of reference to the offline mode (#11236)

2021-04-14 08:39:23 -07:00