NielsRogge 6e68597877 Add CANINE (#12024) ...

* First pass

* More progress

* Add support for local attention

* More improvements

* More improvements

* Conversion script working

* Add CanineTokenizer

* Make style & quality

* First draft of integration test

* Remove decoder test

* Improve tests

* Add documentation

* Mostly docs improvements

* Add CanineTokenizer tests

* Fix most tests on GPU, improve upsampling projection

* Address most comments by @dhgarrette

* Remove decoder logic

* Improve Canine tests, improve docs of CanineConfig

* All tokenizer tests passing

* Make fix-copies and fix tokenizer tests

* Fix test_model_outputs_equivalence test

* Apply suggestions from @sgugger's review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Address some more comments

* Add support for hidden_states and attentions of shallow encoders

* Define custom CanineModelOutputWithPooling, tests pass

* First pass

* More progress

* Add support for local attention

* More improvements

* More improvements

* Conversion script working

* Add CanineTokenizer

* Make style & quality

* First draft of integration test

* Remove decoder test

* Improve tests

* Add documentation

* Mostly docs improvements

* Add CanineTokenizer tests

* Fix most tests on GPU, improve upsampling projection

* Address most comments by @dhgarrette

* Remove decoder logic

* Improve Canine tests, improve docs of CanineConfig

* All tokenizer tests passing

* Make fix-copies and fix tokenizer tests

* Fix test_model_outputs_equivalence test

* Apply suggestions from @sgugger's review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* Address some more comments

* Make conversion script work for Canine-c too

* Fix tokenizer tests

* Remove file

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

2021-06-30 08:05:44 -04:00

..

_static

Document patch release v4.8.1

2021-06-24 10:15:15 -04:00

imgs

Adjust banner width

2021-06-15 09:37:15 -04:00

internal

[Flax] Add Beam Search (#12131)

2021-06-16 09:43:54 +01:00

main_classes

[models] respect dtype of the model when instantiating it (#12316)

2021-06-28 20:11:21 -07:00

model_doc

Add CANINE (#12024)

2021-06-30 08:05:44 -04:00

add_new_model.rst

consistent nn. and nn.functional: part 5 docs (#12161)

2021-06-14 13:34:32 -07:00

benchmarks.rst

[Docs] fixed broken link (#12205)

2021-06-16 15:14:53 -04:00

bertology.rst

Fix documentation links always pointing to master. (#9217)

2021-01-05 06:18:48 -05:00

community.md

Add DETR (#11653)

2021-06-09 11:51:13 -04:00

conf.py

Release: v4.7.0

2021-06-17 17:57:42 +02:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

custom_datasets.rst

Rename NLP library to Datasets library (#10920)

2021-03-26 08:07:59 -04:00

debugging.rst

[debug utils] activation/weights underflow/overflow detector (#11274)

2021-04-30 11:15:46 -07:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

fast_tokenizers.rst

Documentation about loading a fast tokenizer within Transformers (#11029)

2021-04-05 10:51:16 -04:00

favicon.ico

Adding usage examples for common tasks (#2850)

2020-02-25 13:48:24 -05:00

glossary.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

index.rst

Add CANINE (#12024)

2021-06-30 08:05:44 -04:00

installation.md

Add mention of the huggingface_hub methods for offline mode (#12320)

2021-06-23 09:45:30 -04:00

migration.md

consistent nn. and nn.functional: part 5 docs (#12161)

2021-06-14 13:34:32 -07:00

model_sharing.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

model_summary.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

multilingual.rst

Examples reorg (#11350)

2021-04-21 11:11:20 -04:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

performance.md

[docs] performance (#12258)

2021-06-22 15:34:19 -07:00

perplexity.rst

minor typo fix

2021-04-01 11:58:37 -06:00

philosophy.rst

Minor documentation revisions from copyediting (#9266)

2020-12-23 10:15:49 -05:00

preprocessing.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

pretrained_models.rst

GPT Neo few fixes (#10968)

2021-03-30 11:15:55 -04:00

quicktour.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

sagemaker.md

updated DLC images and sample notebooks (#12191)

2021-06-16 07:24:00 -04:00

serialization.rst

Copyright (#8970)

2020-12-07 18:36:34 -05:00

task_summary.rst

Update AutoModel classes in summarization example (#12178)

2021-06-15 10:36:10 -04:00

testing.rst

[tests] multiple improvements (#12294)

2021-06-21 19:51:36 -07:00

tokenizer_summary.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

training.rst

Add video links to the documentation (#12162)

2021-06-15 06:37:37 -04:00

troubleshooting.md

[troubleshooting] add 2 points of reference to the offline mode (#11236)

2021-04-14 08:39:23 -07:00