Sylvain Gugger 6b735a7253 Tokenizer summary (#5467) ...

* Work on tokenizer summary

* Finish tutorial

* Link to it

* Apply suggestions from code review

Co-authored-by: Anthony MOI <xn1t0x@gmail.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

* Add vocab definition

Co-authored-by: Anthony MOI <xn1t0x@gmail.com>
Co-authored-by: Lysandre Debut <lysandre@huggingface.co>

2020-07-02 17:07:42 -04:00

..

_static

Fix dropdown bug in searches (#5440)

2020-07-01 11:02:59 -04:00

imgs

Add model summary (#4789)

2020-06-05 12:22:50 -04:00

main_classes

Fix examples titles and optimization doc page (#5408)

2020-07-01 08:11:25 -04:00

model_doc

[Reformer] Add Masked LM Reformer (#5426)

2020-07-01 22:43:18 +02:00

benchmarks.rst

[Docs] Benchmark docs (#5360)

2020-06-29 16:08:57 +02:00

bertology.rst

[doc] Fix broken links + remove crazy big notebook

2020-05-07 18:44:18 -04:00

conf.py

Release: v3.0.0

2020-06-29 10:40:13 -04:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.rst

Add ALBERT to the Tensorflow to Pytorch model conversion cli (#3933)

2020-05-11 13:10:00 -04:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

favicon.ico

Adding usage examples for common tasks (#2850)

2020-02-25 13:48:24 -05:00

glossary.rst

Fix typo in glossary (#5466)

2020-07-02 09:19:33 -04:00

index.rst

Tokenizer summary (#5467)

2020-07-02 17:07:42 -04:00

installation.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

migration.md

Add hugs (#5225)

2020-06-24 07:56:14 -04:00

model_sharing.rst

How to share model cards with the CLI (#5374)

2020-06-30 08:59:32 -04:00

model_summary.rst

Add hugs (#5225)

2020-06-24 07:56:14 -04:00

multilingual.rst

Refactor Code samples; Test code samples (#5036)

2020-06-25 16:46:00 -04:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

philosophy.rst

Add hugs (#5225)

2020-06-24 07:56:14 -04:00

preprocessing.rst

Tokenization tutorial (#5257)

2020-06-24 18:43:20 -04:00

pretrained_models.rst

Fix all sphynx warnings (#5068)

2020-06-16 16:50:02 -04:00

quicktour.rst

Tokenizer summary (#5467)

2020-07-02 17:07:42 -04:00

task_summary.rst

[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)

2020-06-26 19:48:14 +02:00

tokenizer_summary.rst

Tokenizer summary (#5467)

2020-07-02 17:07:42 -04:00

torchscript.rst

Add hugs (#5225)

2020-06-24 07:56:14 -04:00

training.rst

[tokenizers] Updates data processors, docstring, examples and model cards to the new API (#5308)

2020-06-26 19:48:14 +02:00