Lysandre Debut 3095ee9dab Tokenizers should be framework agnostic (#8599) ...

* Tokenizers should be framework agnostic

* Run the slow tests

* Not testing

* Fix documentation

* Apply suggestions from code review

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

2020-11-17 14:03:03 -05:00

..

_static

Update doc for v3.5.1

2020-11-13 10:29:58 -05:00

imgs

Guide to fixed-length model perplexity evaluation (#5449)

2020-07-07 16:04:15 -06:00

internal

Refactoring the generate() function (#6949)

2020-11-03 16:04:22 +01:00

main_classes

Fix doc bug (#8500)

2020-11-12 11:47:23 -05:00

model_doc

Tokenizers should be framework agnostic (#8599)

2020-11-17 14:03:03 -05:00

benchmarks.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

bertology.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

conf.py

Release: v3.5.0

2020-11-10 08:50:43 -05:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

custom_datasets.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

favicon.ico

Adding usage examples for common tasks (#2850)

2020-02-25 13:48:24 -05:00

glossary.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

index.rst

[MT5] More docs (#8589)

2020-11-17 12:47:57 +01:00

installation.md

Fix doc errors and typos across the board (#8139)

2020-10-29 10:33:33 -04:00

migration.md

Fix doc errors and typos across the board (#8139)

2020-10-29 10:33:33 -04:00

model_sharing.rst

Model sharing doc: more tweaks (#8520)

2020-11-13 12:10:26 -05:00

model_summary.rst

[MT5] More docs (#8589)

2020-11-17 12:47:57 +01:00

multilingual.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

perplexity.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

philosophy.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

preprocessing.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

pretrained_models.rst

Tokenizers: ability to load from model subfolder (#8586)

2020-11-17 08:58:45 -05:00

quicktour.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

serialization.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

task_summary.rst

Switch return_dict to True by default. (#8530)

2020-11-16 11:43:00 -05:00

testing.rst

using multi_gpu consistently (#8446)

2020-11-10 13:23:58 -05:00

tokenizer_summary.rst

Doc styling (#8067)

2020-10-26 18:26:02 -04:00

training.rst

Switch return_dict to True by default. (#8530)

2020-11-16 11:43:00 -05:00