Documentation about loading a fast tokenizer within Transformers (#11029)

* Documentation about loading a fast tokenizer within Transformers * Apply suggestions from code review Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> * style Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
2021-04-05 10:51:16 -04:00
parent 6c25f5228e
commit 9f4e0c23d6
5 changed files with 111 additions and 7 deletions
--- a/docs/source/index.rst
+++ b/docs/source/index.rst
@@ -384,6 +384,7 @@ TensorFlow and/or Flax.
    migration
    contributing
    add_new_model
+    fast_tokenizers
    testing
    serialization