translate the en tokenizer_summary.md to Chinese (#27291)

* translate the en tokenizer_summary.md to Chinese

* revise WordPiece

* add to source/zh/_toctree.yml
This commit is contained in:
九是否随意的称呼
2023-11-08 07:31:51 +08:00
committed by GitHub
parent 7e1eff7600
commit f213d5dd8c
2 changed files with 236 additions and 0 deletions

View File

@@ -41,4 +41,6 @@
- sections:
- local: task_summary
title: 🤗Transformers能做什么
- local: tokenizer_summary
title: 分词器的摘要
title: 概念指南