Put back open in colab markers (#14684)

This commit is contained in:
Sylvain Gugger
2021-12-09 12:00:06 -05:00
committed by GitHub
parent 3bc7d70e9c
commit bab1556456
9 changed files with 18 additions and 0 deletions

View File

@@ -12,6 +12,8 @@ specific language governing permissions and limitations under the License.
# Preprocessing data
[[open-in-colab]]
In this tutorial, we'll explore how to preprocess your data using 🤗 Transformers. The main tool for this is what we
call a [tokenizer](main_classes/tokenizer). You can build one using the tokenizer class associated to the model
you would like to use, or directly with the [`AutoTokenizer`] class.