Revert open-in-colab and add perceiver (#14683)

This commit is contained in:
Sylvain Gugger
2021-12-08 13:52:31 -05:00
committed by GitHub
parent f6b87c5f30
commit 01b8cd5932
10 changed files with 2 additions and 18 deletions

View File

@@ -12,8 +12,6 @@ specific language governing permissions and limitations under the License.
# Preprocessing data
[[open-in-colab]]
In this tutorial, we'll explore how to preprocess your data using 🤗 Transformers. The main tool for this is what we
call a [tokenizer](main_classes/tokenizer). You can build one using the tokenizer class associated to the model
you would like to use, or directly with the [`AutoTokenizer`] class.