Li-Huai (Allan) Lin 841d979190 Add FastTokenizer to REALM (#15211) ...

* Remove BertTokenizer abstraction

* Add FastTokenizer to REALM

* Fix config archive map

* Fix copies

* Update realm.mdx

* Apply suggestions from code review

2022-01-19 15:19:36 +01:00

..

internal

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

main_classes

Enable tqdm toggling (#15167)

2022-01-18 17:52:35 -05:00

model_doc

Add FastTokenizer to REALM (#15211)

2022-01-19 15:19:36 +01:00

_config.py

Prevent style_doc from tempering the config file

2021-12-10 15:31:43 -05:00

_toctree.yml

Add MAE (#15120)

2022-01-18 16:21:32 +01:00

add_new_model.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

add_new_pipeline.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

benchmarks.mdx

[doc] normalize HF Transformers string (#15023)

2022-01-10 08:44:33 -08:00

bertology.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

community.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

custom_datasets.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

debugging.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

fast_tokenizers.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

glossary.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

index.mdx

Add FastTokenizer to REALM (#15211)

2022-01-19 15:19:36 +01:00

installation.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

migration.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

model_sharing.mdx

Update model_sharing.mdx (#15142)

2022-01-13 12:26:02 -05:00

model_summary.mdx

Add "open in hf spaces" gradio button issue #73 (#15106)

2022-01-14 10:12:30 -05:00

multilingual.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

parallelism.mdx

[doc] Update parallelism.mdx (#15018)

2022-01-04 09:58:27 -08:00

performance.mdx

[doc] new MoE paper (#15184)

2022-01-17 09:10:51 -08:00

perplexity.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

philosophy.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

pr_checks.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

preprocessing.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

quicktour.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

sagemaker.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

serialization.mdx

Add ONNX configuration classes to docs (#15121)

2022-01-12 16:33:32 +01:00

task_summary.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

testing.mdx

[doc] normalize HF Transformers string (#15023)

2022-01-10 08:44:33 -08:00

tokenizer_summary.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

training.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

troubleshooting.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00