Suraj Patil d25e25ee2b Add XGLM models (#14876) ...

* add xglm

* update vocab size

* fix model name

* style and tokenizer

* typo

* no mask token

* fix pos embed compute

* fix args

* fix tokenizer

* fix positions

* fix tokenization

* style and dic fixes

* fix imports

* add fast tokenizer

* update names

* add pt tests

* fix tokenizer

* fix typo

* fix tokenizer import

* fix fast tokenizer

* fix tokenizer

* fix converter

* add tokenizer test

* update checkpoint names

* fix tokenizer tests

* fix slow tests

* add copied from comments

* rst -> mdx

* flax model

* update flax tests

* quality

* style

* doc

* update index and readme

* fix copies

* fix doc

* update toctrr

* fix indent

* minor fixes

* fix config doc

* don't save embed_pos weights

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* address Sylvains commnets, few doc fixes

* fix check_repo

* align order of arguments

* fix copies

* fix labels

* remove unnecessary mapping

* fix saving tokenizer

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

2022-01-28 18:55:23 +01:00

..

internal

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

main_classes

Add proper documentation for Keras callbacks (#15374)

2022-01-27 10:51:38 -05:00

model_doc

Add XGLM models (#14876)

2022-01-28 18:55:23 +01:00

_config.py

Prevent style_doc from tempering the config file

2021-12-10 15:31:43 -05:00

_toctree.yml

Add XGLM models (#14876)

2022-01-28 18:55:23 +01:00

accelerate.mdx

Fix code format for Accelerate doc (#15335)

2022-01-27 13:49:04 -06:00

add_new_model.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

add_new_pipeline.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

benchmarks.mdx

[doc] normalize HF Transformers string (#15023)

2022-01-10 08:44:33 -08:00

bertology.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

community.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

custom_datasets.mdx

Added missing code in exemplary notebook - custom datasets fine-tuning (#15300)

2022-01-25 17:26:17 -05:00

debugging.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

fast_tokenizers.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

glossary.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

index.mdx

Add XGLM models (#14876)

2022-01-28 18:55:23 +01:00

installation.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

migration.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

model_sharing.mdx

Update model_sharing.mdx (#15142)

2022-01-13 12:26:02 -05:00

model_summary.mdx

Add "open in hf spaces" gradio button issue #73 (#15106)

2022-01-14 10:12:30 -05:00

multilingual.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

parallelism.mdx

[doc] Update parallelism.mdx (#15018)

2022-01-04 09:58:27 -08:00

performance.mdx

[doc] new MoE paper (#15184)

2022-01-17 09:10:51 -08:00

perplexity.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

philosophy.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

pr_checks.mdx

[docs] fix wrong file name in pr_check (#15380)

2022-01-28 07:52:01 -05:00

preprocessing.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

quicktour.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

sagemaker.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

serialization.mdx

Add ONNX configuration classes to docs (#15121)

2022-01-12 16:33:32 +01:00

task_summary.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

testing.mdx

[doc] normalize HF Transformers string (#15023)

2022-01-10 08:44:33 -08:00

tokenizer_summary.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

training.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

troubleshooting.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00