Gunjan Chhablani ae1f835028 Add PLBart (#13269) ...

* Init PLBART

* Add missing configuration file

* Add conversion script and configurationf ile

* Fix style

* Update modeling and conversion scripts

* Fix scale embedding in config

* Add comment

* Fix conversion script

* Add classification option to conversion script

* Fix vocab size in config doc

* Add tokenizer files from MBart50

* Allow no lang code in regular tokenizer

* Add PLBart Tokenizer Converters

* Remove mask from multi tokenizer

* Remove mask from multi tokenizer

* Change from MBart-50 to MBart tokenizer

* Fix names and modify src/tgt behavior

* Fix imports for tokenizer

* Remove <mask> from multi tokenizer

* Fix style

* Change tokenizer_class to processor_class

* Add attribute map to config class

* Update modeling file to modified MBart code

* Update configuration file to MBart style configuration

* Fix tokenizer

* Separate tokenizers

* Fix error in tokenization auto

* Copy MBart tests

* Replace with MBart tokenization tests

* Fix style

* Fix language code in multi tokenizer

* Fix configuration docs

* Add entry for plbart_multi in transformers init

* Add dummy objects and fix imports

* Fix modeling tests

* Add TODO in config

* Fix copyright year

* Fix modeling docs and test

* Fix some tokenization tests and style

* Add changes from review

* Fix copies

* Fix docs

* Fix docs

* Fix style

* Fix year

* Add changes from review

* Remove extra changes

* Fix base tokenizer and doc

* Fix style

* Fix modeling and slow tokenizer tests

* Remove Multi-tokenizer Converter and Tests

* Delete QA model and Multi Tokenizer dummy objects

* Fix repo consistency and code quality issues

* Fix example documentation

* Fix style

* Remove PLBartTokenizer from type checking in init

* Fix consistency issue

* Add changes from review

* Fix style

* Remove PLBartTokenizerFast

* Remove FastTokenizer converter

* Fix AutoTokenzier mapping

* Add plbart to toctree and fix consistency issues

* Add language codes tokenizer test

* Fix styling and doc issues

* Add fixes for failing tests

* Fix copies

* Fix failing modeling test

* Change assert to assertTrue in modeling tests

2022-02-18 14:17:09 +01:00

..

internal

TF generate refactor - Greedy Search (#15562)

2022-02-15 17:54:43 +01:00

main_classes

Usage examples for logger (#15657)

2022-02-16 10:15:13 +01:00

model_doc

Add PLBart (#13269)

2022-02-18 14:17:09 +01:00

_config.py

Prevent style_doc from tempering the config file

2021-12-10 15:31:43 -05:00

_toctree.yml

Add PLBart (#13269)

2022-02-18 14:17:09 +01:00

accelerate.mdx

Fix code format for Accelerate doc (#15335)

2022-01-27 13:49:04 -06:00

add_new_model.mdx

Adding a model, more doc for pushing to the hub (#15690)

2022-02-18 09:11:18 +01:00

add_new_pipeline.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

autoclass_tutorial.mdx

Update tutorial docs (#15165)

2022-02-01 18:31:35 -06:00

benchmarks.mdx

[doc] normalize HF Transformers string (#15023)

2022-01-10 08:44:33 -08:00

bertology.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

community.mdx

add t5 ner finetuning (#15432)

2022-01-31 17:03:06 +01:00

contributing.md

Update installation page and add contributing to the doc (#5084)

2020-06-17 14:01:10 -04:00

converting_tensorflow_models.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

create_a_model.mdx

Create a custom model guide (#15489)

2022-02-07 12:34:56 -06:00

custom_datasets.mdx

Added missing code in exemplary notebook - custom datasets fine-tuning (#15300)

2022-01-25 17:26:17 -05:00

custom_models.mdx

Mark "code in the Hub" API as experimental (#15624)

2022-02-11 09:55:31 -05:00

debugging.mdx

add a network debug script and document it (#15652)

2022-02-15 08:48:00 -08:00

examples.md

per_device instead of per_gpu/error thrown when argument unknown (#4618)

2020-05-27 11:36:55 -04:00

fast_tokenizers.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

glossary.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

index.mdx

Add PLBart (#13269)

2022-02-18 14:17:09 +01:00

installation.mdx

Get started docs (#15098)

2022-01-28 19:01:37 -06:00

migration.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

model_sharing.mdx

Update model share tutorial (#15288)

2022-01-28 18:49:26 -06:00

model_summary.mdx

Add "open in hf spaces" gradio button issue #73 (#15106)

2022-01-14 10:12:30 -05:00

multilingual.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

notebooks.md

Update notebooks (#3620)

2020-04-06 14:32:39 -04:00

parallelism.mdx

[deepspeed docs] Megatron-Deepspeed info (#15488)

2022-02-04 11:15:13 -08:00

performance.mdx

add model scaling section (#15119)

2022-02-09 15:27:30 +01:00

perplexity.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

philosophy.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

pipeline_tutorial.mdx

Update tutorial docs (#15165)

2022-02-01 18:31:35 -06:00

pr_checks.mdx

[docs] fix wrong file name in pr_check (#15380)

2022-01-28 07:52:01 -05:00

preprocessing.mdx

Update tutorial docs (#15165)

2022-02-01 18:31:35 -06:00

quicktour.mdx

Re-export KeyDataset. (#15645)

2022-02-15 17:49:38 +01:00

sagemaker.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00

serialization.mdx

Add PLBart (#13269)

2022-02-18 14:17:09 +01:00

task_summary.mdx

Doc styler examples (#14953)

2021-12-27 19:07:46 -05:00

testing.mdx

[doc] normalize HF Transformers string (#15023)

2022-01-10 08:44:33 -08:00

tokenizer_summary.mdx

Fix grammar in tokenizer_summary (#15614)

2022-02-11 16:51:30 -05:00

training.mdx

Update fine-tune docs (#15259)

2022-02-01 18:28:12 -06:00

troubleshooting.mdx

Convert rst files (#14888)

2021-12-22 16:14:35 -05:00