HuggingFace_transformer

Files

Loubna Ben Allal bbbb453e58 Add an examples folder for code downstream tasks (#18679 )

* add examples subfolder

* mention examples in codeparrot readme

* use Trainer optimizer and scheduler type and add output_dir as argument

* add example of text-to-python and python-to-text models

* mention the downstream examples in the readme

* fix typo

2022-08-18 18:24:24 +02:00

tests

[CodeParrot] Near-deduplication with jaccard similarity (#17054 )

2022-06-21 14:23:36 +02:00

arguments.py

Update CodeParrot readme to include training in Megatron (#17798 )

2022-07-27 11:59:08 +02:00

bpe_training.py

fix: switch from slow to generic tokenizer class (#15122 )

2022-01-12 09:12:43 -05:00

codeparrot_training.py

Fix CodeParrot training script (#17291 )