Add an examples folder for code downstream tasks (#18679)

* add examples subfolder

* mention examples in codeparrot readme

* use Trainer optimizer and scheduler type and add output_dir as argument

* add example of text-to-python and python-to-text models

* mention the downstream examples in the readme

* fix typo
This commit is contained in:
Loubna Ben Allal
2022-08-18 18:24:24 +02:00
committed by GitHub
parent a123eee9df
commit bbbb453e58
5 changed files with 200 additions and 2 deletions

View File

@@ -12,7 +12,11 @@ This is an open-source effort to train and evaluate code generation models. Code
- continuously push checkpoints to the hub with `huggingface_hub`
- stream the dataset with `datasets` during training to avoid disk bottlenecks
- apply the `code_eval` metric in `datasets` to evaluate on [OpenAI's _HumanEval_ benchmark](https://huggingface.co/datasets/openai_humaneval)
- showcase examples for downstream tasks with code models in [examples](https://github.com/huggingface/transformers/tree/main/examples/research_projects/codeparrot/examples) folder:
- Algorithmic complexity prediction
- Code generation from english text
- Code explanation
## Installation
To install the dependencies simply run the following command:
```bash