[research_projects] deal with security alerts (#15594)
* [research_projects] deal with security alerts * add a note of the original PL ver and warning
This commit is contained in:
@@ -10,6 +10,9 @@ Blog link: https://eng.uber.com/pplm
|
|||||||
|
|
||||||
Please check out the repo under uber-research for more information: https://github.com/uber-research/PPLM
|
Please check out the repo under uber-research for more information: https://github.com/uber-research/PPLM
|
||||||
|
|
||||||
|
# Note
|
||||||
|
|
||||||
|
⚠️ This project should be run with pytorch-lightning==1.0.4 which has a potential security vulnerability
|
||||||
|
|
||||||
## Setup
|
## Setup
|
||||||
|
|
||||||
@@ -51,4 +54,3 @@ python run_pplm.py -D sentiment --class_label 2 --cond_text "My dog died" --leng
|
|||||||
1. Increase `--stepsize` to intensify topic control, and decrease its value to soften the control. `--stepsize 0` recovers the original uncontrolled GPT-2 model.
|
1. Increase `--stepsize` to intensify topic control, and decrease its value to soften the control. `--stepsize 0` recovers the original uncontrolled GPT-2 model.
|
||||||
|
|
||||||
2. Use `--class_label 3` for negative, and `--class_label 2` for positive
|
2. Use `--class_label 3` for negative, and `--class_label 2` for positive
|
||||||
|
|
||||||
|
|||||||
@@ -5,7 +5,7 @@ psutil
|
|||||||
sacrebleu
|
sacrebleu
|
||||||
rouge-score
|
rouge-score
|
||||||
tensorflow_datasets
|
tensorflow_datasets
|
||||||
pytorch-lightning==1.0.4
|
pytorch-lightning
|
||||||
matplotlib
|
matplotlib
|
||||||
git-python==1.0.3
|
git-python==1.0.3
|
||||||
faiss-cpu
|
faiss-cpu
|
||||||
|
|||||||
@@ -15,6 +15,9 @@ This code can be modified to experiment with other research on retrival augmente
|
|||||||
|
|
||||||
To start training, use the bash script (finetune_rag_ray_end2end.sh) in this folder. This script also includes descriptions on each command-line argument used.
|
To start training, use the bash script (finetune_rag_ray_end2end.sh) in this folder. This script also includes descriptions on each command-line argument used.
|
||||||
|
|
||||||
|
# Note
|
||||||
|
|
||||||
|
⚠️ This project should be run with pytorch-lightning==1.3.1 which has a potential security vulnerability
|
||||||
|
|
||||||
# Testing
|
# Testing
|
||||||
|
|
||||||
|
|||||||
@@ -2,6 +2,6 @@ faiss-cpu >= 1.7.0
|
|||||||
datasets >= 1.6.2
|
datasets >= 1.6.2
|
||||||
psutil >= 5.7.0
|
psutil >= 5.7.0
|
||||||
torch >= 1.4.0
|
torch >= 1.4.0
|
||||||
pytorch-lightning == 1.3.1
|
pytorch-lightning
|
||||||
nvidia-ml-py3 == 7.352.0
|
nvidia-ml-py3 == 7.352.0
|
||||||
ray >= 1.3.0
|
ray >= 1.3.0
|
||||||
|
|||||||
@@ -11,6 +11,10 @@ Such contextualized inputs are passed to the generator.
|
|||||||
|
|
||||||
Read more about RAG at https://arxiv.org/abs/2005.11401.
|
Read more about RAG at https://arxiv.org/abs/2005.11401.
|
||||||
|
|
||||||
|
# Note
|
||||||
|
|
||||||
|
⚠️ This project should be run with pytorch-lightning==1.3.1 which has a potential security vulnerability
|
||||||
|
|
||||||
# Finetuning
|
# Finetuning
|
||||||
|
|
||||||
Our finetuning logic is based on scripts from [`examples/seq2seq`](https://github.com/huggingface/transformers/tree/master/examples/seq2seq). We accept training data in the same format as specified there - we expect a directory consisting of 6 text files:
|
Our finetuning logic is based on scripts from [`examples/seq2seq`](https://github.com/huggingface/transformers/tree/master/examples/seq2seq). We accept training data in the same format as specified there - we expect a directory consisting of 6 text files:
|
||||||
|
|||||||
@@ -3,5 +3,5 @@ datasets >= 1.0.1
|
|||||||
psutil >= 5.7.0
|
psutil >= 5.7.0
|
||||||
torch >= 1.4.0
|
torch >= 1.4.0
|
||||||
transformers
|
transformers
|
||||||
pytorch-lightning==1.3.1
|
pytorch-lightning
|
||||||
GitPython
|
GitPython
|
||||||
@@ -13,6 +13,10 @@ Author: Sam Shleifer (https://github.com/sshleifer)
|
|||||||
- `FSMTForConditionalGeneration`
|
- `FSMTForConditionalGeneration`
|
||||||
- `T5ForConditionalGeneration`
|
- `T5ForConditionalGeneration`
|
||||||
|
|
||||||
|
# Note
|
||||||
|
|
||||||
|
⚠️ This project should be run with pytorch-lightning==1.0.4 which has a potential security vulnerability
|
||||||
|
|
||||||
## Datasets
|
## Datasets
|
||||||
|
|
||||||
#### XSUM
|
#### XSUM
|
||||||
|
|||||||
@@ -4,7 +4,7 @@ psutil
|
|||||||
sacrebleu
|
sacrebleu
|
||||||
rouge-score
|
rouge-score
|
||||||
tensorflow_datasets
|
tensorflow_datasets
|
||||||
pytorch-lightning==1.0.4
|
pytorch-lightning
|
||||||
matplotlib
|
matplotlib
|
||||||
git-python==1.0.3
|
git-python==1.0.3
|
||||||
faiss-cpu
|
faiss-cpu
|
||||||
|
|||||||
Reference in New Issue
Block a user