* Update hans data to be able to use Trainer

* Fixes

* Deal with tokenizer that don't have token_ids

* Clean up things

* Simplify data use

* Fix the input dict

* Formatting + proper path in README
This commit is contained in:
Sylvain Gugger
2020-06-13 09:35:13 -04:00
committed by GitHub
parent ca5e1cdf8e
commit 403d309857
4 changed files with 339 additions and 382 deletions

View File

@@ -11,7 +11,7 @@ export HANS_DIR=path-to-hans
export MODEL_TYPE=type-of-the-model-e.g.-bert-roberta-xlnet-etc
export MODEL_PATH=path-to-the-model-directory-that-is-trained-on-NLI-e.g.-by-using-run_glue.py
python examples/hans/test_hans.py \
python examples/adversarial/test_hans.py \
--task_name hans \
--model_type $MODEL_TYPE \
--do_eval \