Lysandre
dc4e9e5cb3
DataParallel for SQuAD + fix XLM
2019-12-10 19:21:20 +00:00
Lysandre Debut
00c4e39581
Merge branch 'master' into squad-refactor
2019-12-09 10:41:15 -05:00
LysandreJik
e9217da5ff
Cleanup
...
Improve global visibility on the run_squad script, remove unused files and fixes related to XLNet.
2019-12-05 16:01:51 -05:00
LysandreJik
9ecd83dace
Patch evaluation for impossible values + cleanup
2019-12-05 14:44:57 -05:00
LysandreJik
ce158a076f
Return dataset (pytorch)
2019-12-04 17:55:52 -05:00
LysandreJik
7a03519975
Documentation
2019-12-04 17:24:35 -05:00
LysandreJik
33508ae310
Remove only_first
2019-12-04 16:26:45 -05:00
LysandreJik
f7e4a7cdfa
Cleanup
2019-12-04 16:24:15 -05:00
LysandreJik
a7ca6d738b
Padding side is tokenizer-dependant
2019-12-04 15:43:34 -05:00
LysandreJik
cca75e7884
Kill the demon spawn
2019-12-04 15:42:29 -05:00
LysandreJik
bf119c0568
TFDS dataset can now be evaluated
2019-12-04 11:34:59 -05:00
LysandreJik
9ddc3f1a12
Naming update + XLNet/XLM evaluation
2019-12-04 10:37:00 -05:00
LysandreJik
de276de1c1
Working evaluation
2019-12-03 17:15:51 -05:00
LysandreJik
c835bc85c2
Compute predictions
2019-12-03 15:28:16 -05:00
LysandreJik
285b1241e3
Added SquadResult
2019-12-03 15:00:49 -05:00
Lysandre
1e9ac5a7cf
New -> normal
2019-11-28 17:43:47 -05:00
Lysandre
0b84b9fd8a
Add processors to __init__
2019-11-28 17:38:52 -05:00
Lysandre
f671997ef7
Interface with TFDS
2019-11-28 17:17:20 -05:00
Lysandre
bd41e8292a
Cleanup & Evaluation now works
2019-11-28 16:03:56 -05:00
VictorSanh
07ab8d7af6
fix bug
2019-11-27 11:07:22 -05:00
VictorSanh
d474022639
cleaning simple_accuracy since not used anymore
2019-11-27 11:07:22 -05:00
VictorSanh
bcd8dc6b48
move xnli_compute_metrics to data/metrics
2019-11-27 11:07:22 -05:00
VictorSanh
73fe2e7385
remove fstrings
2019-11-27 11:07:22 -05:00
VictorSanh
d5910b312f
move xnli processor (and utils) to transformers/data/processors
2019-11-27 11:07:22 -05:00
Lysandre
0669c1fcd1
SQuAD v2 BERT + XLNet
2019-11-25 19:22:21 -05:00
Lysandre
e0e55bc550
Manage training example & refactor the refactor
2019-11-22 16:27:45 -05:00
Lysandre
c3ba645237
Works for XLNet
2019-11-22 16:27:37 -05:00
LysandreJik
a5a8a6175f
Works for BERT
2019-11-22 16:27:31 -05:00
Lysandre
72e506b22e
wip
2019-11-22 16:26:00 -05:00
Lysandre
ea52f82455
Moved some SQuAD logic to /data
2019-11-22 16:25:52 -05:00
Lysandre
beaf66b1f3
Remove break
2019-10-24 21:43:28 +00:00
Lysandre
bab6ad01aa
run_tf_glue works with all tasks
2019-10-24 21:41:45 +00:00
thomwolf
78ef1a9930
fixes
2019-10-04 17:59:44 -04:00
Agrin Hilmkil
795b3e76ff
Add docstring for processor method
2019-09-27 17:32:28 +02:00
Agrin Hilmkil
e31a472801
Fix tensorflow_dataset glue support
...
`glue_convert_examples_to_features` assumed that tensorflow_dataset
examples contains the features `'sentence1'` and `'sentence2'`. This
commit encapsulates the choice of features in the glue processor and
uses that to parse examples.
2019-09-27 17:16:02 +02:00
LysandreJik
36f592cc82
Updated doc for InputExample and InputFeatures
2019-09-26 07:45:40 -04:00
LysandreJik
ad4a393e2e
Changed processor documentation architecture. Added documentation for GLUE
2019-09-26 07:45:40 -04:00
thomwolf
31c23bd5ee
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
