LysandreJik
a7ca6d738b
Padding side is tokenizer-dependant
2019-12-04 15:43:34 -05:00
LysandreJik
cca75e7884
Kill the demon spawn
2019-12-04 15:42:29 -05:00
LysandreJik
bf119c0568
TFDS dataset can now be evaluated
2019-12-04 11:34:59 -05:00
LysandreJik
de276de1c1
Working evaluation
2019-12-03 17:15:51 -05:00
LysandreJik
285b1241e3
Added SquadResult
2019-12-03 15:00:49 -05:00
Lysandre
1e9ac5a7cf
New -> normal
2019-11-28 17:43:47 -05:00
Lysandre
0b84b9fd8a
Add processors to __init__
2019-11-28 17:38:52 -05:00
Lysandre
f671997ef7
Interface with TFDS
2019-11-28 17:17:20 -05:00
Lysandre
bd41e8292a
Cleanup & Evaluation now works
2019-11-28 16:03:56 -05:00
Lysandre
0669c1fcd1
SQuAD v2 BERT + XLNet
2019-11-25 19:22:21 -05:00
Lysandre
e0e55bc550
Manage training example & refactor the refactor
2019-11-22 16:27:45 -05:00
Lysandre
c3ba645237
Works for XLNet
2019-11-22 16:27:37 -05:00
LysandreJik
a5a8a6175f
Works for BERT
2019-11-22 16:27:31 -05:00
Lysandre
72e506b22e
wip
2019-11-22 16:26:00 -05:00
Lysandre
ea52f82455
Moved some SQuAD logic to /data
2019-11-22 16:25:52 -05:00
Lysandre
beaf66b1f3
Remove break
2019-10-24 21:43:28 +00:00
Lysandre
bab6ad01aa
run_tf_glue works with all tasks
2019-10-24 21:41:45 +00:00
thomwolf
78ef1a9930
fixes
2019-10-04 17:59:44 -04:00
Agrin Hilmkil
795b3e76ff
Add docstring for processor method
2019-09-27 17:32:28 +02:00
Agrin Hilmkil
e31a472801
Fix tensorflow_dataset glue support
...
`glue_convert_examples_to_features` assumed that tensorflow_dataset
examples contains the features `'sentence1'` and `'sentence2'`. This
commit encapsulates the choice of features in the glue processor and
uses that to parse examples.
2019-09-27 17:16:02 +02:00
LysandreJik
36f592cc82
Updated doc for InputExample and InputFeatures
2019-09-26 07:45:40 -04:00
LysandreJik
ad4a393e2e
Changed processor documentation architecture. Added documentation for GLUE
2019-09-26 07:45:40 -04:00
thomwolf
31c23bd5ee
[BIG] pytorch-transformers => transformers
2019-09-26 10:15:53 +02:00
