thomwolf
c19b8e4ae0
fixing CTRL tests and OpenAI GPT tests
2019-10-09 13:51:05 +02:00
thomwolf
6dce6dda1b
fixing TF 2.0 model - adding more severe test on pt/tf equivalence
2019-10-09 11:57:55 +02:00
thomwolf
c56d921dda
adding TF 2.0 model
2019-10-09 11:07:43 +02:00
thomwolf
45dc04f33d
tf model [WIP]
2019-10-08 17:37:17 +02:00
thomwolf
248314772f
fix tokenization
2019-10-08 17:19:28 +02:00
thomwolf
03c2c762a6
update tokenizer
2019-10-08 17:12:03 +02:00
thomwolf
3edfa1d6aa
update model to use past
2019-10-08 17:11:58 +02:00
thomwolf
bd5363cc83
update CTRL configuration
2019-10-07 15:37:30 +02:00
thomwolf
dc89441167
update CTRL pytorch model
2019-10-07 15:37:25 +02:00
thomwolf
320b7a7e01
fix #1416
2019-10-07 14:26:59 +02:00
keskarnitish
dbed1c5d94
Adding CTRL (squashed commit)
...
adding conversion script
adding first draft of modeling & tokenization
adding placeholder for test files
bunch of changes
registering the tokenizer/model/etc
tests
change link; something is very VERY wrong here
weird end-of-word thingy going on
i think the tokenization works now ; wrote the unit tests
overall structure works;load w next
the monster is alive!
works after some cleanup as well
adding emacs autosave to gitignore
currently only supporting the 48 layer one; seems to infer fine on my macbook
cleanup
fixing some documentation
fixing some documentation
tests passing?
now works on CUDA also
adding greedy?
adding greedy sampling
works well
2019-10-03 22:29:03 -07:00
VictorSanh
2dc8cb8734
fix unknown imports (*ForMultipleChoice) in run_multiple_choice
2019-09-29 19:51:01 -04:00
Thomas Wolf
ae50ad91ea
Merge pull request #1362 from FeiWang96/doc
...
fix link
2019-09-28 10:26:42 +02:00
wangfei
60f791631b
Fix link in readme
2019-09-28 16:20:17 +08:00
Ikuya Yamada
a6a6d9e638
fix padding_idx of RoBERTa model
2019-09-27 19:03:55 -04:00
Julien Chaumond
d8b641c839
6 -> 8 models
2019-09-27 17:22:01 -04:00
Julien Chaumond
c6acbdd50a
Close #1304
2019-09-27 17:02:53 -04:00
Thomas Wolf
df7cd9e4e4
Merge pull request #1353 from wendingp/patch-1
...
Fix some typos
2019-09-27 23:00:34 +02:00
Thomas Wolf
6a17b3c51b
Merge pull request #1355 from agrinh/master
...
Fix tensorflow_dataset glue support
2019-09-27 22:59:54 +02:00
Thomas Wolf
04e9a6f512
Merge pull request #1359 from dennymarcels/patch-1
...
Update run_lm_finetuning.py
2019-09-27 22:58:19 +02:00
Denny
9478590630
Update run_lm_finetuning.py
...
The previous method, just as phrased, did not exist in the class.
2019-09-27 15:18:42 -03:00
Agrin Hilmkil
795b3e76ff
Add docstring for processor method
2019-09-27 17:32:28 +02:00
Agrin Hilmkil
e31a472801
Fix tensorflow_dataset glue support
...
`glue_convert_examples_to_features` assumed that tensorflow_dataset
examples contains the features `'sentence1'` and `'sentence2'`. This
commit encapsulates the choice of features in the glue processor and
uses that to parse examples.
2019-09-27 17:16:02 +02:00
pj
4f2b6579bf
Fix some typos
2019-09-27 22:55:43 +08:00
Thomas Wolf
ca559826c4
Merge pull request #1349 from ogabrielluiz/master
...
Just some typos
2019-09-27 13:08:00 +02:00
Gabriel Luiz Freitas Almeida
d2de5b9d8c
Just some typos
2019-09-27 07:08:36 -03:00
Thomas Wolf
d83d295763
Merge pull request #1337 from mgrankin/fastdataset
...
faster dataset building
2019-09-27 10:35:12 +02:00
Thomas Wolf
f6de000305
Merge pull request #1346 from BramVanroy/documentation
...
Add small note about the output of hidden states (closes #1332 )
2019-09-27 10:30:07 +02:00
BramVanroy
15749bfc10
Add small note about the output of hidden states
2019-09-27 10:01:36 +02:00
thomwolf
da2e47ad15
clean up a little run_tf_glue
2019-09-27 09:41:15 +02:00
thomwolf
528c288fa9
clean up run_tf_glue
2019-09-27 09:40:29 +02:00
VictorSanh
702f589848
fix input in run_glue for distilbert
2019-09-27 00:20:14 -04:00
Julien Chaumond
22d2fded2c
[docs] Fix doc auto-deploy
...
Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr >
2019-09-26 18:22:45 -04:00
Julien Chaumond
fc9faa8a47
[docs] Doc tweaks
...
Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr >
2019-09-26 18:19:51 -04:00
LysandreJik
ecfddc6034
Update RoBERTa and GPT-2 Tokenizer documentation ( fix #1343 )
2019-09-26 16:49:03 -04:00
LysandreJik
93f0c5fc72
Repository link in the documentation
2019-09-26 11:45:00 -04:00
thomwolf
6c3b131516
typo in readme/doc
2019-09-26 16:23:28 +02:00
thomwolf
f83b35b77d
Merge branch 'master' of https://github.com/huggingface/pytorch-transformers
2019-09-26 16:14:23 +02:00
thomwolf
4e63c90720
update installation instructions in readme
2019-09-26 16:14:21 +02:00
LysandreJik
7e957237e4
[Doc] XLM + Torch in documentation
2019-09-26 10:08:56 -04:00
LysandreJik
302a4813a5
Doc building requirements [TF2]
2019-09-26 09:57:30 -04:00
mgrankin
f71a4577b8
faster dataset building
2019-09-26 16:53:13 +03:00
LysandreJik
a3e0dbba95
Doc building requirements [TF]
2019-09-26 09:51:14 -04:00
Lysandre Debut
0f92f76ca3
CircleCI reference in README
2019-09-26 08:59:52 -04:00
LysandreJik
4094958df2
Doc building requirements
2019-09-26 08:50:55 -04:00
LysandreJik
7d8b395afa
Doc building requirements
2019-09-26 08:49:31 -04:00
LysandreJik
927904bc91
[doc] pytorch_transformers -> transformers
2019-09-26 08:47:15 -04:00
LysandreJik
294edfd83d
Release version in documentation
2019-09-26 08:16:12 -04:00
LysandreJik
de5e4864cb
Documentation
2019-09-26 08:04:54 -04:00
thomwolf
e4e35296fb
update setup.py metadata
2019-09-26 13:52:24 +02:00
