Commit Graph

240 Commits

Author SHA1 Message Date
Lysandre
f6f382532b ALBERT in TF2 2019-11-26 13:08:12 -05:00
Lysandre
d9daad98c7 Re-ordering of group_idx/layer_idx + Python 2 tests 2019-11-26 13:08:12 -05:00
Lysandre
9d5c49546f Tests for AlbertForQuestionAnswering AlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre
16263f9685 Headmasking 2019-11-26 13:08:12 -05:00
Lysandre
abb23a78ba Head pruning for ALBERT 2019-11-26 13:08:12 -05:00
Lysandre
4374eaea78 ALBERT for SQuAD 2019-11-26 13:08:12 -05:00
Lysandre
70d99980de ALBERT-V2 2019-11-26 13:08:12 -05:00
Lysandre
c110c41fdb Run GLUE and remove LAMB 2019-11-26 13:08:12 -05:00
Lysandre
6637a77f80 AlbertForSequenceClassification 2019-11-26 13:08:12 -05:00
Lysandre
0d07a23c04 LAMB implementation 2019-11-26 13:08:12 -05:00
Lysandre
c987545592 Converting script 2019-11-26 13:08:12 -05:00
Lysandre
4f3a54bfc8 ALBERT can load pre-trained models. Doesn't inherit from BERT anymore. 2019-11-26 13:08:12 -05:00
Lysandre
c4403006b8 External MLM head 2019-11-26 13:08:12 -05:00
Lysandre
b21402fc86 Python 2 tests + licence 2019-11-26 13:08:12 -05:00
Lysandre
c14a22272f ALBERT passes all tests 2019-11-26 13:08:12 -05:00
Lysandre
870320a24e Early tests 2019-11-26 13:08:12 -05:00
Lysandre
25a31953e8 Output Attentions + output hidden states 2019-11-26 13:08:12 -05:00
Lysandre
ce9eade29c Initializer range using BertPreTrainedModel 2019-11-26 13:08:12 -05:00
Lysandre
5680a11063 Activation function managed from the config file 2019-11-26 13:08:12 -05:00
Lysandre
1e5b31c388 Several fixes and improvements 2019-11-26 13:08:12 -05:00
Lysandre
ee20201d33 Tokenization tests + fixes + init 2019-11-26 13:08:12 -05:00
Lysandre
e3ea5d1d8d Docstrings 2019-11-26 13:08:12 -05:00
Lysandre
fedac786d4 Tokenization + small fixes 2019-11-26 13:08:12 -05:00
Lysandre
67b422662c Documentation + improved AlbertForMaskedLM 2019-11-26 13:08:12 -05:00
Lysandre
1b92564330 Reorganize and cleanup 2019-11-26 13:08:12 -05:00
Lysandre
12290c0d5c Handles multi layer and multi groups 2019-11-26 13:08:12 -05:00
Lysandre
139affaa8d Albert layer/layer groups 2019-11-26 13:08:12 -05:00
Lysandre
91ccbae788 Accepts multiple sizes 2019-11-26 13:08:12 -05:00
Lysandre
c0c2088333 ALBERT model 2019-11-26 13:08:12 -05:00
v_sboliu
8e5d84fcc1 Fixed typo 2019-11-26 09:01:32 -05:00
Bilal Khan
07bf43074f Fix GPT2 docstring 2019-11-25 11:32:00 -05:00
Evpok Padding
fa963ecc59 if→elif 2019-11-25 10:21:03 -05:00
Evpok Padding
c8eb8157b8 fix docstrings 2019-11-25 10:21:03 -05:00
Evpok Padding
99f750d64e add Camembert models to modeling_auto 2019-11-25 10:21:03 -05:00
Nikolay Korolev
041a901f32 Fix typo in documentation. toto -> to 2019-11-23 10:55:16 -05:00
Stefan Schweter
0b3d45eb64 camembert: add implementation for save_vocabulary method 2019-11-18 15:49:44 +01:00
Stefan Schweter
33753d9139 module: import CamembertForTokenClassification 2019-11-18 14:14:54 +01:00
Stefan Schweter
d32ce2c8df camembert: add wrapper for CamembertForTokenClassification 2019-11-18 14:14:19 +01:00
Julien Chaumond
0477b307c7 [camembert] tokenizer: use additional_special_tokens 2019-11-16 00:11:07 -05:00
Julien Chaumond
f9abf73e31 [camembert] realign w/ recent changes 2019-11-16 00:11:07 -05:00
Julien Chaumond
26858f27cb [camembert] Upload to s3 + rename script 2019-11-16 00:11:07 -05:00
Louis MARTIN
035fea5315 Add CamemBERT to auto files and docs 2019-11-16 00:11:07 -05:00
Louis MARTIN
694d4fcbb6 Add CamemBERT classes to __init__.py 2019-11-16 00:11:07 -05:00
Louis MARTIN
fb6c70a91d Update tokenization_camembert.py with urls 2019-11-16 00:11:07 -05:00
Louis MARTIN
e44b939e71 Add configuration_camembert.py and modeling_camembert.py 2019-11-16 00:11:07 -05:00
Louis MARTIN
14b3aa3b3c Add tokenization_camembert.py 2019-11-16 00:11:07 -05:00
Thomas Wolf
74ce8de7d8 Merge pull request #1792 from stefan-it/distilbert-for-token-classification
DistilBERT for token classification
2019-11-14 22:47:53 +01:00
Thomas Wolf
5b322a36db Merge pull request #1811 from huggingface/special-tokens
Fix special tokens addition in decoder #1807
2019-11-14 22:17:24 +01:00
Thomas Wolf
1a237d7f42 Merge pull request #1831 from iedmrc/gpt2-tokenization-sum-func-replacement
sum() is replaced by itertools.chain.from_iterable()
2019-11-14 22:11:54 +01:00
Thomas Wolf
df99f8c5a1 Merge pull request #1832 from huggingface/memory-leak-schedulers
replace LambdaLR scheduler wrappers by function
2019-11-14 22:10:31 +01:00