Matthew Carrigan
|
a8a577ba93
|
Reduced memory usage for pregenerating the data a lot by writing it
out on the fly without shuffling - the Sampler in the finetuning script
will shuffle for us.
|
2019-03-21 14:05:52 +00:00 |
|
Matthew Carrigan
|
0ae59e662d
|
Reduced memory usage for pregenerating the data a lot by writing it
out on the fly without shuffling - the Sampler in the finetuning script
will shuffle for us.
|
2019-03-21 14:04:17 +00:00 |
|
Matthew Carrigan
|
6a9038ba53
|
Removed an old irrelevant comment
|
2019-03-21 13:36:41 +00:00 |
|
Matthew Carrigan
|
29a392fbcf
|
Small README changes
|
2019-03-20 17:35:17 +00:00 |
|
Matthew Carrigan
|
832b2b0058
|
Adding README
|
2019-03-20 17:31:49 +00:00 |
|
Matthew Carrigan
|
934d3f4d2f
|
Syncing up argument names between the scripts
|
2019-03-20 17:23:23 +00:00 |
|
Matthew Carrigan
|
f19ba35b2b
|
Move old finetuning script into the new folder
|
2019-03-20 16:47:06 +00:00 |
|
Matthew Carrigan
|
7de5c6aa5e
|
PEP8 and formatting cleanups
|
2019-03-20 16:44:04 +00:00 |
|
Matthew Carrigan
|
1798e98e5a
|
Added final TODOs
|
2019-03-20 16:42:37 +00:00 |
|
Matthew Carrigan
|
c64c2fc4c2
|
Fixed embarrassing indentation problem
|
2019-03-20 15:42:57 +00:00 |
|
Matthew Carrigan
|
0540d360f2
|
Fixed logging
|
2019-03-20 15:36:51 +00:00 |
|
Matthew Carrigan
|
976554a472
|
First commit of the new LM finetuning
|
2019-03-20 14:23:51 +00:00 |
|
tseretelitornike
|
83857ffeaa
|
Added missing imports.
|
2019-03-15 12:45:48 +01:00 |
|
Yongbo Wang
|
d1e4fa98a9
|
typo in annotation
modify `heruistic` to `heuristic` in line 660, `charcter` to `character` in line 661.
|
2019-03-14 17:32:15 +08:00 |
|
Yongbo Wang
|
3d6452163d
|
typo
modify `mull` to `null` in line 474 annotation.
|
2019-03-14 17:03:38 +08:00 |
|
thomwolf
|
a98dfe4ced
|
fixing #377 (empty nbest_predictions.json)
|
2019-03-14 09:57:06 +01:00 |
|
Yongbo Wang
|
22a465a91f
|
Simplify code, delete redundancy line
delete redundancy line `if args.train`, simplify code.
|
2019-03-13 09:42:06 +08:00 |
|
Elon Musk
|
66d8206809
|
Update run_gpt2.py
|
2019-03-08 11:59:08 -05:00 |
|
thomwolf
|
7cc35c3104
|
fix openai gpt example and updating readme
|
2019-03-06 11:43:21 +01:00 |
|
thomwolf
|
994d86609b
|
fixing PYTORCH_PRETRAINED_BERT_CACHE use in examples
|
2019-03-06 10:21:24 +01:00 |
|
thomwolf
|
5c85fc3977
|
fix typo - logger info
|
2019-03-06 10:05:21 +01:00 |
|
Thomas Wolf
|
8e36da7acb
|
Merge pull request #347 from jplehmann/feature/sst2-processor
Processor for SST-2 task
|
2019-03-06 09:48:27 +01:00 |
|
Thomas Wolf
|
3c01dfb775
|
Merge pull request #338 from CatalinVoss/patch-3
Fix top k generation for k != 0
|
2019-03-06 09:47:33 +01:00 |
|
John Lehmann
|
0f96d4b1f7
|
Run classifier processor for SST-2.
|
2019-03-05 13:38:28 -06:00 |
|
Catalin Voss
|
4b4b079272
|
Fix top k generation for k != 0
|
2019-03-02 21:54:44 -08:00 |
|
Catalin Voss
|
c0cf0a04d5
|
Fix typo
|
2019-02-27 18:01:06 -08:00 |
|
Ben Johnson
|
8607233679
|
Update run_openai_gpt.py
|
2019-02-20 13:58:54 -05:00 |
|
thomwolf
|
0202da0271
|
remove unnecessary example
|
2019-02-18 13:51:42 +01:00 |
|
thomwolf
|
690a0dbf36
|
fix example - masking
|
2019-02-18 10:50:30 +01:00 |
|
thomwolf
|
fbb248a2e4
|
examples testing
|
2019-02-18 01:28:18 +01:00 |
|
thomwolf
|
b65f07d8c0
|
adding examples
|
2019-02-18 00:55:33 +01:00 |
|
wlhgtc
|
8efaf8f176
|
fix 'best_non_null_entry' is None error
|
2019-02-15 15:57:25 +08:00 |
|
Davide Fiocco
|
65df0d78ed
|
--do_lower_case is duplicated in parser args
Deleting one repetition (please review!)
|
2019-02-13 15:30:05 +01:00 |
|
Thomas Wolf
|
03cdb2a390
|
Merge pull request #254 from huggingface/python_2
Adding OpenAI GPT and Transformer-XL models, compatibility with Python 2
|
2019-02-11 14:19:26 +01:00 |
|
thomwolf
|
d38caba169
|
typo in run_squad
|
2019-02-11 14:10:27 +01:00 |
|
thomwolf
|
af62cc5f20
|
fix run_squad example
|
2019-02-11 14:06:32 +01:00 |
|
thomwolf
|
eebc8abbe2
|
clarify and unify model saving logic in examples
|
2019-02-11 14:04:19 +01:00 |
|
thomwolf
|
32fea876bb
|
add distant debugging to run_transfo_xl
|
2019-02-11 12:53:32 +01:00 |
|
thomwolf
|
b31ba23913
|
cuda on in the examples by default
|
2019-02-11 12:15:43 +01:00 |
|
thomwolf
|
6cd769957e
|
update transfo xl example
|
2019-02-09 16:59:17 +01:00 |
|
thomwolf
|
1320e4ec0c
|
mc_token_mask => mc_token_ids
|
2019-02-09 16:58:53 +01:00 |
|
thomwolf
|
f4a07a392c
|
mems not splitted
|
2019-02-09 16:14:31 +01:00 |
|
thomwolf
|
43b9af0cac
|
mems initialized to None in run_transfo
|
2019-02-09 16:12:19 +01:00 |
|
thomwolf
|
b80684b23f
|
fixing run openai gpt example
|
2019-02-08 22:31:32 +01:00 |
|
thomwolf
|
7b4b0cf966
|
logging
|
2019-02-08 11:16:29 +01:00 |
|
thomwolf
|
4bbb9f2d68
|
log loss - helpers
|
2019-02-08 11:14:29 +01:00 |
|
thomwolf
|
5d7e845712
|
fix model on cuda
|
2019-02-08 11:08:43 +01:00 |
|
thomwolf
|
eccb2f0163
|
hot fix
|
2019-02-08 11:05:20 +01:00 |
|
thomwolf
|
5adc20723b
|
add distant debugging
|
2019-02-08 11:03:59 +01:00 |
|
thomwolf
|
777459b471
|
run openai example running
|
2019-02-08 10:33:14 +01:00 |
|