Merge pull request #116 from FDecaYed/deyuf/fp16_with_apex

Change to use apex for better fp16 and multi-gpu support
2018-12-13 12:32:37 +01:00
parent 32a227f507 3b0a14b761
commit 91aab2a6d3
6 changed files with 154 additions and 186 deletions
--- a/README.md
+++ b/README.md
@@ -338,7 +338,7 @@ The optimizer accepts the following arguments:
 - `b1` : Adams b1. Default : `0.9`
 - `b2` : Adams b2. Default : `0.999`
 - `e` : Adams epsilon. Default : `1e-6`
- `weight_decay_rate:` Weight decay. Default : `0.01`
+- `weight_decay:` Weight decay. Default : `0.01`
 - `max_grad_norm` : Maximum norm for the gradients (`-1` means no clipping). Default : `1.0`

 ## Examples