From 2a3c88a65974a7771d0ef81f58bed470146ef754 Mon Sep 17 00:00:00 2001 From: Victor SANH Date: Thu, 28 May 2020 10:42:00 -0400 Subject: [PATCH] Update examples/movement-pruning/README.md Co-authored-by: Julien Chaumond --- examples/movement-pruning/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/examples/movement-pruning/README.md b/examples/movement-pruning/README.md index 57383aa5c4..34e01b52b9 100644 --- a/examples/movement-pruning/README.md +++ b/examples/movement-pruning/README.md @@ -159,7 +159,7 @@ python examples/movement-pruning/bertarize.py \ For reproducibility purposes, we share the detailed results presented in the paper. This [spreadsheet](TODO) exhaustively describes the individual hyper-parameters used for each data point. -## Remarks +## Inference speed Early experiments show that even though models fine-pruned with (soft) movement pruning are extremely sparse, they do not benefit from significant improvement in terms of inference speed when using the standard PyTorch inference. We are currently benchmarking and exploring inference setups specifically for sparse architectures.