SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Update examples/movement-pruning/README.md

Browse Source 
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
This commit is contained in:
Victor SANH
2020-05-28 10:42:00 -04:00
parent 4ac462bfb8
commit 2a3c88a659
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
examples/movement-pruning/README.md
View File

@@ -159,7 +159,7 @@ python examples/movement-pruning/bertarize.py \
For reproducibility purposes, we share the detailed results presented in the paper. This [spreadsheet](TODO) exhaustively describes the individual hyper-parameters used for each data point.
## Remarks
## Inference speed
Early experiments show that even though models fine-pruned with (soft) movement pruning are extremely sparse, they do not benefit from significant improvement in terms of inference speed when using the standard PyTorch inference.
We are currently benchmarking and exploring inference setups specifically for sparse architectures.