SUMIN/HuggingFace_transformer
1
0
Fork 0
Code Issues Pull Requests Actions 7 Packages Projects Releases Wiki Activity

Update examples/movement-pruning/README.md

Browse Source 
Co-authored-by: Julien Chaumond <chaumond@gmail.com>
This commit is contained in:
Victor SANH
2020-05-28 10:41:53 -04:00
parent 35fa0bbca0
commit 4ac462bfb8
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
examples/movement-pruning/README.md
View File

@@ -163,6 +163,7 @@ For reproducibility purposes, we share the detailed results presented in the pap
Early experiments show that even though models fine-pruned with (soft) movement pruning are extremely sparse, they do not benefit from significant improvement in terms of inference speed when using the standard PyTorch inference. Early experiments show that even though models fine-pruned with (soft) movement pruning are extremely sparse, they do not benefit from significant improvement in terms of inference speed when using the standard PyTorch inference.
We are currently benchmarking and exploring inference setups specifically for sparse architectures. We are currently benchmarking and exploring inference setups specifically for sparse architectures.
In particular, hardware manufacturers are announcing devices that will speedup inference for sparse networks considerably.
## Citation ## Citation