Use HF papers (#38184)
* Use hf papers * Hugging Face papers * doi to hf papers * style
This commit is contained in:
committed by
GitHub
parent
1031ed5166
commit
de24fb63ed
@@ -1881,7 +1881,7 @@ class ModuleUtilsMixin:
|
||||
Get number of (optionally, non-embeddings) floating-point operations for the forward and backward passes of a
|
||||
batch with this transformer model. Default approximation neglects the quadratic dependency on the number of
|
||||
tokens (valid if `12 * d_model << sequence_length`) as laid out in [this
|
||||
paper](https://arxiv.org/pdf/2001.08361.pdf) section 2.1. Should be overridden for transformers with parameter
|
||||
paper](https://huggingface.co/papers/2001.08361) section 2.1. Should be overridden for transformers with parameter
|
||||
re-use e.g. Albert or Universal Transformers, or if doing long-range modeling with very high sequence lengths.
|
||||
|
||||
Args:
|
||||
|
||||
Reference in New Issue
Block a user