Rename supports_static_cache to can_compile_fullgraph (#39505)
* update all * Apply suggestions from code review Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * apply suggestions * fix copies --------- Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
This commit is contained in:
committed by
GitHub
parent
b357cbb19d
commit
eb1a007f7f
@@ -2063,8 +2063,7 @@ class PreTrainedModel(nn.Module, EmbeddingAccessMixin, ModuleUtilsMixin, PushToH
|
||||
# Flex Attention support
|
||||
_supports_flex_attn = False
|
||||
|
||||
# Has support `torch.compile(fullgraph=True)`
|
||||
_supports_static_cache = False
|
||||
_can_compile_fullgraph = False
|
||||
|
||||
# A tensor parallel plan to be applied to the model when TP is enabled. For
|
||||
# top-level models, this attribute is currently defined in respective model
|
||||
|
||||
Reference in New Issue
Block a user