ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Disable Flex Attention

Browse source
This commit is contained in:
Daniel Han 2024-10-23 02:58:40 -07:00
commit 28958397ee
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
unsloth/kernels/flex_attention.py
View file

@ -31,7 +31,7 @@ try:
create_block_mask as _create_block_mask,
)
_flex_attention = torch.compile(_flex_attention, dynamic = True, options = torch_compile_options)
HAS_FLEX_ATTENTION = True
HAS_FLEX_ATTENTION = False
except:
HAS_FLEX_ATTENTION = False
pass