ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update llama.py

Browse source
This commit is contained in:
Daniel Han-Chen 2024-01-28 16:40:59 +11:00
commit 5fe166d32e
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
unsloth/models/llama.py
View file

@ -524,6 +524,7 @@ def LlamaModel_fast_forward(
inputs_requires_grad = hidden_states.requires_grad
if inputs_requires_grad: hidden_states.requires_grad_(False)
hidden_states *= attention_mask.unsqueeze(0).transpose(0, 1).transpose(1, 2)
print(1)
if inputs_requires_grad: hidden_states.requires_grad_(True)
pass