ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update cross_entropy_loss.py

Browse source
This commit is contained in:
Daniel Han 2024-10-23 22:18:24 -07:00
commit a048a791f4
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
unsloth/kernels/cross_entropy_loss.py
View file

@ -373,9 +373,9 @@ def fast_cross_entropy_loss(
logit_softcapping,
logit_scaling,
)
print(n_items)
if n_items is None:
n_items = torch.count_nonzero(labels != -100)
print(n_items)
return loss.sum() / n_items
pass