ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

Browse source 
* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens
This commit is contained in:
Nino Risteski 2025-03-14 10:53:21 +01:00 • committed by GitHub
commit 6aaf377d3a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 1 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

5
unsloth/chat_templates.py
View file

@ -1512,10 +1512,7 @@ def get_ollama_eos_tokens(tokenizer, extra_eos_tokens = []):
# Remove duplicates
splitted = joined_text.split("\x01\x00")
final_eos_tokens = []
for old, new in zip(added_tokens_decoder, splitted):
if old == new: final_eos_tokens.append(old)
pass
final_eos_tokens = [old for old, new in zip(added_tokens_decoder, splitted) if old == new]
final_eos_tokens += extra_eos_tokens
final_eos_tokens += repeatted_tokens

1
unsloth/kernels/rms_layernorm.py
View file

@ -256,7 +256,6 @@ def unpatch_rms_layernorm():
except:
pass
return
return
pass