ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,439 commits 391 branches 58 tags 304 MiB
Commit graph

1,439 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
9065938acb Update llama.py 2025-02-13 19:11:38 -08:00
Daniel Han
bb3bb2dc8c Update llama.py 2025-02-13 17:25:12 -08:00
Daniel Han
640bc8878e Update llama.py 2025-02-13 17:22:39 -08:00
Daniel Han
ed907850ad Update llama.py 2025-02-13 17:18:42 -08:00
Daniel Han
3d9fe12a23 Update rl_replacements.py 2025-02-13 17:15:29 -08:00
Daniel Han
945e3f95e1 Update llama.py 2025-02-13 17:12:06 -08:00
Daniel Han
f9055a767e Update llama.py 2025-02-13 17:11:33 -08:00
Daniel Han
c495bfad69 Update llama.py 2025-02-13 17:05:04 -08:00
Daniel Han
3687a6f7b9 Update llama.py 2025-02-13 17:00:14 -08:00
Daniel Han
9794dc2308 Update rl.py 2025-02-13 16:47:27 -08:00
Daniel Han
61c219d4fc Update rl.py 2025-02-13 16:38:21 -08:00
Daniel Han
17bfcf9ebb Update rl.py 2025-02-13 16:37:05 -08:00
Daniel Han
95b7df53e8 Update rl.py 2025-02-13 16:35:09 -08:00
Daniel Han
cfdd3f150f Update rl.py 2025-02-13 16:27:23 -08:00
Daniel Han
881105b2c8 Update rl_replacements.py 2025-02-13 16:27:02 -08:00
Daniel Han
139911095f Update _utils.py 2025-02-13 16:23:51 -08:00
Daniel Han
acf98dccdc Update llama.py 2025-02-13 16:11:51 -08:00
Daniel Han
447dfc457f Merge branch 'main' into nightly 2025-02-13 15:14:35 -08:00
Daniel Han
a41cdffa55 Update _utils.py 2025-02-13 15:14:17 -08:00
Daniel Han
5b1bb7782a Update pyproject.toml 2025-02-13 15:13:55 -08:00
Daniel Han
44d00e8c00 Merge branch 'main' into nightly 2025-02-13 15:02:56 -08:00
Daniel Han
7f0511b0cd Update rl.py 2025-02-13 15:02:50 -08:00
Daniel Han
c9e450f25e Merge branch 'main' into nightly 2025-02-13 14:59:59 -08:00
Daniel Han
fd3bfa9945 Update _utils.py 2025-02-13 14:59:52 -08:00
Daniel Han
3622d537e7 Update dpo.py 2025-02-13 14:59:42 -08:00
Daniel Han
d5d7a063ce Merge branch 'main' into nightly 2025-02-13 14:57:58 -08:00
Daniel Han
57029ab775 Update __init__.py 2025-02-13 14:55:14 -08:00
Daniel Han
6fdb54b0ab Update _utils.py 2025-02-13 14:54:49 -08:00
Daniel Han
016315eb04
 		Fix bugs (#1701) 
* Phi 4

* Update llama.py

* Torch.Cuda Is Available Condition and Warning (#1545)

* check for torch.cuda and triton if available
on my machine(mac m3) the cuda were not available

* Update pyproject.toml

* Update __init__.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update mistral.py

* Update mistral.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Fix

* Bug fixes

* Update mapper.py

* Add dropout to granite to match HF's implementation (#1557)

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>

* Update llama.py

* Update llama.py

* Bug fixes

* fix: flash_attn_detection_error (#1556)

* fix: flash_attn_detection_error

* Update _utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update mapper.py

* Update gemma.py

* Update gemma.py

* Update gemma.py

* Update gemma.py

* dim fix

* Update _utils.py

* Torch 2.6 support

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Faster inference?

* Update llama.py

* Update llama.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update mapper.py

* Fast Inference via vLLM

* Update llama.py

* Update llama.py

* Update utils.py

* Create rl.py

* PatchRL

* Update rl.py

* Update rl.py

* Update rl.py

* PatchRLStatistics

* Update rl.py

* Update rl.py

* Update rl.py

* Update utils.py

* Update utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* RL metrics

* Update rl.py

* RL metrics

* Update __init__.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update chat_templates.py

* Update mapper.py

* Fp8 cache

* Update llama.py

* Update llama.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update __init__.py

* Update loader.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Better TRL handling

* Update rl.py

* Update tokenizer_utils.py

* Auto patching

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update rl.py

* Update tokenizer_utils.py

* Update rl.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update tokenizer_utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* max seq length

* Update rl.py

* Update rl.py

* Patching

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* NEFTune

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Extra replacements

* Update rl_replacements.py

* Update rl.py

* extra RL replacements

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update _utils.py

* Update loader_utils.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* autocast

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update pyproject.toml

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update _utils.py

---------

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
Co-authored-by: AminWhat <88392440+aminwhat@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Zhe Zhang <2631992879@qq.com>
 2025-02-13 14:50:44 -08:00
Daniel Han
69ab838499 Update _utils.py 2025-02-13 14:47:54 -08:00
Daniel Han
2635f2af96 Update llama.py 2025-02-13 14:42:38 -08:00
Daniel Han
9934ac56f4 Merge branch 'main' into nightly 2025-02-13 14:40:49 -08:00
Daniel Han
73210b3b8e Update rl_replacements.py 2025-02-13 04:44:21 -08:00
Daniel Han
087a5dc2f0 Update rl_replacements.py 2025-02-13 04:40:53 -08:00
Daniel Han
527a0c4fc8 Update rl_replacements.py 2025-02-13 04:40:42 -08:00
Daniel Han
2daa8e3e3c Update rl_replacements.py 2025-02-13 04:34:13 -08:00
Daniel Han
c859030d0f Update rl_replacements.py 2025-02-13 04:25:56 -08:00
Daniel Han
4bff998081 Update rl_replacements.py 2025-02-13 02:06:36 -08:00
Daniel Han
9215bbefb5 Update rl_replacements.py 2025-02-13 02:04:11 -08:00
Daniel Han
6652f1df66 Update rl_replacements.py 2025-02-13 02:01:51 -08:00
Daniel Han
8e5b09adb0 Update llama.py 2025-02-13 01:57:45 -08:00
Daniel Han
c409574568 Update rl_replacements.py 2025-02-13 01:52:07 -08:00
Daniel Han
0309949b63 Update rl_replacements.py 2025-02-13 01:48:38 -08:00
Daniel Han
dc723bc70e Update rl_replacements.py 2025-02-13 01:44:00 -08:00
Daniel Han
4b201d98c6 Update rl_replacements.py 2025-02-13 01:42:55 -08:00
Michael Han
027b5100c7
 		Merge pull request #1688 from unslothai/shimmyshimmer-patch-5 
Update README.md
 2025-02-13 01:14:23 -08:00
Michael Han
f9e28fc6cf
 		Update README.md 2025-02-13 01:14:06 -08:00
Daniel Han
b7e855945e Update llama.py 2025-02-13 00:29:34 -08:00
Daniel Han
b30a81f308 Update llama.py 2025-02-13 00:26:58 -08:00
Daniel Han
9d10d2f41b Update llama.py 2025-02-13 00:10:44 -08:00