ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
4,672 commits 391 branches 58 tags 304 MiB
Commit graph

4,672 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
834c3a4492 Merge branch 'main' into nightly 2025-02-13 15:14:35 -08:00
Daniel Han
4f9301d321 Update _utils.py 2025-02-13 15:14:17 -08:00
Daniel Han
26f8d8580b Update pyproject.toml 2025-02-13 15:13:55 -08:00
Daniel Han
bf2ee8eed2 Merge branch 'main' into nightly 2025-02-13 15:02:56 -08:00
Daniel Han
39eaefce14 Update rl.py 2025-02-13 15:02:50 -08:00
Daniel Han
3ad4076e4b Merge branch 'main' into nightly 2025-02-13 14:59:59 -08:00
Daniel Han
635e921506 Update _utils.py 2025-02-13 14:59:52 -08:00
Daniel Han
5c19724e7f Update dpo.py 2025-02-13 14:59:42 -08:00
Daniel Han
f11079ba65 Merge branch 'main' into nightly 2025-02-13 14:57:58 -08:00
Daniel Han
43cda3240c Update __init__.py 2025-02-13 14:55:14 -08:00
Daniel Han
010de17c90 Update _utils.py 2025-02-13 14:54:49 -08:00
Daniel Han
95fb1d699d Fix bugs (#1701) 
* Phi 4

* Update llama.py

* Torch.Cuda Is Available Condition and Warning (#1545)

* check for torch.cuda and triton if available
on my machine(mac m3) the cuda were not available

* Update pyproject.toml

* Update __init__.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update mistral.py

* Update mistral.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Fix

* Bug fixes

* Update mapper.py

* Add dropout to granite to match HF's implementation (#1557)

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>

* Update llama.py

* Update llama.py

* Bug fixes

* fix: flash_attn_detection_error (#1556)

* fix: flash_attn_detection_error

* Update _utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update mapper.py

* Update gemma.py

* Update gemma.py

* Update gemma.py

* Update gemma.py

* dim fix

* Update _utils.py

* Torch 2.6 support

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Faster inference?

* Update llama.py

* Update llama.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update mapper.py

* Fast Inference via vLLM

* Update llama.py

* Update llama.py

* Update utils.py

* Create rl.py

* PatchRL

* Update rl.py

* Update rl.py

* Update rl.py

* PatchRLStatistics

* Update rl.py

* Update rl.py

* Update rl.py

* Update utils.py

* Update utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* RL metrics

* Update rl.py

* RL metrics

* Update __init__.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update chat_templates.py

* Update mapper.py

* Fp8 cache

* Update llama.py

* Update llama.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update __init__.py

* Update loader.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Better TRL handling

* Update rl.py

* Update tokenizer_utils.py

* Auto patching

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update rl.py

* Update tokenizer_utils.py

* Update rl.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update tokenizer_utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* max seq length

* Update rl.py

* Update rl.py

* Patching

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* NEFTune

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Extra replacements

* Update rl_replacements.py

* Update rl.py

* extra RL replacements

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update _utils.py

* Update loader_utils.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* autocast

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update pyproject.toml

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update _utils.py

---------

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
Co-authored-by: AminWhat <88392440+aminwhat@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Zhe Zhang <2631992879@qq.com>
 2025-02-13 14:50:44 -08:00
Daniel Han
44e2879efb Update _utils.py 2025-02-13 14:47:54 -08:00
Daniel Han
50568f1c15 Update llama.py 2025-02-13 14:42:38 -08:00
Daniel Han
c59c2738d9 Merge branch 'main' into nightly 2025-02-13 14:40:49 -08:00
Daniel Han
b1d2c9fb30 Update rl_replacements.py 2025-02-13 04:44:21 -08:00
Daniel Han
de7e76c250 Update rl_replacements.py 2025-02-13 04:40:53 -08:00
Daniel Han
1013ab5891 Update rl_replacements.py 2025-02-13 04:40:42 -08:00
Daniel Han
a0ed33d99a Update rl_replacements.py 2025-02-13 04:34:13 -08:00
Daniel Han
dffbba5ff4 Update rl_replacements.py 2025-02-13 04:25:56 -08:00
Daniel Han
8a7a6c1a8e Update rl_replacements.py 2025-02-13 02:06:36 -08:00
Daniel Han
ef9ad91e36 Update rl_replacements.py 2025-02-13 02:04:11 -08:00
Daniel Han
ca8080290c Update rl_replacements.py 2025-02-13 02:01:51 -08:00
Daniel Han
386cb81c23 Update llama.py 2025-02-13 01:57:45 -08:00
Daniel Han
b181a8ff2b Update rl_replacements.py 2025-02-13 01:52:07 -08:00
Daniel Han
5cd34b0b95 Update rl_replacements.py 2025-02-13 01:48:38 -08:00
Daniel Han
d594ba5812 Update rl_replacements.py 2025-02-13 01:44:00 -08:00
Daniel Han
c9da968975 Update rl_replacements.py 2025-02-13 01:42:55 -08:00
Michael Han
28cb38675f Merge pull request #1688 from unslothai/shimmyshimmer-patch-5 
Update README.md
 2025-02-13 01:14:23 -08:00
Michael Han
6097db77bb Update README.md 2025-02-13 01:14:06 -08:00
Daniel Han
53653128ff Update llama.py 2025-02-13 00:29:34 -08:00
Daniel Han
3ddad518b6 Update llama.py 2025-02-13 00:26:58 -08:00
Daniel Han
8a35445c23 Update llama.py 2025-02-13 00:10:44 -08:00
Daniel Han
005a397436 Update llama.py 2025-02-12 23:03:40 -08:00
Daniel Han
7d881ae18a Update llama.py 2025-02-12 23:00:51 -08:00
Daniel Han
a94e37db16 Update llama.py 2025-02-12 22:56:47 -08:00
Daniel Han
310a40b3f9 Update llama.py 2025-02-12 22:34:50 -08:00
Daniel Han
85bb48288a Update pyproject.toml 2025-02-12 21:16:44 -08:00
Daniel Han
df43bdb8bf Update llama.py 2025-02-12 21:06:33 -08:00
Daniel Han
eb5a14617f Update llama.py 2025-02-12 20:33:37 -08:00
Daniel Han
318a59f6b4 Update llama.py 2025-02-12 20:29:10 -08:00
Daniel Han
35bad803b5 Update llama.py 2025-02-12 20:24:48 -08:00
Daniel Han
e270294550 Update rl_replacements.py 2025-02-12 20:18:07 -08:00
Daniel Han
3f500fdd12 Update llama.py 2025-02-12 19:11:09 -08:00
Daniel Han
56dffe007c Update llama.py 2025-02-12 19:10:48 -08:00
Daniel Han
2f25ff2698 Update llama.py 2025-02-12 19:07:50 -08:00
Daniel Han
46007979eb Update llama.py 2025-02-12 19:01:23 -08:00
Daniel Han
43458dafd4 Update llama.py 2025-02-12 18:57:01 -08:00
Daniel Han
2b7655527b Update rl_replacements.py 2025-02-12 18:50:45 -08:00
Daniel Han
07616241a0 Update llama.py 2025-02-12 18:44:47 -08:00