ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,650 commits 391 branches 58 tags 304 MiB
Commit graph

1,650 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
fd11ad770a Update utils.py 2025-03-05 03:46:21 -08:00
Daniel Han
185bced6b2 Update llama.py 2025-03-05 03:38:16 -08:00
Daniel Han
3f5ce93004 Update llama.py 2025-03-05 03:30:13 -08:00
Daniel Han
413ea80ab4 Update rl.py 2025-03-05 03:24:08 -08:00
Daniel Han
7d8f100488 Update rl_replacements.py 2025-03-05 01:11:03 -08:00
Daniel Han
0a3dbfa4d7 Update rl_replacements.py 2025-03-05 01:03:13 -08:00
Daniel Han
f41dff5af3 Update rl_replacements.py 2025-03-05 01:00:01 -08:00
Daniel Han
44951487d8 Update pyproject.toml 2025-03-05 00:56:56 -08:00
Daniel Han
91a4fce193 SFT dataset prepare 2025-03-05 00:51:10 -08:00
Daniel Han
f640c8d40b Update _utils.py 2025-03-04 19:44:54 -08:00
Daniel Han
647dbb4299 Update llama.py 2025-03-04 19:39:49 -08:00
Daniel Han
95f872dedc Update llama.py 2025-03-04 19:20:38 -08:00
Daniel Han
e887f43b52 Update llama.py 2025-03-04 19:19:12 -08:00
Daniel Han
c9566164e9 Update llama.py 2025-03-04 19:15:40 -08:00
Daniel Han
28361287cb Update llama.py 2025-03-04 19:11:54 -08:00
Daniel Han
12094a7f99 Update llama.py 2025-03-04 19:08:59 -08:00
Daniel Han
e022016798 Update llama.py 2025-03-04 19:04:46 -08:00
Daniel Han
b356fce8e8 Update llama.py 2025-03-04 19:02:12 -08:00
Daniel Han
dd4bd0721a Update llama.py 2025-03-04 18:59:55 -08:00
Daniel Han
109364bf75 Update llama.py 2025-03-04 18:21:54 -08:00
Daniel Han
6f0857ba46 Update llama.py 2025-03-04 18:18:02 -08:00
Daniel Han
b8b0f9c8ae _wrap_fast_inference 2025-03-04 18:15:45 -08:00
Daniel Han
5df3936a87 Update _utils.py 2025-03-04 16:30:57 -08:00
Daniel Han
59b24adca5 Update llama.py 2025-03-04 16:16:21 -08:00
Daniel Han
ad6d962da4 Merge branch 'main' into nightly 2025-03-04 14:20:27 -08:00
Daniel Han
949c298f3d Bug fixes 2025-03-04 14:19:56 -08:00
Daniel Han
840988b12b Bug fix 2025-03-04 13:26:47 -08:00
Daniel Han
1aeb21b10e Bug fix 2025-03-04 04:22:23 -08:00
Daniel Han
ff18cb3a74 Bug fix 2025-03-04 04:12:38 -08:00
Daniel Han
362a9ac1ac
 		Bug fixes (#1891) 
* Update rl.py

* Patching

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* NEFTune

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Extra replacements

* Update rl_replacements.py

* Update rl.py

* extra RL replacements

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update _utils.py

* Update loader_utils.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* autocast

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update pyproject.toml

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* GRPO optimized

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Selective Log softmax

* Fix GRPO bsz

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Fix TRL

* Metrics GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* No compile

* Update rl.py

* Remove docs

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* llama-quantize on WINDOWS WSL error fix - edit save.py (gguf saving breaks) (#1649)

* edit save.py to fix gguf saving breaks.

* add check for .exe or not exe file extension for linux and windows

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* unsloth_num_chunks

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py (#1754)

Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.

* Optional logits

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update pyproject.toml

* Update pyproject.toml

* Export Model to ollama.com  (#1648)

* Ollama Export Model to ollama.com

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Check for model_name

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* subprocess use instead of requests | added check for ollama server

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model | fix

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Push to Ollama

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Update cross_entropy_loss.py

* torch_cuda_device

* Update utils.py

* Update utils.py

* Update utils.py

* device

* device

* Update loader.py

* Update llama.py

* Update README.md

* Update llama.py

* Update llama.py

* Update _utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* __version__

* Update rl.py

* Bug fixes

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>
Co-authored-by: Gennadii Manzhos <105049664+everythingisc00l@users.noreply.github.com>
Co-authored-by: Seth Weidman <seth@sethweidman.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
Co-authored-by: Jyotin Goel <120490013+gjyotin305@users.noreply.github.com>
 2025-03-04 03:55:49 -08:00
Daniel Han
adc697770f Bug fixes 2025-03-04 03:47:51 -08:00
Daniel Han
208971bc33 Update rl.py 2025-03-04 03:31:38 -08:00
Daniel Han
8c8ce96af7 __version__ 2025-03-04 02:57:54 -08:00
Daniel Han
6ef086694a Update utils.py 2025-03-04 02:38:44 -08:00
Daniel Han
dcff03c59a Update utils.py 2025-03-04 02:37:09 -08:00
Daniel Han
432ea2447f Update utils.py 2025-03-04 02:35:19 -08:00
Daniel Han
c2ae5101e8 Update utils.py 2025-03-04 02:28:35 -08:00
Daniel Han
8c4b79c32d Update llama.py 2025-03-03 23:59:11 -08:00
Daniel Han
45ea48c3ce Update llama.py 2025-03-03 23:58:58 -08:00
Daniel Han
4485da745b Update llama.py 2025-03-03 23:41:37 -08:00
Daniel Han
d73c34bf19 Update llama.py 2025-03-03 23:32:02 -08:00
Daniel Han
ed697da945 Update llama.py 2025-03-03 23:00:26 -08:00
Michael Han
be55e29a2d
 		Merge pull request #1885 from unslothai/shimmyshimmer-patch-6 
Update README.md
 2025-03-03 21:28:00 -08:00
Michael Han
b512a60093
 		Update README.md 2025-03-03 21:27:20 -08:00
Daniel Han
8f9ba99b76 Update utils.py 2025-03-03 18:46:16 -08:00
Daniel Han
6e2a3a8d77 Update utils.py 2025-03-03 18:33:18 -08:00
Daniel Han
d93cca24a8 Update utils.py 2025-03-03 18:29:35 -08:00
Daniel Han
a7a5d75b83 Update utils.py 2025-03-03 17:27:59 -08:00
Daniel Han
91458bbcdc Update utils.py 2025-03-03 17:17:25 -08:00
Daniel Han
ee9d6e5955 Update _utils.py 2025-03-03 17:12:56 -08:00