ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,630 commits 391 branches 58 tags 304 MiB
Commit graph

1,630 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
fa5e37de2d Update llama.py 2025-03-04 18:18:02 -08:00
Daniel Han
0b1cf7640e _wrap_fast_inference 2025-03-04 18:15:45 -08:00
Daniel Han
ed90df2c4f Update _utils.py 2025-03-04 16:30:57 -08:00
Daniel Han
fe68005095 Update llama.py 2025-03-04 16:16:21 -08:00
Daniel Han
d84f723a82 Merge branch 'main' into nightly 2025-03-04 14:20:27 -08:00
Daniel Han
6a03ea2f81 Bug fixes 2025-03-04 14:19:56 -08:00
Daniel Han
6208d99833 Bug fix 2025-03-04 13:26:47 -08:00
Daniel Han
c813f2de1d Bug fix 2025-03-04 04:22:23 -08:00
Daniel Han
d5c427adea Bug fix 2025-03-04 04:12:38 -08:00
Daniel Han
3e5f061133 Bug fixes (#1891) 
* Update rl.py

* Patching

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* NEFTune

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Extra replacements

* Update rl_replacements.py

* Update rl.py

* extra RL replacements

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update _utils.py

* Update loader_utils.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* autocast

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update pyproject.toml

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* GRPO optimized

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Selective Log softmax

* Fix GRPO bsz

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Fix TRL

* Metrics GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* No compile

* Update rl.py

* Remove docs

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* llama-quantize on WINDOWS WSL error fix - edit save.py (gguf saving breaks) (#1649)

* edit save.py to fix gguf saving breaks.

* add check for .exe or not exe file extension for linux and windows

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* unsloth_num_chunks

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py (#1754)

Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.

* Optional logits

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update pyproject.toml

* Update pyproject.toml

* Export Model to ollama.com  (#1648)

* Ollama Export Model to ollama.com

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Check for model_name

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* subprocess use instead of requests | added check for ollama server

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model | fix

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Push to Ollama

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Update cross_entropy_loss.py

* torch_cuda_device

* Update utils.py

* Update utils.py

* Update utils.py

* device

* device

* Update loader.py

* Update llama.py

* Update README.md

* Update llama.py

* Update llama.py

* Update _utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* __version__

* Update rl.py

* Bug fixes

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>
Co-authored-by: Gennadii Manzhos <105049664+everythingisc00l@users.noreply.github.com>
Co-authored-by: Seth Weidman <seth@sethweidman.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
Co-authored-by: Jyotin Goel <120490013+gjyotin305@users.noreply.github.com>
 2025-03-04 03:55:49 -08:00
Daniel Han
94bda540e2 Bug fixes 2025-03-04 03:47:51 -08:00
Daniel Han
f22fe83726 Update rl.py 2025-03-04 03:31:38 -08:00
Daniel Han
607539435e __version__ 2025-03-04 02:57:54 -08:00
Daniel Han
e0c0b71831 Update utils.py 2025-03-04 02:38:44 -08:00
Daniel Han
0387f997f7 Update utils.py 2025-03-04 02:37:09 -08:00
Daniel Han
c38c1d52dd Update utils.py 2025-03-04 02:35:19 -08:00
Daniel Han
963e876ea4 Update utils.py 2025-03-04 02:28:35 -08:00
Daniel Han
71735c342f Update llama.py 2025-03-03 23:59:11 -08:00
Daniel Han
a4fa7f920f Update llama.py 2025-03-03 23:58:58 -08:00
Daniel Han
63b7b34424 Update llama.py 2025-03-03 23:41:37 -08:00
Daniel Han
0460a67ed4 Update llama.py 2025-03-03 23:32:02 -08:00
Daniel Han
61a3daa667 Update llama.py 2025-03-03 23:00:26 -08:00
Michael Han
6491abfb78 Merge pull request #1885 from unslothai/shimmyshimmer-patch-6 
Update README.md
 2025-03-03 21:28:00 -08:00
Michael Han
c018ea28db Update README.md 2025-03-03 21:27:20 -08:00
Daniel Han
9c3bb53a0a Update utils.py 2025-03-03 18:46:16 -08:00
Daniel Han
baed76e0a5 Update utils.py 2025-03-03 18:33:18 -08:00
Daniel Han
2f9767887a Update utils.py 2025-03-03 18:29:35 -08:00
Daniel Han
3671756291 Update utils.py 2025-03-03 17:27:59 -08:00
Daniel Han
806bf910fc Update utils.py 2025-03-03 17:17:25 -08:00
Daniel Han
7e0bb36f9f Update _utils.py 2025-03-03 17:12:56 -08:00
Daniel Han
ce708bef1c Update llama.py 2025-03-03 15:49:04 -08:00
Daniel Han
6662fd652c Update llama.py 2025-03-03 15:48:55 -08:00
Daniel Han
d7ffc09329 Update README.md 2025-03-03 14:58:30 -08:00
Daniel Han
643637dd5e Update llama.py 2025-03-03 02:36:16 -08:00
Daniel Han
64ab4df808 Update loader.py 2025-03-03 02:30:53 -08:00
Daniel Han
391fe2907b device 2025-03-03 00:04:08 -08:00
Daniel Han
37541f149a device 2025-03-02 23:58:17 -08:00
Daniel Han
cb6318299d Update utils.py 2025-03-02 23:43:02 -08:00
Daniel Han
ed45bd9cd3 Update utils.py 2025-03-02 23:41:35 -08:00
Daniel Han
0b69bf34cc Update utils.py 2025-03-02 23:38:32 -08:00
Daniel Han
ed75ff330a torch_cuda_device 2025-03-02 23:31:16 -08:00
Daniel Han
b73a2c39d7 Update cross_entropy_loss.py 2025-03-02 23:08:44 -08:00
Michael Han
e02561d883 Update README.md 2025-03-02 20:44:26 -08:00
Michael Han
8b5883275d Update README.md 2025-03-02 20:35:27 -08:00
Michael Han
788563f8fe Update README.md 2025-03-02 20:34:36 -08:00
Daniel Han
f47415973a Merge branch 'main' into nightly 2025-03-02 20:28:24 -08:00
J. M Areeb Uzair
c6d2433547 Added Python version warning to Windows Install Section (#1872) 
I spent half a day on the wrong Python version, so I am adding this big, red sign.
 2025-03-02 03:48:21 -08:00
Mohamed Mekkouri
8180e9803c Fix Layernorm when num_cols not a power of 2 (#1867) 
* fix

* Update layernorm.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-03-01 14:23:22 -08:00
Daniel Han
8a72e20aa5 Update vision.py 2025-03-01 13:47:01 -08:00
Daniel Han
4f166026d7 LoRA 2025-03-01 02:52:20 -08:00