ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,627 commits 391 branches 58 tags 304 MiB
Commit graph

1,627 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
d8daa9d2fc Update llama.py 2025-03-04 16:16:21 -08:00
Daniel Han
1dafd6af8c Merge branch 'main' into nightly 2025-03-04 14:20:27 -08:00
Daniel Han
3a01f482a7 Bug fixes 2025-03-04 14:19:56 -08:00
Daniel Han
56691d8d03 Bug fix 2025-03-04 13:26:47 -08:00
Daniel Han
1a844651af Bug fix 2025-03-04 04:22:23 -08:00
Daniel Han
f0ae89360f Bug fix 2025-03-04 04:12:38 -08:00
Daniel Han
7cef895be7 Bug fixes (#1891) 
* Update rl.py

* Patching

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* NEFTune

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Extra replacements

* Update rl_replacements.py

* Update rl.py

* extra RL replacements

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update _utils.py

* Update loader_utils.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* autocast

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update pyproject.toml

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* GRPO optimized

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Selective Log softmax

* Fix GRPO bsz

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Fix TRL

* Metrics GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* No compile

* Update rl.py

* Remove docs

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* llama-quantize on WINDOWS WSL error fix - edit save.py (gguf saving breaks) (#1649)

* edit save.py to fix gguf saving breaks.

* add check for .exe or not exe file extension for linux and windows

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* unsloth_num_chunks

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py (#1754)

Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.

* Optional logits

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update pyproject.toml

* Update pyproject.toml

* Export Model to ollama.com  (#1648)

* Ollama Export Model to ollama.com

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Check for model_name

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* subprocess use instead of requests | added check for ollama server

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model | fix

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Push to Ollama

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Update cross_entropy_loss.py

* torch_cuda_device

* Update utils.py

* Update utils.py

* Update utils.py

* device

* device

* Update loader.py

* Update llama.py

* Update README.md

* Update llama.py

* Update llama.py

* Update _utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* __version__

* Update rl.py

* Bug fixes

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>
Co-authored-by: Gennadii Manzhos <105049664+everythingisc00l@users.noreply.github.com>
Co-authored-by: Seth Weidman <seth@sethweidman.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
Co-authored-by: Jyotin Goel <120490013+gjyotin305@users.noreply.github.com>
 2025-03-04 03:55:49 -08:00
Daniel Han
bf542e9ef6 Bug fixes 2025-03-04 03:47:51 -08:00
Daniel Han
e4bc56a087 Update rl.py 2025-03-04 03:31:38 -08:00
Daniel Han
20482bf9d6 __version__ 2025-03-04 02:57:54 -08:00
Daniel Han
a722a5d25d Update utils.py 2025-03-04 02:38:44 -08:00
Daniel Han
8d07b0e64a Update utils.py 2025-03-04 02:37:09 -08:00
Daniel Han
5ee394758d Update utils.py 2025-03-04 02:35:19 -08:00
Daniel Han
bfa92159d0 Update utils.py 2025-03-04 02:28:35 -08:00
Daniel Han
e854df5509 Update llama.py 2025-03-03 23:59:11 -08:00
Daniel Han
9955ec9c93 Update llama.py 2025-03-03 23:58:58 -08:00
Daniel Han
2793018ea6 Update llama.py 2025-03-03 23:41:37 -08:00
Daniel Han
69044ce605 Update llama.py 2025-03-03 23:32:02 -08:00
Daniel Han
06e2d96b39 Update llama.py 2025-03-03 23:00:26 -08:00
Michael Han
c3f80d7cd7 Merge pull request #1885 from unslothai/shimmyshimmer-patch-6 
Update README.md
 2025-03-03 21:28:00 -08:00
Michael Han
c77238cb31 Update README.md 2025-03-03 21:27:20 -08:00
Daniel Han
2415050cac Update utils.py 2025-03-03 18:46:16 -08:00
Daniel Han
18ab316dd2 Update utils.py 2025-03-03 18:33:18 -08:00
Daniel Han
91231ab3e6 Update utils.py 2025-03-03 18:29:35 -08:00
Daniel Han
1570f4cfe6 Update utils.py 2025-03-03 17:27:59 -08:00
Daniel Han
189146e389 Update utils.py 2025-03-03 17:17:25 -08:00
Daniel Han
0eee505371 Update _utils.py 2025-03-03 17:12:56 -08:00
Daniel Han
f40d5812f8 Update llama.py 2025-03-03 15:49:04 -08:00
Daniel Han
cc4c71d8cf Update llama.py 2025-03-03 15:48:55 -08:00
Daniel Han
ee16f6ce99 Update README.md 2025-03-03 14:58:30 -08:00
Daniel Han
8c064a3707 Update llama.py 2025-03-03 02:36:16 -08:00
Daniel Han
a4b3bebab8 Update loader.py 2025-03-03 02:30:53 -08:00
Daniel Han
54121bb4b3 device 2025-03-03 00:04:08 -08:00
Daniel Han
cf77d8b610 device 2025-03-02 23:58:17 -08:00
Daniel Han
a833ab9829 Update utils.py 2025-03-02 23:43:02 -08:00
Daniel Han
4b2b345cdd Update utils.py 2025-03-02 23:41:35 -08:00
Daniel Han
306fd3009e Update utils.py 2025-03-02 23:38:32 -08:00
Daniel Han
7e096ff9bf torch_cuda_device 2025-03-02 23:31:16 -08:00
Daniel Han
72a7919e37 Update cross_entropy_loss.py 2025-03-02 23:08:44 -08:00
Michael Han
a19430b7c6 Update README.md 2025-03-02 20:44:26 -08:00
Michael Han
dbd6be596f Update README.md 2025-03-02 20:35:27 -08:00
Michael Han
9c3deeb019 Update README.md 2025-03-02 20:34:36 -08:00
Daniel Han
e7fca61f7c Merge branch 'main' into nightly 2025-03-02 20:28:24 -08:00
J. M Areeb Uzair
debb3e0810 Added Python version warning to Windows Install Section (#1872) 
I spent half a day on the wrong Python version, so I am adding this big, red sign.
 2025-03-02 03:48:21 -08:00
Mohamed Mekkouri
8c9404dd5e Fix Layernorm when num_cols not a power of 2 (#1867) 
* fix

* Update layernorm.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-03-01 14:23:22 -08:00
Daniel Han
4ffbf6734c Update vision.py 2025-03-01 13:47:01 -08:00
Daniel Han
3fa6ac944f LoRA 2025-03-01 02:52:20 -08:00
Daniel Han
09be705d7d Update llama.py 2025-03-01 00:23:20 -08:00
Daniel Han
b53d160b6f Update _utils.py 2025-03-01 00:21:28 -08:00
Daniel Han
a7f00fe966 Update granite.py 2025-03-01 00:20:34 -08:00