ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,555 commits 391 branches 58 tags 304 MiB
Commit graph

1,555 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
7de002246f Update llama.py 2025-02-20 07:25:31 -08:00
Daniel Han
b5eda24d81 Update llama.py 2025-02-20 07:01:14 -08:00
Daniel Han
2969db8bbc Merge branch 'main' into nightly 2025-02-20 05:14:57 -08:00
Daniel Han
ed7673b350 bug fix 2025-02-20 04:47:12 -08:00
Daniel Han
f29da34fab
 		Memory Efficient GRPO (#1773) 
* Update __init__.py

* Update loader.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Better TRL handling

* Update rl.py

* Update tokenizer_utils.py

* Auto patching

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update rl.py

* Update tokenizer_utils.py

* Update rl.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update tokenizer_utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* max seq length

* Update rl.py

* Update rl.py

* Patching

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* NEFTune

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Extra replacements

* Update rl_replacements.py

* Update rl.py

* extra RL replacements

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update _utils.py

* Update loader_utils.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* autocast

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update pyproject.toml

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* GRPO optimized

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Selective Log softmax

* Fix GRPO bsz

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Fix TRL

* Metrics GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* No compile

* Update rl.py

* Remove docs

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* llama-quantize on WINDOWS WSL error fix - edit save.py (gguf saving breaks) (#1649)

* edit save.py to fix gguf saving breaks.

* add check for .exe or not exe file extension for linux and windows

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* unsloth_num_chunks

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py (#1754)

Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.

* Optional logits

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

---------

Co-authored-by: Gennadii Manzhos <105049664+everythingisc00l@users.noreply.github.com>
Co-authored-by: Seth Weidman <seth@sethweidman.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
 2025-02-20 04:23:28 -08:00
Daniel Han
0362bd22fa Versioning 2025-02-20 04:22:17 -08:00
Daniel Han
3a5610e53f default num_chunks == -1 2025-02-19 23:51:06 -08:00
Daniel Han
6d5caca271 Update __init__.py 2025-02-19 23:45:07 -08:00
Daniel Han
f3d9efb40c vLLMSamplingParams 2025-02-19 23:43:52 -08:00
Daniel Han
77109a4d98 Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-02-19 23:40:50 -08:00
Ben
07aea401fa
 		[Windows Support] Add latest xformers wheels to pyproject.toml (#1753) 
* Add latest xformers

* Add a couple of lines to docs
 2025-02-19 23:40:07 -08:00
Edd
19d57bcae6
 		Convert mask to float (#1762) 2025-02-19 23:38:48 -08:00
Daniel Han
2957d89d67 SamplingParams 2025-02-19 23:37:52 -08:00
Nino Risteski
798ad95881
 		fix an import error (#1767) 
* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-02-19 23:32:25 -08:00
Daniel Han
3fccf5d6b0 Update rl.py 2025-02-19 23:27:16 -08:00
Daniel Han
f11e5ab057 Merge branch 'main' into nightly 2025-02-19 23:24:21 -08:00
Daniel Han
67d34405ea
 		Update README.md (#1768) 2025-02-19 23:24:05 -08:00
Daniel Han
e07f4bc303 Update rl.py 2025-02-19 23:23:39 -08:00
Daniel Han
ae8bf68e4d Update rl.py 2025-02-19 23:15:13 -08:00
Daniel Han
2cf4349740 Update rl.py 2025-02-19 23:06:18 -08:00
Daniel Han
515cf5a764 Update rl_replacements.py 2025-02-19 22:03:47 -08:00
Daniel Han
3c750a1608 Update rl.py 2025-02-19 21:41:17 -08:00
Daniel Han
eb48b98bcf Update rl.py 2025-02-19 17:58:25 -08:00
Daniel Han
ba01cf500d Update rl.py 2025-02-19 16:40:37 -08:00
Daniel Han
95fb6a49f2 Update rl.py 2025-02-19 16:38:44 -08:00
Daniel Han
bc6bfae663 Update rl.py 2025-02-19 16:37:12 -08:00
Daniel Han
8ece11ffba Update rl.py 2025-02-19 12:51:22 -08:00
Daniel Han
83ce085c88 Update rl.py 2025-02-19 12:47:15 -08:00
Daniel Han
a6a5f60995 Update rl.py 2025-02-19 03:41:51 -08:00
Daniel Han
91ab43dbd4 Optional logits 2025-02-19 02:23:00 -08:00
Seth Weidman
15442d1036
 		Update rl_replacements.py (#1754) 
Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.
 2025-02-19 02:12:07 -08:00
Daniel Han
5efe9f356c Update rl_replacements.py 2025-02-18 01:57:18 -08:00
Daniel Han
6732822a83 Update rl_replacements.py 2025-02-18 00:17:07 -08:00
Daniel Han
1afe3f2bf6 Update rl.py 2025-02-18 00:13:26 -08:00
Daniel Han
0daa328df3 Update rl.py 2025-02-18 00:09:11 -08:00
Daniel Han
a88712f94a Update rl.py 2025-02-18 00:05:40 -08:00
Daniel Han
ac2e814c25 Update rl.py 2025-02-18 00:01:09 -08:00
Daniel Han
bd046ca226 Update rl.py 2025-02-17 23:57:57 -08:00
Daniel Han
6796801247 Update rl_replacements.py 2025-02-17 23:47:52 -08:00
Daniel Han
0c1a808e3a Update rl_replacements.py 2025-02-17 22:30:20 -08:00
Daniel Han
d16299b154 Update rl_replacements.py 2025-02-17 22:30:13 -08:00
Daniel Han
cbb16e363b Update rl.py 2025-02-17 22:24:57 -08:00
Daniel Han
06b2cd3e57 unsloth_num_chunks 2025-02-17 22:17:11 -08:00
Daniel Han
24c7a2f7c4 Update rl_replacements.py 2025-02-17 21:17:58 -08:00
Daniel Han
97b55c139f Update rl_replacements.py 2025-02-17 21:10:26 -08:00
Daniel Han
7c0c7493cb Update rl_replacements.py 2025-02-17 21:08:32 -08:00
Daniel Han
58bd27f332 Update rl_replacements.py 2025-02-17 21:03:44 -08:00
Daniel Han
97637c5b3d Update rl_replacements.py 2025-02-17 20:38:18 -08:00
Daniel Han
f09478de36 Update rl_replacements.py 2025-02-17 20:21:20 -08:00
Daniel Han
47a85eba5a Update rl.py 2025-02-17 20:08:15 -08:00