ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,562 commits 391 branches 58 tags 304 MiB
Commit graph

1,562 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
92ea46eae4 Update pyproject.toml 2025-02-20 08:43:46 -08:00
Daniel Han
0cf0a33c41 Update rl_replacements.py 2025-02-20 08:31:37 -08:00
Daniel Han
7a6e004288 Update rl_replacements.py 2025-02-20 08:28:21 -08:00
Daniel Han
3a06c5054c Update _utils.py 2025-02-20 07:51:33 -08:00
Daniel Han
0d28429ba1 Update llama.py 2025-02-20 07:46:14 -08:00
Daniel Han
4dc880dae8 Update llama.py 2025-02-20 07:40:45 -08:00
Daniel Han
9c812cc72a Update llama.py 2025-02-20 07:36:23 -08:00
Daniel Han
1a0f18e598 Update llama.py 2025-02-20 07:25:31 -08:00
Daniel Han
2c438b3b99 Update llama.py 2025-02-20 07:01:14 -08:00
Daniel Han
0345c8b1c3 Merge branch 'main' into nightly 2025-02-20 05:14:57 -08:00
Daniel Han
cd3a733602 bug fix 2025-02-20 04:47:12 -08:00
Daniel Han
a45a08f91b Memory Efficient GRPO (#1773) 
* Update __init__.py

* Update loader.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Better TRL handling

* Update rl.py

* Update tokenizer_utils.py

* Auto patching

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update rl.py

* Update tokenizer_utils.py

* Update rl.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update tokenizer_utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* max seq length

* Update rl.py

* Update rl.py

* Patching

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* NEFTune

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Extra replacements

* Update rl_replacements.py

* Update rl.py

* extra RL replacements

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update _utils.py

* Update loader_utils.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* autocast

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update pyproject.toml

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* GRPO optimized

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Selective Log softmax

* Fix GRPO bsz

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Fix TRL

* Metrics GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* No compile

* Update rl.py

* Remove docs

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* llama-quantize on WINDOWS WSL error fix - edit save.py (gguf saving breaks) (#1649)

* edit save.py to fix gguf saving breaks.

* add check for .exe or not exe file extension for linux and windows

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* unsloth_num_chunks

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py (#1754)

Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.

* Optional logits

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

---------

Co-authored-by: Gennadii Manzhos <105049664+everythingisc00l@users.noreply.github.com>
Co-authored-by: Seth Weidman <seth@sethweidman.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
 2025-02-20 04:23:28 -08:00
Daniel Han
89711bf4f8 Versioning 2025-02-20 04:22:17 -08:00
Daniel Han
3a0fb38744 default num_chunks == -1 2025-02-19 23:51:06 -08:00
Daniel Han
50acb0f4f8 Update __init__.py 2025-02-19 23:45:07 -08:00
Daniel Han
940bce0b04 vLLMSamplingParams 2025-02-19 23:43:52 -08:00
Daniel Han
ad46d1a4a7 Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-02-19 23:40:50 -08:00
Ben
b8a2ceca14 [Windows Support] Add latest xformers wheels to pyproject.toml (#1753) 
* Add latest xformers

* Add a couple of lines to docs
 2025-02-19 23:40:07 -08:00
Edd
16e69efc96 Convert mask to float (#1762) 2025-02-19 23:38:48 -08:00
Daniel Han
c27074c28b SamplingParams 2025-02-19 23:37:52 -08:00
Nino Risteski
1b329a6731 fix an import error (#1767) 
* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-02-19 23:32:25 -08:00
Daniel Han
e9c0591119 Update rl.py 2025-02-19 23:27:16 -08:00
Daniel Han
f3488a88c5 Merge branch 'main' into nightly 2025-02-19 23:24:21 -08:00
Daniel Han
fbe9ee80d4 Update README.md (#1768) 2025-02-19 23:24:05 -08:00
Daniel Han
55e8c086dd Update rl.py 2025-02-19 23:23:39 -08:00
Daniel Han
4fdbe839ea Update rl.py 2025-02-19 23:15:13 -08:00
Daniel Han
b4bd52f978 Update rl.py 2025-02-19 23:06:18 -08:00
Daniel Han
93804d9998 Update rl_replacements.py 2025-02-19 22:03:47 -08:00
Daniel Han
fe3c84d250 Update rl.py 2025-02-19 21:41:17 -08:00
Daniel Han
4dfbbb2b9a Update rl.py 2025-02-19 17:58:25 -08:00
Daniel Han
90158637d3 Update rl.py 2025-02-19 16:40:37 -08:00
Daniel Han
5129cf3049 Update rl.py 2025-02-19 16:38:44 -08:00
Daniel Han
98ad241821 Update rl.py 2025-02-19 16:37:12 -08:00
Daniel Han
09d8c9b2ca Update rl.py 2025-02-19 12:51:22 -08:00
Daniel Han
e06905724d Update rl.py 2025-02-19 12:47:15 -08:00
Daniel Han
dc04a82307 Update rl.py 2025-02-19 03:41:51 -08:00
Daniel Han
3797412198 Optional logits 2025-02-19 02:23:00 -08:00
Seth Weidman
c2938ccc83 Update rl_replacements.py (#1754) 
Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.
 2025-02-19 02:12:07 -08:00
Daniel Han
b7a53c37bd Update rl_replacements.py 2025-02-18 01:57:18 -08:00
Daniel Han
9eb8e34a15 Update rl_replacements.py 2025-02-18 00:17:07 -08:00
Daniel Han
ab27ddc6a3 Update rl.py 2025-02-18 00:13:26 -08:00
Daniel Han
6148ce8d46 Update rl.py 2025-02-18 00:09:11 -08:00
Daniel Han
79141331f1 Update rl.py 2025-02-18 00:05:40 -08:00
Daniel Han
16f0cc2214 Update rl.py 2025-02-18 00:01:09 -08:00
Daniel Han
7a8ae1f272 Update rl.py 2025-02-17 23:57:57 -08:00
Daniel Han
2c81afe484 Update rl_replacements.py 2025-02-17 23:47:52 -08:00
Daniel Han
d6325aa94d Update rl_replacements.py 2025-02-17 22:30:20 -08:00
Daniel Han
6741b050d7 Update rl_replacements.py 2025-02-17 22:30:13 -08:00
Daniel Han
99b56e4193 Update rl.py 2025-02-17 22:24:57 -08:00
Daniel Han
6688732d2e unsloth_num_chunks 2025-02-17 22:17:11 -08:00