Commit graph

1,542 commits

Author SHA1 Message Date
Nino Risteski
d95f5782d0 fix an import error (#1767)
* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-02-19 23:32:25 -08:00
Daniel Han
abeb373878 Update rl.py 2025-02-19 23:27:16 -08:00
Daniel Han
309fd6cd90 Merge branch 'main' into nightly 2025-02-19 23:24:21 -08:00
Daniel Han
25988683f8 Update README.md (#1768) 2025-02-19 23:24:05 -08:00
Daniel Han
e83d31632c Update rl.py 2025-02-19 23:23:39 -08:00
Daniel Han
b15b98c697 Update rl.py 2025-02-19 23:15:13 -08:00
Daniel Han
381b025779 Update rl.py 2025-02-19 23:06:18 -08:00
Daniel Han
18dfabd8e5 Update rl_replacements.py 2025-02-19 22:03:47 -08:00
Daniel Han
078d623b5d Update rl.py 2025-02-19 21:41:17 -08:00
Daniel Han
8368734e48 Update rl.py 2025-02-19 17:58:25 -08:00
Daniel Han
cc7188e7d2 Update rl.py 2025-02-19 16:40:37 -08:00
Daniel Han
8a703abe10 Update rl.py 2025-02-19 16:38:44 -08:00
Daniel Han
94264f7017 Update rl.py 2025-02-19 16:37:12 -08:00
Daniel Han
d9b31ee764 Update rl.py 2025-02-19 12:51:22 -08:00
Daniel Han
5ee0990347 Update rl.py 2025-02-19 12:47:15 -08:00
Daniel Han
17245595fa Update rl.py 2025-02-19 03:41:51 -08:00
Daniel Han
10b236d634 Optional logits 2025-02-19 02:23:00 -08:00
Seth Weidman
9f354c1447 Update rl_replacements.py (#1754)
Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.
2025-02-19 02:12:07 -08:00
Daniel Han
550cddefb5 Update rl_replacements.py 2025-02-18 01:57:18 -08:00
Daniel Han
606fc099f3 Update rl_replacements.py 2025-02-18 00:17:07 -08:00
Daniel Han
f444c7517d Update rl.py 2025-02-18 00:13:26 -08:00
Daniel Han
9455ef40c9 Update rl.py 2025-02-18 00:09:11 -08:00
Daniel Han
fa831423b3 Update rl.py 2025-02-18 00:05:40 -08:00
Daniel Han
afa5f08c45 Update rl.py 2025-02-18 00:01:09 -08:00
Daniel Han
3b5c0d3c74 Update rl.py 2025-02-17 23:57:57 -08:00
Daniel Han
72999b3885 Update rl_replacements.py 2025-02-17 23:47:52 -08:00
Daniel Han
cf0f907321 Update rl_replacements.py 2025-02-17 22:30:20 -08:00
Daniel Han
6bac0780bc Update rl_replacements.py 2025-02-17 22:30:13 -08:00
Daniel Han
c355a7457d Update rl.py 2025-02-17 22:24:57 -08:00
Daniel Han
e554eb6f28 unsloth_num_chunks 2025-02-17 22:17:11 -08:00
Daniel Han
e77d21688d Update rl_replacements.py 2025-02-17 21:17:58 -08:00
Daniel Han
26aca36db8 Update rl_replacements.py 2025-02-17 21:10:26 -08:00
Daniel Han
46f470bea6 Update rl_replacements.py 2025-02-17 21:08:32 -08:00
Daniel Han
68d7c9941d Update rl_replacements.py 2025-02-17 21:03:44 -08:00
Daniel Han
2bba4e02d3 Update rl_replacements.py 2025-02-17 20:38:18 -08:00
Daniel Han
673325dea7 Update rl_replacements.py 2025-02-17 20:21:20 -08:00
Daniel Han
24d9963c83 Update rl.py 2025-02-17 20:08:15 -08:00
Daniel Han
f3c8175ac6 Update rl.py 2025-02-17 20:04:26 -08:00
Daniel Han
053952c948 Update rl_replacements.py 2025-02-17 20:04:14 -08:00
Daniel Han
33aa91ae42 Update rl.py 2025-02-17 20:00:04 -08:00
Daniel Han
8bdcfec233 Update rl.py 2025-02-17 19:58:17 -08:00
Daniel Han
abc16ad45f Update rl_replacements.py 2025-02-17 19:53:49 -08:00
Daniel Han
a55a25e0c5 Update rl_replacements.py 2025-02-17 19:45:07 -08:00
Daniel Han
dc743ef4da Update rl_replacements.py 2025-02-17 19:44:43 -08:00
Daniel Han
25a7117dbe Update llama.py 2025-02-17 19:16:41 -08:00
Daniel Han
a5fcf2dfc6 Update llama.py 2025-02-17 00:49:35 -08:00
Daniel Han
a9a4b5e436 Update rl_replacements.py 2025-02-17 00:43:11 -08:00
Daniel Han
30c59b1e34 Update rl_replacements.py 2025-02-17 00:05:32 -08:00
Daniel Han
a83afa3622 Update rl_replacements.py 2025-02-16 23:49:20 -08:00
Daniel Han
8c57ab2e0b Update llama.py 2025-02-16 21:22:35 -08:00