ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,765 commits 391 branches 58 tags 304 MiB
Commit graph

1,765 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
f45bddbdae Update vision.py 2025-03-13 06:06:24 -07:00
Daniel Han
0288db2fa7 Autocast 2025-03-13 06:02:33 -07:00
Daniel Han
33c7219dc7 forced precision 2025-03-13 05:46:02 -07:00
Daniel Han
ac5f2b33dc Update _utils.py 2025-03-13 05:38:21 -07:00
Daniel Han
9f89844a81 Revert 2025-03-13 05:13:17 -07:00
Daniel Han
885265db8d Update vision.py 2025-03-13 01:30:06 -07:00
Daniel Han
ba096eda6e Update vision.py 2025-03-13 01:27:50 -07:00
Daniel Han
7bd582a6ff Update loader.py 2025-03-13 01:17:48 -07:00
Daniel Han
4a917c3a92 Update vision.py 2025-03-13 01:15:25 -07:00
Daniel Han
8dd99de4ee Update vision.py 2025-03-12 22:23:29 -07:00
Daniel Han
2079f9f217 Update vision.py 2025-03-12 22:22:23 -07:00
Daniel Han
b63cafd329 Update chat_templates.py 2025-03-12 21:52:38 -07:00
Daniel Han
60eccec650 Update chat_templates.py 2025-03-12 21:47:53 -07:00
Daniel Han
d79a19fe0b Update rl.py 2025-03-12 21:47:01 -07:00
Daniel Han
b23ef893b9 Update llama.py 2025-03-12 21:42:27 -07:00
Daniel Han
44f405a009 Update llama.py 2025-03-12 21:40:20 -07:00
Daniel Han
b637868fb2 Update vision.py 2025-03-12 21:38:51 -07:00
Daniel Han
10c9033872 Update vision.py 2025-03-12 21:35:29 -07:00
Daniel Han
1717d67070 Update vision.py 2025-03-12 21:34:34 -07:00
Daniel Han
4cfb8aed5d Update vision.py 2025-03-12 21:33:22 -07:00
Daniel Han
14360a81d8 Update vision.py 2025-03-12 21:31:37 -07:00
Daniel Han
afe6c9e247 Bug fixes 2025-03-12 21:30:02 -07:00
Daniel Han
e81486b0bf Gemma 3 chat template 2025-03-12 20:37:19 -07:00
Daniel Han
fc5933c017 model names 2025-03-12 20:04:27 -07:00
Daniel Han
19bb14dfa9 Update loader.py 2025-03-12 19:25:41 -07:00
Daniel Han
ce96e82496 Temporary patches 2025-03-12 19:20:17 -07:00
Daniel Han
59b1a034b8 Update vision.py 2025-03-12 06:51:23 -07:00
Daniel Han
b75e121b26 Merge branch 'main' into nightly 2025-03-12 05:00:45 -07:00
Daniel Han
3960c4c0d0 Update _utils.py 2025-03-12 04:52:07 -07:00
Daniel Han
6c24831c7c Update _utils.py 2025-03-12 04:46:34 -07:00
Daniel Han
91642617a8 Update mapper.py 2025-03-12 04:07:45 -07:00
Daniel Han
da8ebf776d Gemma 3 (#1986) 
* Update llama.py

* GRPO optimized

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Selective Log softmax

* Fix GRPO bsz

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Fix TRL

* Metrics GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* No compile

* Update rl.py

* Remove docs

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* llama-quantize on WINDOWS WSL error fix - edit save.py (gguf saving breaks) (#1649)

* edit save.py to fix gguf saving breaks.

* add check for .exe or not exe file extension for linux and windows

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* unsloth_num_chunks

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py (#1754)

Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.

* Optional logits

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update pyproject.toml

* Update pyproject.toml

* Export Model to ollama.com  (#1648)

* Ollama Export Model to ollama.com

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Check for model_name

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* subprocess use instead of requests | added check for ollama server

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model | fix

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Push to Ollama

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Update cross_entropy_loss.py

* torch_cuda_device

* Update utils.py

* Update utils.py

* Update utils.py

* device

* device

* Update loader.py

* Update llama.py

* Update README.md

* Update llama.py

* Update llama.py

* Update _utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* __version__

* Update rl.py

* Bug fixes

* Bug fixes

* Update llama.py

* Update _utils.py

* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>
Co-authored-by: Gennadii Manzhos <105049664+everythingisc00l@users.noreply.github.com>
Co-authored-by: Seth Weidman <seth@sethweidman.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
Co-authored-by: Jyotin Goel <120490013+gjyotin305@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
 2025-03-12 01:23:34 -07:00
Daniel Han
59ee04021c Update mapper.py 2025-03-11 23:35:46 -07:00
Daniel Han
4696bc0931 Update vision.py 2025-03-11 22:55:34 -07:00
Daniel Han
a9687f6224 Update vision.py 2025-03-11 22:36:51 -07:00
Daniel Han
6949a52dcc Update vision.py 2025-03-11 22:34:57 -07:00
Daniel Han
cf2dd1ff53 Update loader.py 2025-03-11 22:31:14 -07:00
Daniel Han
a22eec898d Update vision.py 2025-03-11 22:29:06 -07:00
Daniel Han
2637427be7 Update loader.py 2025-03-11 22:27:53 -07:00
Daniel Han
fa595d3b44 Update _utils.py 2025-03-11 22:22:36 -07:00
Daniel Han
48813c903e Update loader.py 2025-03-11 22:02:39 -07:00
Daniel Han
f6a745d73a Update loader.py 2025-03-11 20:45:53 -07:00
Daniel Han
fa7030b71e Update loader.py 2025-03-11 20:44:01 -07:00
Daniel Han
407f5d472b Update loader.py 2025-03-11 20:43:25 -07:00
Daniel Han
85bb3e619d Batch samples 2025-03-11 19:46:41 -07:00
Daniel Han
cabf4a7345 Update _utils.py 2025-03-11 15:25:21 -07:00
Daniel Han
3478774039 Update _utils.py 2025-03-11 15:22:16 -07:00
Daniel Han
6c3f84a24f Update _utils.py 2025-03-11 15:20:20 -07:00
Daniel Han
ed1d1a06b1 Update pyproject.toml 2025-03-11 14:59:29 -07:00
Daniel Han
0176f058b2 Update mapper.py 2025-03-11 05:37:29 -07:00