ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,759 commits 391 branches 58 tags 304 MiB
Commit graph

1,759 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
7d0893bd89 Update vision.py 2025-03-13 01:27:50 -07:00
Daniel Han
dd17676c99 Update loader.py 2025-03-13 01:17:48 -07:00
Daniel Han
6e58d9764f Update vision.py 2025-03-13 01:15:25 -07:00
Daniel Han
c96eab5d8c Update vision.py 2025-03-12 22:23:29 -07:00
Daniel Han
caec8ffcf9 Update vision.py 2025-03-12 22:22:23 -07:00
Daniel Han
07f47a4d20 Update chat_templates.py 2025-03-12 21:52:38 -07:00
Daniel Han
b0d9ee0a8a Update chat_templates.py 2025-03-12 21:47:53 -07:00
Daniel Han
24cd9f719a Update rl.py 2025-03-12 21:47:01 -07:00
Daniel Han
97f40bdb0d Update llama.py 2025-03-12 21:42:27 -07:00
Daniel Han
9005a5700c Update llama.py 2025-03-12 21:40:20 -07:00
Daniel Han
6218eae6ad Update vision.py 2025-03-12 21:38:51 -07:00
Daniel Han
a3637fa0b2 Update vision.py 2025-03-12 21:35:29 -07:00
Daniel Han
ed588ee66e Update vision.py 2025-03-12 21:34:34 -07:00
Daniel Han
bc735a7522 Update vision.py 2025-03-12 21:33:22 -07:00
Daniel Han
8457c759cd Update vision.py 2025-03-12 21:31:37 -07:00
Daniel Han
57a5442f83 Bug fixes 2025-03-12 21:30:02 -07:00
Daniel Han
bb193e48e0 Gemma 3 chat template 2025-03-12 20:37:19 -07:00
Daniel Han
3326c4f6ad model names 2025-03-12 20:04:27 -07:00
Daniel Han
bb59cec9d7 Update loader.py 2025-03-12 19:25:41 -07:00
Daniel Han
b6187c6428 Temporary patches 2025-03-12 19:20:17 -07:00
Daniel Han
f386f0fe49 Update vision.py 2025-03-12 06:51:23 -07:00
Daniel Han
0df6ad49a8 Merge branch 'main' into nightly 2025-03-12 05:00:45 -07:00
Daniel Han
71039cb1ce Update _utils.py 2025-03-12 04:52:07 -07:00
Daniel Han
3edacc50bc Update _utils.py 2025-03-12 04:46:34 -07:00
Daniel Han
060f931edf Update mapper.py 2025-03-12 04:07:45 -07:00
Daniel Han
78374adccd
 		Gemma 3 (#1986) 
* Update llama.py

* GRPO optimized

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Selective Log softmax

* Fix GRPO bsz

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Fix TRL

* Metrics GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* No compile

* Update rl.py

* Remove docs

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* llama-quantize on WINDOWS WSL error fix - edit save.py (gguf saving breaks) (#1649)

* edit save.py to fix gguf saving breaks.

* add check for .exe or not exe file extension for linux and windows

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* unsloth_num_chunks

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py (#1754)

Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.

* Optional logits

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update pyproject.toml

* Update pyproject.toml

* Export Model to ollama.com  (#1648)

* Ollama Export Model to ollama.com

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Check for model_name

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* subprocess use instead of requests | added check for ollama server

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model | fix

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Push to Ollama

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Update cross_entropy_loss.py

* torch_cuda_device

* Update utils.py

* Update utils.py

* Update utils.py

* device

* device

* Update loader.py

* Update llama.py

* Update README.md

* Update llama.py

* Update llama.py

* Update _utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* __version__

* Update rl.py

* Bug fixes

* Bug fixes

* Update llama.py

* Update _utils.py

* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>
Co-authored-by: Gennadii Manzhos <105049664+everythingisc00l@users.noreply.github.com>
Co-authored-by: Seth Weidman <seth@sethweidman.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
Co-authored-by: Jyotin Goel <120490013+gjyotin305@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
 2025-03-12 01:23:34 -07:00
Daniel Han
ceda772a3d Update mapper.py 2025-03-11 23:35:46 -07:00
Daniel Han
2fdeecd179 Update vision.py 2025-03-11 22:55:34 -07:00
Daniel Han
152b376eca Update vision.py 2025-03-11 22:36:51 -07:00
Daniel Han
528e8f07ba Update vision.py 2025-03-11 22:34:57 -07:00
Daniel Han
0c4ebb3a05 Update loader.py 2025-03-11 22:31:14 -07:00
Daniel Han
ea6aae6858 Update vision.py 2025-03-11 22:29:06 -07:00
Daniel Han
d6d862eb15 Update loader.py 2025-03-11 22:27:53 -07:00
Daniel Han
80eac80093 Update _utils.py 2025-03-11 22:22:36 -07:00
Daniel Han
b388d8de36 Update loader.py 2025-03-11 22:02:39 -07:00
Daniel Han
ead1b3be56 Update loader.py 2025-03-11 20:45:53 -07:00
Daniel Han
b556785f25 Update loader.py 2025-03-11 20:44:01 -07:00
Daniel Han
eb0add48c1 Update loader.py 2025-03-11 20:43:25 -07:00
Daniel Han
a4faf0f992 Batch samples 2025-03-11 19:46:41 -07:00
Daniel Han
a3541c054c Update _utils.py 2025-03-11 15:25:21 -07:00
Daniel Han
3aa2d959dd Update _utils.py 2025-03-11 15:22:16 -07:00
Daniel Han
3ddcf849e0 Update _utils.py 2025-03-11 15:20:20 -07:00
Daniel Han
c539fc6a71 Update pyproject.toml 2025-03-11 14:59:29 -07:00
Daniel Han
77fec997e6 Update mapper.py 2025-03-11 05:37:29 -07:00
Daniel Han
c555388223 AutoModelForImageTextToText 2025-03-11 04:30:01 -07:00
Daniel Han
739b1dd6ea Update pyproject.toml 2025-03-11 00:18:55 -07:00
Daniel Han
a8c96d3be2 Update rl.py 2025-03-10 05:00:45 -07:00
Daniel Han
8b16a16d5b Update rl.py 2025-03-10 04:58:59 -07:00
Daniel Han
8f16ce0a35 Update rl.py 2025-03-10 04:57:47 -07:00
Daniel Han
4c0a8d62b9 max_seq_length 2025-03-10 04:39:25 -07:00