ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
2,629 commits 391 branches 58 tags 304 MiB
Commit graph

2,629 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
d89b4e8089 Fix quantization_method 2025-07-21 05:14:17 -07:00
Daniel Han
dd06e90628 Update llama.py 2025-07-20 03:19:10 -07:00
Daniel Han
cc6b25849f Update llama.py 2025-07-20 03:17:02 -07:00
Daniel Han
4813fda120 Update synthetic.py 2025-07-20 00:10:41 -07:00
Daniel Han
04ec7af3e8 Update synthetic.py 2025-07-19 03:36:53 -07:00
Daniel Han
6216f946c5 Update synthetic.py 2025-07-19 03:18:18 -07:00
Daniel Han
20a06145e6 Update synthetic.py 2025-07-19 03:11:33 -07:00
Daniel Han
4f73de8041 Update synthetic.py 2025-07-19 02:54:28 -07:00
Daniel Han
ff3da36a54 Merge branch 'main' into nightly 2025-07-19 01:29:41 -07:00
Quentin Gallouédec
7b4ea96c08 Update README.md (#2991) 
* Update README.md

* Update README.md
 2025-07-18 15:43:59 -07:00
Daniel Han
0051a8832b Merge branch 'main' into nightly 2025-07-18 05:37:10 -07:00
Daniel Han
7c72f8ffc7 Bug fixes (#2998) 
* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Debugging only

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Generic efficient GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* Remove debugging

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update llama.py

* Update rl_replacements.py

* versioning

* Update _utils.py

* Update vision.py

* Update mapper.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update _utils.py

* Update vision.py

* gradient checkpointing

* Gemma 3N fixes

* Update loader.py

* Versioning

* Gemma 3N fixes

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Fix setup.py

* setup.py

* Prints

* Update setup.py

* Update setup.py

* Update setup.py

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update pyproject.toml

* Update vision.py

* Update _utils.py

* Update __init__.py

* Update __init__.py

* Small fixes

* Update vision.py

* Update vision.py

* versioning

* Update __init__.py

* Update llama.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update vision.py

* Update vision.py

* compiler stance

* Update _utils.py

* Update pyproject.toml

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Revert "Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model me…" (#2990)

This reverts commit 6631007493.

* skip_guard_eval_unsafe fix
 2025-07-18 05:36:15 -07:00
Daniel Han
19a33e8cf8 skip_guard_eval_unsafe fix 2025-07-18 05:31:21 -07:00
Daniel Han
b707fd78c4 Revert "Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model me…" (#2990) 
This reverts commit 6631007493.
 2025-07-17 15:37:23 -07:00
Daniel Han
c3763d5ec3 Merge branch 'main' into nightly 2025-07-17 15:36:24 -07:00
Daniel Han
6631007493 Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model merge erro…" (#2988) 
This reverts commit 73c02231de.
 2025-07-17 15:35:28 -07:00
Roland Tannous
73c02231de Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model merge error (#2986) 2025-07-17 15:35:05 -07:00
DoubleMathew
8362af2475 use fastmodel (#2987) 2025-07-17 15:34:14 -07:00
Quentin Gallouédec
be955324c4 Update unsloth-cli.py (#2985) 2025-07-17 15:08:38 -07:00
Daniel Han
1b28ec31f7 Bug fixes (#2982) 
* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Debugging only

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Generic efficient GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* Remove debugging

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update llama.py

* Update rl_replacements.py

* versioning

* Update _utils.py

* Update vision.py

* Update mapper.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update _utils.py

* Update vision.py

* gradient checkpointing

* Gemma 3N fixes

* Update loader.py

* Versioning

* Gemma 3N fixes

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Fix setup.py

* setup.py

* Prints

* Update setup.py

* Update setup.py

* Update setup.py

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update pyproject.toml

* Update vision.py

* Update _utils.py

* Update __init__.py

* Update __init__.py

* Small fixes

* Update vision.py

* Update vision.py

* versioning

* Update __init__.py

* Update llama.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update vision.py

* Update vision.py

* compiler stance

* Update _utils.py

* Update pyproject.toml

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py
 2025-07-17 07:02:38 -07:00
Daniel Han
4217703430 Update rl_replacements.py 2025-07-17 06:54:25 -07:00
Daniel Han
f245bf4408 Update rl_replacements.py 2025-07-17 06:51:59 -07:00
Daniel Han
a9209cf4fa Update rl_replacements.py 2025-07-17 06:49:21 -07:00
Daniel Han
fd1547cd7b Update rl_replacements.py 2025-07-17 06:47:23 -07:00
Daniel Han
62c874f37b Update rl_replacements.py 2025-07-17 06:44:28 -07:00
Daniel Han
0a00c6fee1 Update rl_replacements.py 2025-07-17 06:44:13 -07:00
Daniel Han
585453b19b Update rl_replacements.py 2025-07-17 06:39:59 -07:00
Daniel Han
a14ee1b764 Update rl.py 2025-07-17 06:30:26 -07:00
Daniel Han
1a969535e4 Update rl_replacements.py 2025-07-17 06:26:10 -07:00
Daniel Han
34c66f0327 Update rl_replacements.py 2025-07-17 06:25:21 -07:00
Daniel Han
31df063c28 Update rl_replacements.py 2025-07-17 06:24:33 -07:00
Daniel Han
e4e6bc1e4a Update rl_replacements.py 2025-07-17 06:23:37 -07:00
Daniel Han
bf628efd28 Update pyproject.toml 2025-07-17 05:38:04 -07:00
Daniel Han
fa7b673a9c Update pyproject.toml 2025-07-17 05:26:58 -07:00
Daniel Han
743010d7fc Merge branch 'main' into nightly 2025-07-17 05:14:52 -07:00
Daniel Han
170fbcad66 Revert "GRPO Fix - Support vllm pre-dequantized quantization states in fast_dequantize kernel (#2943)" 
This reverts commit 2d4ef50fb3.
 2025-07-17 05:02:08 -07:00
Daniel Han
935754dba2 Update _utils.py 2025-07-17 02:08:49 -07:00
Daniel Han
d17519d819 compiler stance 2025-07-17 01:40:49 -07:00
Daniel Han
54f09f2fd7 Update vision.py 2025-07-17 01:19:07 -07:00
Daniel Han
ec8a4c6216 Update vision.py 2025-07-17 00:33:27 -07:00
Daniel Han
9d1afec41d Update _utils.py 2025-07-14 02:45:19 -07:00
Daniel Han
85b1825e66 Merge branch 'main' into nightly 2025-07-14 02:44:42 -07:00
Roland Tannous
2d4ef50fb3 GRPO Fix - Support vllm pre-dequantized quantization states in fast_dequantize kernel (#2943) 
* Support pre-dequantized quantization states in fast_dequantize kernel

* has_nested_quant conditional set to  only

* Update utils.py

* Update utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-07-14 02:41:15 -07:00
Roland Tannous
497f8ccdc3 fix dataloader_num_workers value error in GRPOTrainer (#2944) 2025-07-14 01:43:33 -07:00
Muzammil Khan
20ef20422b fix: change lora_dropout from int to float for type consistency (#2949) 
Fixes "Argument of type 'float' cannot be assigned to parameter 'lora_dropout' of type 'int'" error by ensuring lora_dropout is consistently a float (0.0) rather than int (0) across vision.py, llama.py, and unsloth-cli.py
 2025-07-14 01:42:07 -07:00
Datta Nimmaturi
382e9e03ce Fix falcon H1 dropout issue (#2938) 
Because we don't have down and gate multipliers, the MLP output values are too huge, causing NaN and unstable training. To bypass that lets rely on HF's implementation for the time being
 2025-07-12 15:53:07 -07:00
DoubleMathew
ac8848b45f patch falcon h1 inference (#2932) 2025-07-12 15:52:24 -07:00
Daniel Han
75e394b269 Update rl.py 2025-07-11 03:13:55 -07:00
Daniel Han
e69923e93f Update rl.py 2025-07-11 03:11:07 -07:00
Daniel Han
a7c3f7e339 Merge branch 'main' into nightly 2025-07-11 03:04:28 -07:00