Daniel Han
4f20e54237
Revert "Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model me…" ( #2990 )
...
This reverts commit 204fc46e19
2025-07-17 15:37:23 -07:00
Daniel Han
2682c9bebc
Merge branch 'main' into nightly
2025-07-17 15:36:24 -07:00
Daniel Han
204fc46e19
Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model merge erro…" ( #2988 )
...
This reverts commit 6aedb647fa
2025-07-17 15:35:28 -07:00
Roland Tannous
6aedb647fa
Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model merge error ( #2986 )
2025-07-17 15:35:05 -07:00
DoubleMathew
c2ed0d8a99
use fastmodel ( #2987 )
2025-07-17 15:34:14 -07:00
Quentin Gallouédec
47c38c9aba
Update unsloth-cli.py ( #2985 )
2025-07-17 15:08:38 -07:00
Daniel Han
7ebde8ee67
Bug fixes ( #2982 )
...
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Small fixes
* Update vision.py
* Update vision.py
* versioning
* Update __init__.py
* Update llama.py
* Update rl.py
* Update rl.py
* Update _utils.py
* Update vision.py
* Update vision.py
* compiler stance
* Update _utils.py
* Update pyproject.toml
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
2025-07-17 07:02:38 -07:00
Daniel Han
3f4033e612
Update rl_replacements.py
2025-07-17 06:54:25 -07:00
Daniel Han
63b7963d38
Update rl_replacements.py
2025-07-17 06:51:59 -07:00
Daniel Han
6ea72964df
Update rl_replacements.py
2025-07-17 06:49:21 -07:00
Daniel Han
e766f2be4b
Update rl_replacements.py
2025-07-17 06:47:23 -07:00
Daniel Han
ab9c21d6c8
Update rl_replacements.py
2025-07-17 06:44:28 -07:00
Daniel Han
e85aa501e5
Update rl_replacements.py
2025-07-17 06:44:13 -07:00
Daniel Han
e4455edf81
Update rl_replacements.py
2025-07-17 06:39:59 -07:00
Daniel Han
97e3f9e69b
Update rl.py
2025-07-17 06:30:26 -07:00
Daniel Han
6be29a36a6
Update rl_replacements.py
2025-07-17 06:26:10 -07:00
Daniel Han
ac845d1093
Update rl_replacements.py
2025-07-17 06:25:21 -07:00
Daniel Han
ce1d9f7f4e
Update rl_replacements.py
2025-07-17 06:24:33 -07:00
Daniel Han
ac5c247962
Update rl_replacements.py
2025-07-17 06:23:37 -07:00
Daniel Han
c9e6741e1e
Update pyproject.toml
2025-07-17 05:38:04 -07:00
Daniel Han
61b1491d7f
Update pyproject.toml
2025-07-17 05:26:58 -07:00
Daniel Han
7eaef8e81e
Merge branch 'main' into nightly
2025-07-17 05:14:52 -07:00
Daniel Han
f6a9dc49af
Revert "GRPO Fix - Support vllm pre-dequantized quantization states in fast_dequantize kernel ( #2943 )"
...
This reverts commit 0eb61fbea7
2025-07-17 05:02:08 -07:00
Daniel Han
e9bc2d21fb
Update _utils.py
2025-07-17 02:08:49 -07:00
Daniel Han
84ef3b6a8f
compiler stance
2025-07-17 01:40:49 -07:00
Daniel Han
b07ef89376
Update vision.py
2025-07-17 01:19:07 -07:00
Daniel Han
a3ded71100
Update vision.py
2025-07-17 00:33:27 -07:00
Daniel Han
56438e0c91
Update _utils.py
2025-07-14 02:45:19 -07:00
Daniel Han
8b845f29a9
Merge branch 'main' into nightly
2025-07-14 02:44:42 -07:00
Roland Tannous
0eb61fbea7
GRPO Fix - Support vllm pre-dequantized quantization states in fast_dequantize kernel ( #2943 )
...
* Support pre-dequantized quantization states in fast_dequantize kernel
* has_nested_quant conditional set to only
* Update utils.py
* Update utils.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-07-14 02:41:15 -07:00
Roland Tannous
c972010449
fix dataloader_num_workers value error in GRPOTrainer ( #2944 )
2025-07-14 01:43:33 -07:00
Muzammil Khan
cf5bf081fb
fix: change lora_dropout from int to float for type consistency ( #2949 )
...
Fixes "Argument of type 'float' cannot be assigned to parameter 'lora_dropout' of type 'int'" error by ensuring lora_dropout is consistently a float (0.0) rather than int (0) across vision.py, llama.py, and unsloth-cli.py
2025-07-14 01:42:07 -07:00
Datta Nimmaturi
1898b6d049
Fix falcon H1 dropout issue ( #2938 )
...
Because we don't have down and gate multipliers, the MLP output values are too huge, causing NaN and unstable training. To bypass that lets rely on HF's implementation for the time being
2025-07-12 15:53:07 -07:00
DoubleMathew
e339860ba0
patch falcon h1 inference ( #2932 )
2025-07-12 15:52:24 -07:00
Daniel Han
f788488190
Update rl.py
2025-07-11 03:13:55 -07:00
Daniel Han
b3261aee16
Update rl.py
2025-07-11 03:11:07 -07:00
Daniel Han
a09a0b556e
Merge branch 'main' into nightly
2025-07-11 03:04:28 -07:00
Daniel Han
7758e1da96
Uninitialized handler
2025-07-11 03:04:17 -07:00
Daniel Han
2fac21687f
Fixes
2025-07-11 00:01:37 -07:00
Daniel Han
2947b90784
Update llama.py
2025-07-10 17:18:40 -07:00
Daniel Han
81eaf81ac2
Merge branch 'main' into nightly
2025-07-10 17:12:59 -07:00
Daniel Han
b780dcfc6b
Fix GRPO
2025-07-10 17:12:49 -07:00
Michael Han
4b5076e6b7
Merge pull request #2929 from rolandtannous/fix/fix-grpo-get-per-token-logps-argument-mismatch
...
Fix argument mismatch in GRPO _get_per_token_logps lambda function
2025-07-10 14:30:05 -07:00
Roland Tannous
3475bb4a8f
Fix argument mismatch in GRPO _get_per_token_logps lambda function
2025-07-10 18:24:53 +00:00
Daniel Han
856cf94130
Merge branch 'main' into nightly
2025-07-10 07:03:59 -07:00
Daniel Han
af7fe19e40
Many bug fixes ( #2927 )
...
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Small fixes
* Update vision.py
* Update vision.py
* versioning
* Update __init__.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-07-10 07:03:48 -07:00
Daniel Han
e9de967a1b
Update __init__.py
2025-07-10 07:03:28 -07:00
Daniel Han
3ef29aa991
versioning
2025-07-10 07:01:44 -07:00
Daniel Han
d6b0a52270
Update vision.py
2025-07-10 05:15:03 -07:00
Daniel Han
09bfd6da43
Update vision.py
2025-07-10 04:34:23 -07:00
