Daniel Han
f3606ea3d9
Update pyproject.toml
2025-07-17 05:26:58 -07:00
Daniel Han
1185706555
Merge branch 'main' into nightly
2025-07-17 05:14:52 -07:00
Daniel Han
2c468550e6
Revert "GRPO Fix - Support vllm pre-dequantized quantization states in fast_dequantize kernel ( #2943 )"
...
This reverts commit 1cefffa2d2
2025-07-17 05:02:08 -07:00
Daniel Han
03c880f5da
Update _utils.py
2025-07-17 02:08:49 -07:00
Daniel Han
c88758124a
compiler stance
2025-07-17 01:40:49 -07:00
Daniel Han
aa8e172396
Update vision.py
2025-07-17 01:19:07 -07:00
Daniel Han
b112838f58
Update vision.py
2025-07-17 00:33:27 -07:00
Daniel Han
98cebf3d06
Update _utils.py
2025-07-14 02:45:19 -07:00
Daniel Han
e718c27474
Merge branch 'main' into nightly
2025-07-14 02:44:42 -07:00
Roland Tannous
1cefffa2d2
GRPO Fix - Support vllm pre-dequantized quantization states in fast_dequantize kernel ( #2943 )
...
* Support pre-dequantized quantization states in fast_dequantize kernel
* has_nested_quant conditional set to only
* Update utils.py
* Update utils.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-07-14 02:41:15 -07:00
Roland Tannous
32738da0d1
fix dataloader_num_workers value error in GRPOTrainer ( #2944 )
2025-07-14 01:43:33 -07:00
Muzammil Khan
1eaa52ae55
fix: change lora_dropout from int to float for type consistency ( #2949 )
...
Fixes "Argument of type 'float' cannot be assigned to parameter 'lora_dropout' of type 'int'" error by ensuring lora_dropout is consistently a float (0.0) rather than int (0) across vision.py, llama.py, and unsloth-cli.py
2025-07-14 01:42:07 -07:00
Datta Nimmaturi
665a8e4b1d
Fix falcon H1 dropout issue ( #2938 )
...
Because we don't have down and gate multipliers, the MLP output values are too huge, causing NaN and unstable training. To bypass that lets rely on HF's implementation for the time being
2025-07-12 15:53:07 -07:00
DoubleMathew
bbcba7fc21
patch falcon h1 inference ( #2932 )
2025-07-12 15:52:24 -07:00
Daniel Han
01f649f6fc
Update rl.py
2025-07-11 03:13:55 -07:00
Daniel Han
7c8cd3dd6d
Update rl.py
2025-07-11 03:11:07 -07:00
Daniel Han
7d2106e5c6
Merge branch 'main' into nightly
2025-07-11 03:04:28 -07:00
Daniel Han
f155097cd8
Uninitialized handler
2025-07-11 03:04:17 -07:00
Daniel Han
681b10dc0c
Fixes
2025-07-11 00:01:37 -07:00
Daniel Han
2dae012308
Update llama.py
2025-07-10 17:18:40 -07:00
Daniel Han
17f7447a39
Merge branch 'main' into nightly
2025-07-10 17:12:59 -07:00
Daniel Han
9071adb723
Fix GRPO
2025-07-10 17:12:49 -07:00
Michael Han
6503961a33
Merge pull request #2929 from rolandtannous/fix/fix-grpo-get-per-token-logps-argument-mismatch
...
Fix argument mismatch in GRPO _get_per_token_logps lambda function
2025-07-10 14:30:05 -07:00
Roland Tannous
8d6da15c2e
Fix argument mismatch in GRPO _get_per_token_logps lambda function
2025-07-10 18:24:53 +00:00
Daniel Han
07df9c1233
Merge branch 'main' into nightly
2025-07-10 07:03:59 -07:00
Daniel Han
5a2dcc924b
Many bug fixes ( #2927 )
...
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Small fixes
* Update vision.py
* Update vision.py
* versioning
* Update __init__.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-07-10 07:03:48 -07:00
Daniel Han
c73406d8ba
Update __init__.py
2025-07-10 07:03:28 -07:00
Daniel Han
ee93391155
versioning
2025-07-10 07:01:44 -07:00
Daniel Han
509cf61834
Update vision.py
2025-07-10 05:15:03 -07:00
Daniel Han
d3bd189e47
Update vision.py
2025-07-10 04:34:23 -07:00
Daniel Han
ace8de011d
Small fixes
2025-07-10 04:04:51 -07:00
Daniel Han
d4a302ff3d
Merge branch 'main' into nightly
2025-07-10 04:02:01 -07:00
Datta Nimmaturi
c77f6c3719
Move inputs to right devices. ( #2919 )
...
* Move tensors to right devices
* fix multi gpu for non mistral models
* multi GPU RoPE for gemma2
* Finish up multi GPU inference
* Make multiGPU rope a list
* Remove unnecessary transfer to CPU
* Remove unnecessary move to CPU
* Donot move inputs to device yet
will be handled separately in another PR
* Move inputs to appropriate decoder device
* Make device count global variable
* Cleanup RoPE device code
* Fixup num_gpu to device count
* Cleanup device counts
* Use device index for RoPE get_cache
* Donot typecast
* Use tuple instead of list for tensors. Use device index directly
* fixup move to device logic
2025-07-10 04:01:03 -07:00
Daniel Han
13a32054b7
Merge branch 'main' into nightly
2025-07-10 01:50:14 -07:00
Daniel Han
62c5c315dd
Merge branch 'main' of https://github.com/unslothai/unsloth
2025-07-10 01:50:04 -07:00
Daniel Han
87e1a933d8
Update llama.py
2025-07-10 01:50:03 -07:00
DoubleMathew
643f9b068b
if mlp doesn't exist in layer module check for feed_forward name for falcon h1 ( #2913 )
2025-07-09 23:29:41 -07:00
Daniel Han
20f665a98a
Update __init__.py
2025-07-09 16:30:57 -07:00
Datta Nimmaturi
ced87c6059
Explicitly check if xformers exists for attention ( #2889 )
2025-07-09 14:15:35 -07:00
Lei Zhenyuan
6a36b6e1fc
[bugs] fix for casual mask ( #2868 )
...
* fix for casual mask
* use un_casual in sdpa
* add missing mask
* fix for type
2025-07-09 14:10:25 -07:00
Lei Zhenyuan
74b9feb674
add intel gpu with vllm support ( #2903 )
2025-07-09 14:08:38 -07:00
Datta Nimmaturi
772f15ca49
Dynamically adjust get_per_token_logps function and patch as well ( #2911 )
2025-07-09 14:07:33 -07:00
DoubleMathew
c4901fd894
silienty skip falcon h1 import is transformers_version < 4.53.0 ( #2912 )
2025-07-09 14:05:41 -07:00
Daniel Han
1fb1b72ae1
Merge branch 'main' into nightly
2025-07-09 14:03:38 -07:00
Daniel Han
7dde992481
Many bug fixes ( #2908 )
...
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-07-09 07:14:18 -07:00
Daniel Han
3cd089ec02
Update __init__.py
2025-07-09 07:00:17 -07:00
Daniel Han
8cf37d23dc
Update __init__.py
2025-07-09 03:58:13 -07:00
Daniel Han
bf7bf02f3e
Update _utils.py
2025-07-07 04:56:04 -07:00
Daniel Han
45c73f7c36
Merge branch 'main' into nightly
2025-07-06 23:01:53 -07:00
Daniel Han
735466b102
versioning
2025-07-06 22:58:14 -07:00
