Daniel Han
01f649f6fc
Update rl.py
2025-07-11 03:13:55 -07:00
Daniel Han
7c8cd3dd6d
Update rl.py
2025-07-11 03:11:07 -07:00
Daniel Han
7d2106e5c6
Merge branch 'main' into nightly
2025-07-11 03:04:28 -07:00
Daniel Han
f155097cd8
Uninitialized handler
2025-07-11 03:04:17 -07:00
Daniel Han
681b10dc0c
Fixes
2025-07-11 00:01:37 -07:00
Daniel Han
2dae012308
Update llama.py
2025-07-10 17:18:40 -07:00
Daniel Han
17f7447a39
Merge branch 'main' into nightly
2025-07-10 17:12:59 -07:00
Daniel Han
9071adb723
Fix GRPO
2025-07-10 17:12:49 -07:00
Michael Han
6503961a33
Merge pull request #2929 from rolandtannous/fix/fix-grpo-get-per-token-logps-argument-mismatch
...
Fix argument mismatch in GRPO _get_per_token_logps lambda function
2025-07-10 14:30:05 -07:00
Roland Tannous
8d6da15c2e
Fix argument mismatch in GRPO _get_per_token_logps lambda function
2025-07-10 18:24:53 +00:00
Daniel Han
07df9c1233
Merge branch 'main' into nightly
2025-07-10 07:03:59 -07:00
Daniel Han
5a2dcc924b
Many bug fixes ( #2927 )
...
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Small fixes
* Update vision.py
* Update vision.py
* versioning
* Update __init__.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-07-10 07:03:48 -07:00
Daniel Han
c73406d8ba
Update __init__.py
2025-07-10 07:03:28 -07:00
Daniel Han
ee93391155
versioning
2025-07-10 07:01:44 -07:00
Daniel Han
509cf61834
Update vision.py
2025-07-10 05:15:03 -07:00
Daniel Han
d3bd189e47
Update vision.py
2025-07-10 04:34:23 -07:00
Daniel Han
ace8de011d
Small fixes
2025-07-10 04:04:51 -07:00
Daniel Han
d4a302ff3d
Merge branch 'main' into nightly
2025-07-10 04:02:01 -07:00
Datta Nimmaturi
c77f6c3719
Move inputs to right devices. ( #2919 )
...
* Move tensors to right devices
* fix multi gpu for non mistral models
* multi GPU RoPE for gemma2
* Finish up multi GPU inference
* Make multiGPU rope a list
* Remove unnecessary transfer to CPU
* Remove unnecessary move to CPU
* Donot move inputs to device yet
will be handled separately in another PR
* Move inputs to appropriate decoder device
* Make device count global variable
* Cleanup RoPE device code
* Fixup num_gpu to device count
* Cleanup device counts
* Use device index for RoPE get_cache
* Donot typecast
* Use tuple instead of list for tensors. Use device index directly
* fixup move to device logic
2025-07-10 04:01:03 -07:00
Daniel Han
13a32054b7
Merge branch 'main' into nightly
2025-07-10 01:50:14 -07:00
Daniel Han
62c5c315dd
Merge branch 'main' of https://github.com/unslothai/unsloth
2025-07-10 01:50:04 -07:00
Daniel Han
87e1a933d8
Update llama.py
2025-07-10 01:50:03 -07:00
DoubleMathew
643f9b068b
if mlp doesn't exist in layer module check for feed_forward name for falcon h1 ( #2913 )
2025-07-09 23:29:41 -07:00
Daniel Han
20f665a98a
Update __init__.py
2025-07-09 16:30:57 -07:00
Datta Nimmaturi
ced87c6059
Explicitly check if xformers exists for attention ( #2889 )
2025-07-09 14:15:35 -07:00
Lei Zhenyuan
6a36b6e1fc
[bugs] fix for casual mask ( #2868 )
...
* fix for casual mask
* use un_casual in sdpa
* add missing mask
* fix for type
2025-07-09 14:10:25 -07:00
Lei Zhenyuan
74b9feb674
add intel gpu with vllm support ( #2903 )
2025-07-09 14:08:38 -07:00
Datta Nimmaturi
772f15ca49
Dynamically adjust get_per_token_logps function and patch as well ( #2911 )
2025-07-09 14:07:33 -07:00
DoubleMathew
c4901fd894
silienty skip falcon h1 import is transformers_version < 4.53.0 ( #2912 )
2025-07-09 14:05:41 -07:00
Daniel Han
1fb1b72ae1
Merge branch 'main' into nightly
2025-07-09 14:03:38 -07:00
Daniel Han
7dde992481
Many bug fixes ( #2908 )
...
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-07-09 07:14:18 -07:00
Daniel Han
3cd089ec02
Update __init__.py
2025-07-09 07:00:17 -07:00
Daniel Han
8cf37d23dc
Update __init__.py
2025-07-09 03:58:13 -07:00
Daniel Han
bf7bf02f3e
Update _utils.py
2025-07-07 04:56:04 -07:00
Daniel Han
45c73f7c36
Merge branch 'main' into nightly
2025-07-06 23:01:53 -07:00
Daniel Han
735466b102
versioning
2025-07-06 22:58:14 -07:00
Daniel Han
924283602a
Merge branch 'main' into nightly
2025-07-06 22:44:43 -07:00
Daniel Han
538558df53
MoE kernels AGPLv3
2025-07-06 22:44:35 -07:00
Daniel Han
6c98d33275
Merge branch 'main' into nightly
2025-07-06 22:40:31 -07:00
Daniel Han
f0a9442a06
Update README.md ( #2885 )
2025-07-05 02:07:20 -07:00
Michael Han
78e17304a0
Update README.md
...
Updating icon sizes
2025-07-04 15:50:31 -07:00
Michael Han
9ecc97a67c
Update README.md
...
Editing icon sizes
2025-07-04 15:37:44 -07:00
DoubleMathew
e858f08047
only warn about prepare causal attention mask when transformers<=4.52.4 ( #2867 )
2025-07-04 01:54:27 -07:00
Daniel Han
68c279eaef
Merge branch 'main' into nightly
2025-07-03 15:55:30 -07:00
Michael Han
eb97606c53
Merge pull request #2873 from Erland366/fix/unslothtrainingarguments
...
Fix `UnslothTrainingArguments` not patching `trl.Config` properly
2025-07-03 14:00:12 -07:00
Erland366
7a306bfbdc
Initialize parent class in UnslothTrainingArguments constructor
2025-07-03 15:47:58 +00:00
Erland366
d2d3875596
Refactor UnslothTrainingArguments to initialize embedding_learning_rate in constructor
2025-07-03 15:47:10 +00:00
Erland366
fe5358bacc
Refactor UnslothTrainingArguments to support fallback for TrainingArguments import
2025-07-03 15:39:56 +00:00
Erland366
80206ec1eb
Always use SFTConfig
2025-07-03 14:08:04 +00:00
Daniel Han
172084f14f
Merge branch 'main' into nightly
2025-07-02 18:02:57 -07:00
