ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
2,442 commits 391 branches 58 tags 304 MiB
Commit graph

2,442 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
4663ba3be0 Update _utils.py 2025-06-26 03:39:13 -07:00
Daniel Han
388f0203df Merge branch 'main' into nightly 2025-06-26 03:16:08 -07:00
Daniel Han
6a83bb53a5 Bug fixes (#2805) 
* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update vision.py

* HF Transfer

* fix(utils): add missing importlib import to fix NameError (#2134)

This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.

* Add QLoRA Train and Merge16bit Test (#2130)

* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Revert

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Bug fix

* Update mapper.py

* check SDPA for Mistral 3, Pixtral

* Update vision.py

* Versioning

* Update rl_replacements.py

* Update README.md

* add model registry

* move hf hub utils to unsloth/utils

* refactor global model info dicts to dataclasses

* fix dataclass init

* fix llama registration

* remove deprecated key function

* start registry reog

* add llama vision

* quant types -> Enum

* remap literal quant types to QuantType Enum

* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Debugging only

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Generic efficient GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* Remove debugging

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update llama.py

* Update rl_replacements.py

* versioning

---------

Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
 2025-06-26 02:17:12 -07:00
Daniel Han
83c0e52e90 versioning 2025-06-26 02:13:49 -07:00
Daniel Han
c6e8c516a5 Update rl_replacements.py 2025-06-26 01:57:56 -07:00
Daniel Han
0922ec5544 Update llama.py 2025-06-26 01:56:55 -07:00
Daniel Han
5f28dbe8e4 Merge branch 'main' into nightly 2025-06-26 01:51:20 -07:00
Datta Nimmaturi
e402be69b7 Fix grpo sleep regex and indentation (#2804) 2025-06-26 01:50:47 -07:00
Lei Zhenyuan
48d51bac5f fix for inductor no attribute prop.multi_processor_count (#2803) 2025-06-26 01:44:15 -07:00
Daniel Han
29e4870a45 Update vision.py 2025-06-26 01:27:16 -07:00
Daniel Han
2e9b504b28 Update rl_replacements.py 2025-06-26 01:12:21 -07:00
Daniel Han
5e99e7467f Update rl_replacements.py 2025-06-26 00:56:05 -07:00
Daniel Han
f41bfbc092 Remove debugging 2025-06-26 00:41:37 -07:00
Daniel Han
e1ca077164 Update rl_replacements.py 2025-06-26 00:35:20 -07:00
Daniel Han
c2a901493f Update rl_replacements.py 2025-06-26 00:27:17 -07:00
Daniel Han
33f20f0289 Generic efficient GRPO 2025-06-26 00:10:07 -07:00
DoubleMathew
c928612ee0 [4/N] Enable intel GPU for unsloth (#2801) 
* add code for xpu llama

* refine code

* change version check to 2.6.0

* remove unuse blank

* reslove commits

* Cleaned up statistics printing

* Update unsloth/models/_utils.py

---------

Co-authored-by: lei,zhenyuan <zhenyuan.lei@intel.com>
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-06-25 20:28:07 -07:00
Daniel Han
b526f8b091 Update rl_replacements.py 2025-06-25 20:13:17 -07:00
Daniel Han
2a67486109 Update rl_replacements.py 2025-06-25 19:51:43 -07:00
Daniel Han
5dea7d9076 Update rl_replacements.py 2025-06-25 18:53:19 -07:00
Daniel Han
ba9e9dcef8 Update rl_replacements.py 2025-06-25 18:51:54 -07:00
Daniel Han
2414e577da Update rl_replacements.py 2025-06-25 18:50:45 -07:00
Daniel Han
cda0aacb5c Merge branch 'main' into nightly 2025-06-25 16:50:18 -07:00
Daniel Han
7dc1ce9eb3 Update llama.py 2025-06-25 02:09:56 -07:00
Daniel Han
cd1aff0222 Update llama.py 2025-06-25 01:57:15 -07:00
Daniel Han
537d4b217c Debugging only 2025-06-25 01:44:07 -07:00
Michael Han
b017f2395a Update README.md 
Updating links
 2025-06-25 01:32:24 -07:00
Daniel Han
404052510b Merge branch 'main' into nightly 2025-06-24 02:03:47 -07:00
Lei Zhenyuan
dcf26ac3fb [3/N] Enable intel GPU for unsloth (#2620) 
* enable intel xpu changes within kernels

* reslove torch.version < 2.6

* change version check to 2.6.0

* resolve comments for torch_gpu_device

* resolve amp fwd comments

* fix typo

* change cuda default logic

* clean this pr

* add HAS_CUDA_STREAM as default False

* split GPU streams to cuda and xpu streams

* add optional
 2025-06-24 02:01:28 -07:00
Daniel Han
9476eccb31 Merge branch 'main' of https://github.com/unslothai/unsloth into nightly 2025-06-24 01:36:03 -07:00
Daniel Han
48ccca95e8 Merge branch 'main' into nightly 2025-06-24 01:36:02 -07:00
DoubleMathew
0a14b795d0 move min_sms in is_big_gpu inside DEVICE_TYPE if else (#2792) 
log is not defined in torch inductor so remove

Remove log.warning entirely
 2025-06-23 18:57:55 -07:00
pluesclues
22c4d45d48 Fixed Sequence Classification errors, loaded model weirdly (#2793) 2025-06-23 18:56:56 -07:00
Michael Han
853a72592b Update issue templates 2025-06-23 05:34:46 -07:00
Daniel Han
97c10f9494 Update issue templates 2025-06-23 05:26:28 -07:00
Lei Zhenyuan
1ae3425b07 [5/N] Enable intel GPU for unsloth (#2768) 
* add is_big_gpu support for xpu

* make code unsloth's style
 2025-06-23 04:47:34 -07:00
kilavvy
1d5af06e00 Docs: Fix typo and improve MoE docstrings (#2784) 
* Update qwen3_moe.py

* Update interface.py
 2025-06-23 01:09:23 -07:00
Daniel Han
d7b0653a2a Fix GRPO (#2787) 
* Update _utils.py

* Update _utils.py

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update vision.py

* HF Transfer

* fix(utils): add missing importlib import to fix NameError (#2134)

This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.

* Add QLoRA Train and Merge16bit Test (#2130)

* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Revert

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Bug fix

* Update mapper.py

* check SDPA for Mistral 3, Pixtral

* Update vision.py

* Versioning

* Update rl_replacements.py

* Update README.md

* add model registry

* move hf hub utils to unsloth/utils

* refactor global model info dicts to dataclasses

* fix dataclass init

* fix llama registration

* remove deprecated key function

* start registry reog

* add llama vision

* quant types -> Enum

* remap literal quant types to QuantType Enum

* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

---------

Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
 2025-06-22 05:54:29 -07:00
Daniel Han
1e8201f465 Update rl_replacements.py 2025-06-22 05:51:07 -07:00
Daniel Han
6f8711e2e6 Update rl_replacements.py 2025-06-22 05:34:52 -07:00
Daniel Han
ae992555e4 Update pyproject.toml 2025-06-22 05:33:57 -07:00
Daniel Han
c8e5a88001 Update rl_replacements.py 2025-06-22 05:32:38 -07:00
Daniel Han
d9601bd14a logits / temperature 2025-06-22 04:54:18 -07:00
Daniel Han
d36abd3b71 Update rl_replacements.py 2025-06-22 03:44:56 -07:00
Daniel Han
7837f6f40c Update rl_replacements.py 2025-06-22 03:39:30 -07:00
Daniel Han
9b612677f9 Update rl.py 2025-06-22 03:29:20 -07:00
Daniel Han
c465cf2fd2 Update rl_replacements.py 2025-06-22 02:55:00 -07:00
Daniel Han
0815525b15 Update rl_replacements.py 2025-06-22 02:37:52 -07:00
Daniel Han
0012c8906c Merge branch 'main' into nightly 2025-06-22 02:37:11 -07:00
Daniel Han
c7c6f2c88d Update rl.py 2025-06-21 23:29:08 -07:00