Commit graph

2,563 commits

Author SHA1 Message Date
Daniel Han
13a32054b7 Merge branch 'main' into nightly 2025-07-10 01:50:14 -07:00
Daniel Han
62c5c315dd Merge branch 'main' of https://github.com/unslothai/unsloth 2025-07-10 01:50:04 -07:00
Daniel Han
87e1a933d8 Update llama.py 2025-07-10 01:50:03 -07:00
DoubleMathew
643f9b068b if mlp doesn't exist in layer module check for feed_forward name for falcon h1 (#2913) 2025-07-09 23:29:41 -07:00
Daniel Han
20f665a98a Update __init__.py 2025-07-09 16:30:57 -07:00
Datta Nimmaturi
ced87c6059 Explicitly check if xformers exists for attention (#2889) 2025-07-09 14:15:35 -07:00
Lei Zhenyuan
6a36b6e1fc [bugs] fix for casual mask (#2868)
* fix for casual mask

* use un_casual in sdpa

* add missing mask

* fix for type
2025-07-09 14:10:25 -07:00
Lei Zhenyuan
74b9feb674 add intel gpu with vllm support (#2903) 2025-07-09 14:08:38 -07:00
Datta Nimmaturi
772f15ca49 Dynamically adjust get_per_token_logps function and patch as well (#2911) 2025-07-09 14:07:33 -07:00
DoubleMathew
c4901fd894 silienty skip falcon h1 import is transformers_version < 4.53.0 (#2912) 2025-07-09 14:05:41 -07:00
Daniel Han
1fb1b72ae1 Merge branch 'main' into nightly 2025-07-09 14:03:38 -07:00
Daniel Han
7dde992481 Many bug fixes (#2908)
* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Debugging only

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Generic efficient GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* Remove debugging

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update llama.py

* Update rl_replacements.py

* versioning

* Update _utils.py

* Update vision.py

* Update mapper.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update _utils.py

* Update vision.py

* gradient checkpointing

* Gemma 3N fixes

* Update loader.py

* Versioning

* Gemma 3N fixes

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Fix setup.py

* setup.py

* Prints

* Update setup.py

* Update setup.py

* Update setup.py

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update pyproject.toml

* Update vision.py

* Update _utils.py

* Update __init__.py

* Update __init__.py

---------

Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-07-09 07:14:18 -07:00
Daniel Han
3cd089ec02 Update __init__.py 2025-07-09 07:00:17 -07:00
Daniel Han
8cf37d23dc Update __init__.py 2025-07-09 03:58:13 -07:00
Daniel Han
bf7bf02f3e Update _utils.py 2025-07-07 04:56:04 -07:00
Daniel Han
45c73f7c36 Merge branch 'main' into nightly 2025-07-06 23:01:53 -07:00
Daniel Han
735466b102 versioning 2025-07-06 22:58:14 -07:00
Daniel Han
924283602a Merge branch 'main' into nightly 2025-07-06 22:44:43 -07:00
Daniel Han
538558df53 MoE kernels AGPLv3 2025-07-06 22:44:35 -07:00
Daniel Han
6c98d33275 Merge branch 'main' into nightly 2025-07-06 22:40:31 -07:00
Daniel Han
f0a9442a06 Update README.md (#2885) 2025-07-05 02:07:20 -07:00
Michael Han
78e17304a0 Update README.md
Updating icon sizes
2025-07-04 15:50:31 -07:00
Michael Han
9ecc97a67c Update README.md
Editing icon sizes
2025-07-04 15:37:44 -07:00
DoubleMathew
e858f08047 only warn about prepare causal attention mask when transformers<=4.52.4 (#2867) 2025-07-04 01:54:27 -07:00
Daniel Han
68c279eaef Merge branch 'main' into nightly 2025-07-03 15:55:30 -07:00
Michael Han
eb97606c53 Merge pull request #2873 from Erland366/fix/unslothtrainingarguments
Fix `UnslothTrainingArguments` not patching `trl.Config` properly
2025-07-03 14:00:12 -07:00
Erland366
7a306bfbdc Initialize parent class in UnslothTrainingArguments constructor 2025-07-03 15:47:58 +00:00
Erland366
d2d3875596 Refactor UnslothTrainingArguments to initialize embedding_learning_rate in constructor 2025-07-03 15:47:10 +00:00
Erland366
fe5358bacc Refactor UnslothTrainingArguments to support fallback for TrainingArguments import 2025-07-03 15:39:56 +00:00
Erland366
80206ec1eb Always use SFTConfig 2025-07-03 14:08:04 +00:00
Daniel Han
172084f14f Merge branch 'main' into nightly 2025-07-02 18:02:57 -07:00
DoubleMathew
bd32b2fd66 Update CSM for faster inference (no compile) (#2865) 2025-07-02 16:59:56 -07:00
Roland Tannous
59b30f335c fix quantized model parameter count method (#2855)
* fix quantized model parameter count method

* function cleanup

* parameter space cleanup
2025-07-01 23:36:59 -07:00
Michael Han
f4a922fc6f Update README.md 2025-07-01 09:28:59 -07:00
Daniel Han
ed969515ee Merge branch 'main' into nightly 2025-07-01 07:01:42 -07:00
Daniel Han
9ad09f9ab2 Fix Gemma 3N (#2854)
* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Debugging only

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Generic efficient GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* Remove debugging

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update llama.py

* Update rl_replacements.py

* versioning

* Update _utils.py

* Update vision.py

* Update mapper.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update _utils.py

* Update vision.py

* gradient checkpointing

* Gemma 3N fixes

* Update loader.py

* Versioning

* Gemma 3N fixes

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Fix setup.py

* setup.py

* Prints

* Update setup.py

* Update setup.py

* Update setup.py

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update pyproject.toml

* Update vision.py

---------

Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-07-01 07:01:31 -07:00
Daniel Han
d11d7a2c16 Update vision.py 2025-07-01 06:59:30 -07:00
Daniel Han
0b1545d218 Update pyproject.toml 2025-07-01 06:57:58 -07:00
Daniel Han
93487dbf81 Update vision.py 2025-07-01 04:27:40 -07:00
Daniel Han
34464fa436 Update vision.py 2025-07-01 02:49:48 -07:00
Daniel Han
48986eb6c4 Merge branch 'main' into nightly 2025-07-01 02:47:20 -07:00
Daniel Han
00c947798d Update vision.py 2025-07-01 02:47:17 -07:00
Daniel Han
c2ecdecd5c Merge branch 'main' into nightly 2025-07-01 02:37:07 -07:00
Daniel Han
a98505a5ae Update _utils.py 2025-07-01 02:36:54 -07:00
Daniel Han
19448b2517 Update pyproject.toml 2025-07-01 01:34:17 -07:00
Daniel Han
622f3fc85a Move AMD to AMD branch 2025-07-01 01:10:40 -07:00
Daniel Han
f1e1b890ac Move AMD to AMD branch 2025-07-01 01:02:51 -07:00
Daniel Han
9886a2a3a0 subprocess 2025-07-01 00:51:04 -07:00
Daniel Han
46bc57ce49 Update setup.py 2025-07-01 00:34:27 -07:00
Daniel Han
b4b75a9ea8 Update setup.py 2025-07-01 00:32:23 -07:00