Commit graph

2,529 commits

Author SHA1 Message Date
Daniel Han
845eaa5ccd Merge branch 'main' into nightly 2025-07-01 07:01:42 -07:00
Daniel Han
644eb5c66d
Fix Gemma 3N (#2854)
* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Debugging only

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Generic efficient GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* Remove debugging

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update llama.py

* Update rl_replacements.py

* versioning

* Update _utils.py

* Update vision.py

* Update mapper.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update _utils.py

* Update vision.py

* gradient checkpointing

* Gemma 3N fixes

* Update loader.py

* Versioning

* Gemma 3N fixes

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Fix setup.py

* setup.py

* Prints

* Update setup.py

* Update setup.py

* Update setup.py

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update pyproject.toml

* Update vision.py

---------

Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-07-01 07:01:31 -07:00
Daniel Han
fe17511916 Update vision.py 2025-07-01 06:59:30 -07:00
Daniel Han
f5a4c427db Update pyproject.toml 2025-07-01 06:57:58 -07:00
Daniel Han
bd82a2b754 Update vision.py 2025-07-01 04:27:40 -07:00
Daniel Han
a7adcad761 Update vision.py 2025-07-01 02:49:48 -07:00
Daniel Han
2674595d6c Merge branch 'main' into nightly 2025-07-01 02:47:20 -07:00
Daniel Han
d78bf49045 Update vision.py 2025-07-01 02:47:17 -07:00
Daniel Han
79e1431d26 Merge branch 'main' into nightly 2025-07-01 02:37:07 -07:00
Daniel Han
08ee15f83b Update _utils.py 2025-07-01 02:36:54 -07:00
Daniel Han
6f4bde25db Update pyproject.toml 2025-07-01 01:34:17 -07:00
Daniel Han
6f27839955 Move AMD to AMD branch 2025-07-01 01:10:40 -07:00
Daniel Han
eef2515749 Move AMD to AMD branch 2025-07-01 01:02:51 -07:00
Daniel Han
2ac58e30e8 subprocess 2025-07-01 00:51:04 -07:00
Daniel Han
e73487a4a6 Update setup.py 2025-07-01 00:34:27 -07:00
Daniel Han
a6b9a8fce3 Update setup.py 2025-07-01 00:32:23 -07:00
Daniel Han
ce8815f1c7 Update setup.py 2025-07-01 00:27:34 -07:00
Daniel Han
5958944ddd Update setup.py 2025-07-01 00:26:34 -07:00
Daniel Han
90c5b9a380 Update setup.py 2025-07-01 00:19:25 -07:00
Daniel Han
51b06266e2 Update setup.py 2025-07-01 00:18:22 -07:00
Daniel Han
7cc17da547 Update setup.py 2025-07-01 00:14:58 -07:00
Daniel Han
a5e37ac1a2 Cmake and ninja move 2025-07-01 00:13:00 -07:00
Daniel Han
3c1c8e5b95 Fix setup.py 2025-07-01 00:05:56 -07:00
Daniel Han
08f5c90428 Update _utils.py 2025-06-30 23:13:33 -07:00
Daniel Han
e29cbd8d83 Remove stale bot 2025-06-30 23:11:57 -07:00
Daniel Han
aafe905267 Update pyproject.toml 2025-06-30 21:01:55 -07:00
Daniel Han
7a4bd9d561 Update pyproject.toml 2025-06-30 21:01:32 -07:00
Daniel Han
fd85e22a4a Update pyproject.toml 2025-06-30 21:00:49 -07:00
Daniel Han
2b5ec93005 Update pyproject.toml 2025-06-30 20:25:46 -07:00
Daniel Han
ad34341766 Update pyproject.toml 2025-06-30 20:01:13 -07:00
Daniel Han
23bcba9604 Update pyproject.toml 2025-06-30 20:00:20 -07:00
Daniel Han
98037ea35e Update setup.py 2025-06-30 19:50:15 -07:00
Daniel Han
d2ac17065d Update setup.py 2025-06-30 19:48:00 -07:00
Daniel Han
786d8d2efc Update setup.py 2025-06-30 19:47:22 -07:00
Daniel Han
32238b6867 Prints 2025-06-30 19:35:59 -07:00
Daniel Han
b3712aacb7 setup.py 2025-06-30 19:32:32 -07:00
Daniel Han
bf1d9e3112 Fix setup.py 2025-06-30 19:25:49 -07:00
Daniel Han
392be9be2c Merge branch 'main' into nightly 2025-06-30 16:57:19 -07:00
billishyahao
06ca5c273b
[Feature] enable unsloth on amd gpu (#2520)
* [Feature] enable unsloth on amd gpu

* fix the comment

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-06-30 16:52:05 -07:00
Rishabh
a15e77fc63
Convert torch.bfloat16, torch.float16, etc. to vLLM valid dtypes (#2811)
* Convert torch.bfloat16, torch.float16, etc. to vLLM valid dtypes

* removed newlines and extra whitespace
2025-06-30 16:39:36 -07:00
DoubleMathew
8e6ec3bf04
Fix loftq None config for FastBaseModel (#2848)
add new validate_loftq_config to __all__
2025-06-30 16:38:51 -07:00
Daniel Han
9aa13e4e64
Gemma 3N bug fixes (#2842)
* Update vision.py

* Bug fix

* Update mapper.py

* check SDPA for Mistral 3, Pixtral

* Update vision.py

* Versioning

* Update rl_replacements.py

* Update README.md

* add model registry

* move hf hub utils to unsloth/utils

* refactor global model info dicts to dataclasses

* fix dataclass init

* fix llama registration

* remove deprecated key function

* start registry reog

* add llama vision

* quant types -> Enum

* remap literal quant types to QuantType Enum

* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Debugging only

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Generic efficient GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* Remove debugging

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update llama.py

* Update rl_replacements.py

* versioning

* Update _utils.py

* Update vision.py

* Update mapper.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update _utils.py

* Update vision.py

* gradient checkpointing

* Gemma 3N fixes

* Update loader.py

* Versioning

* Gemma 3N fixes

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

---------

Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-06-30 07:15:48 -07:00
Daniel Han
acfc5d36b3 Update vision.py 2025-06-30 07:07:38 -07:00
Daniel Han
0ac637d4dc Update loader.py 2025-06-30 07:06:35 -07:00
Daniel Han
57c1840f6f Update vision.py 2025-06-30 07:03:36 -07:00
Daniel Han
0f8590370c Update vision.py 2025-06-30 06:53:28 -07:00
Daniel Han
db2be2346a Gemma 3N fixes 2025-06-30 06:51:49 -07:00
Daniel Han
285c7fe015 Versioning 2025-06-30 06:08:14 -07:00
Daniel Han
845de0e585 Update loader.py 2025-06-30 06:04:19 -07:00
Roland Tannous
3d78d44e76
Added conda/mamba section to blackwell installation readme (#2817)
* Added conda/mamba section to blackwell installation readme

* fix conda creation suffix and vllm install syntax
2025-06-30 06:02:57 -07:00