Daniel Han
|
172084f14f
|
Merge branch 'main' into nightly
|
2025-07-02 18:02:57 -07:00 |
|
DoubleMathew
|
bd32b2fd66
|
Update CSM for faster inference (no compile) (#2865)
|
2025-07-02 16:59:56 -07:00 |
|
Roland Tannous
|
59b30f335c
|
fix quantized model parameter count method (#2855)
* fix quantized model parameter count method
* function cleanup
* parameter space cleanup
|
2025-07-01 23:36:59 -07:00 |
|
Michael Han
|
f4a922fc6f
|
Update README.md
|
2025-07-01 09:28:59 -07:00 |
|
Daniel Han
|
ed969515ee
|
Merge branch 'main' into nightly
|
2025-07-01 07:01:42 -07:00 |
|
Daniel Han
|
9ad09f9ab2
|
Fix Gemma 3N (#2854)
* add llama model registration
* fix quant tag mapping
* add qwen2.5 models to registry
* add option to include original model in registry
* handle quant types per model size
* separate registration of base and instruct llama3.2
* add QwenQVQ to registry
* add gemma3 to registry
* add phi
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
|
2025-07-01 07:01:31 -07:00 |
|
Daniel Han
|
d11d7a2c16
|
Update vision.py
|
2025-07-01 06:59:30 -07:00 |
|
Daniel Han
|
0b1545d218
|
Update pyproject.toml
|
2025-07-01 06:57:58 -07:00 |
|
Daniel Han
|
93487dbf81
|
Update vision.py
|
2025-07-01 04:27:40 -07:00 |
|
Daniel Han
|
34464fa436
|
Update vision.py
|
2025-07-01 02:49:48 -07:00 |
|
Daniel Han
|
48986eb6c4
|
Merge branch 'main' into nightly
|
2025-07-01 02:47:20 -07:00 |
|
Daniel Han
|
00c947798d
|
Update vision.py
|
2025-07-01 02:47:17 -07:00 |
|
Daniel Han
|
c2ecdecd5c
|
Merge branch 'main' into nightly
|
2025-07-01 02:37:07 -07:00 |
|
Daniel Han
|
a98505a5ae
|
Update _utils.py
|
2025-07-01 02:36:54 -07:00 |
|
Daniel Han
|
19448b2517
|
Update pyproject.toml
|
2025-07-01 01:34:17 -07:00 |
|
Daniel Han
|
622f3fc85a
|
Move AMD to AMD branch
|
2025-07-01 01:10:40 -07:00 |
|
Daniel Han
|
f1e1b890ac
|
Move AMD to AMD branch
|
2025-07-01 01:02:51 -07:00 |
|
Daniel Han
|
9886a2a3a0
|
subprocess
|
2025-07-01 00:51:04 -07:00 |
|
Daniel Han
|
46bc57ce49
|
Update setup.py
|
2025-07-01 00:34:27 -07:00 |
|
Daniel Han
|
b4b75a9ea8
|
Update setup.py
|
2025-07-01 00:32:23 -07:00 |
|
Daniel Han
|
95d5d7dbcc
|
Update setup.py
|
2025-07-01 00:27:34 -07:00 |
|
Daniel Han
|
4f7185dc08
|
Update setup.py
|
2025-07-01 00:26:34 -07:00 |
|
Daniel Han
|
725c4616ef
|
Update setup.py
|
2025-07-01 00:19:25 -07:00 |
|
Daniel Han
|
71f7bb26df
|
Update setup.py
|
2025-07-01 00:18:22 -07:00 |
|
Daniel Han
|
ccd15f09bc
|
Update setup.py
|
2025-07-01 00:14:58 -07:00 |
|
Daniel Han
|
6093e18e26
|
Cmake and ninja move
|
2025-07-01 00:13:00 -07:00 |
|
Daniel Han
|
9d0f44cdf6
|
Fix setup.py
|
2025-07-01 00:05:56 -07:00 |
|
Daniel Han
|
507b5c41e4
|
Update _utils.py
|
2025-06-30 23:13:33 -07:00 |
|
Daniel Han
|
fba0bff2f4
|
Remove stale bot
|
2025-06-30 23:11:57 -07:00 |
|
Daniel Han
|
97a5f2c7e1
|
Update pyproject.toml
|
2025-06-30 21:01:55 -07:00 |
|
Daniel Han
|
c6155cc6d3
|
Update pyproject.toml
|
2025-06-30 21:01:32 -07:00 |
|
Daniel Han
|
6e612e3aa7
|
Update pyproject.toml
|
2025-06-30 21:00:49 -07:00 |
|
Daniel Han
|
3aec8de53b
|
Update pyproject.toml
|
2025-06-30 20:25:46 -07:00 |
|
Daniel Han
|
713b59a04a
|
Update pyproject.toml
|
2025-06-30 20:01:13 -07:00 |
|
Daniel Han
|
a409f2a430
|
Update pyproject.toml
|
2025-06-30 20:00:20 -07:00 |
|
Daniel Han
|
2b50604876
|
Update setup.py
|
2025-06-30 19:50:15 -07:00 |
|
Daniel Han
|
c7d765c425
|
Update setup.py
|
2025-06-30 19:48:00 -07:00 |
|
Daniel Han
|
e21ac3c3ba
|
Update setup.py
|
2025-06-30 19:47:22 -07:00 |
|
Daniel Han
|
719a626af0
|
Prints
|
2025-06-30 19:35:59 -07:00 |
|
Daniel Han
|
28a968d118
|
setup.py
|
2025-06-30 19:32:32 -07:00 |
|
Daniel Han
|
d7ac7f46c0
|
Fix setup.py
|
2025-06-30 19:25:49 -07:00 |
|
Daniel Han
|
021d1f78fc
|
Merge branch 'main' into nightly
|
2025-06-30 16:57:19 -07:00 |
|
billishyahao
|
25d73efe8a
|
[Feature] enable unsloth on amd gpu (#2520)
* [Feature] enable unsloth on amd gpu
* fix the comment
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
|
2025-06-30 16:52:05 -07:00 |
|
Rishabh
|
3ff04c3d09
|
Convert torch.bfloat16, torch.float16, etc. to vLLM valid dtypes (#2811)
* Convert torch.bfloat16, torch.float16, etc. to vLLM valid dtypes
* removed newlines and extra whitespace
|
2025-06-30 16:39:36 -07:00 |
|
DoubleMathew
|
35b09e2d2a
|
Fix loftq None config for FastBaseModel (#2848)
add new validate_loftq_config to __all__
|
2025-06-30 16:38:51 -07:00 |
|
Daniel Han
|
e1693c1caf
|
Gemma 3N bug fixes (#2842)
* Update vision.py
* Bug fix
* Update mapper.py
* check SDPA for Mistral 3, Pixtral
* Update vision.py
* Versioning
* Update rl_replacements.py
* Update README.md
* add model registry
* move hf hub utils to unsloth/utils
* refactor global model info dicts to dataclasses
* fix dataclass init
* fix llama registration
* remove deprecated key function
* start registry reog
* add llama vision
* quant types -> Enum
* remap literal quant types to QuantType Enum
* add llama model registration
* fix quant tag mapping
* add qwen2.5 models to registry
* add option to include original model in registry
* handle quant types per model size
* separate registration of base and instruct llama3.2
* add QwenQVQ to registry
* add gemma3 to registry
* add phi
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
---------
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
|
2025-06-30 07:15:48 -07:00 |
|
Daniel Han
|
21ec11eaa4
|
Update vision.py
|
2025-06-30 07:07:38 -07:00 |
|
Daniel Han
|
b8e661b39e
|
Update loader.py
|
2025-06-30 07:06:35 -07:00 |
|
Daniel Han
|
1444b1011a
|
Update vision.py
|
2025-06-30 07:03:36 -07:00 |
|
Daniel Han
|
ac09d15750
|
Update vision.py
|
2025-06-30 06:53:28 -07:00 |
|