Daniel Han
|
62c5c315dd
|
Merge branch 'main' of https://github.com/unslothai/unsloth
|
2025-07-10 01:50:04 -07:00 |
|
Daniel Han
|
87e1a933d8
|
Update llama.py
|
2025-07-10 01:50:03 -07:00 |
|
DoubleMathew
|
643f9b068b
|
if mlp doesn't exist in layer module check for feed_forward name for falcon h1 (#2913)
|
2025-07-09 23:29:41 -07:00 |
|
Daniel Han
|
20f665a98a
|
Update __init__.py
|
2025-07-09 16:30:57 -07:00 |
|
Datta Nimmaturi
|
ced87c6059
|
Explicitly check if xformers exists for attention (#2889)
|
2025-07-09 14:15:35 -07:00 |
|
Lei Zhenyuan
|
6a36b6e1fc
|
[bugs] fix for casual mask (#2868)
* fix for casual mask
* use un_casual in sdpa
* add missing mask
* fix for type
|
2025-07-09 14:10:25 -07:00 |
|
Lei Zhenyuan
|
74b9feb674
|
add intel gpu with vllm support (#2903)
|
2025-07-09 14:08:38 -07:00 |
|
Datta Nimmaturi
|
772f15ca49
|
Dynamically adjust get_per_token_logps function and patch as well (#2911)
|
2025-07-09 14:07:33 -07:00 |
|
DoubleMathew
|
c4901fd894
|
silienty skip falcon h1 import is transformers_version < 4.53.0 (#2912)
|
2025-07-09 14:05:41 -07:00 |
|
Daniel Han
|
7dde992481
|
Many bug fixes (#2908)
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
|
2025-07-09 07:14:18 -07:00 |
|
Daniel Han
|
735466b102
|
versioning
|
2025-07-06 22:58:14 -07:00 |
|
Daniel Han
|
538558df53
|
MoE kernels AGPLv3
|
2025-07-06 22:44:35 -07:00 |
|
Daniel Han
|
f0a9442a06
|
Update README.md (#2885)
|
2025-07-05 02:07:20 -07:00 |
|
Michael Han
|
78e17304a0
|
Update README.md
Updating icon sizes
|
2025-07-04 15:50:31 -07:00 |
|
Michael Han
|
9ecc97a67c
|
Update README.md
Editing icon sizes
|
2025-07-04 15:37:44 -07:00 |
|
DoubleMathew
|
e858f08047
|
only warn about prepare causal attention mask when transformers<=4.52.4 (#2867)
|
2025-07-04 01:54:27 -07:00 |
|
Michael Han
|
eb97606c53
|
Merge pull request #2873 from Erland366/fix/unslothtrainingarguments
Fix `UnslothTrainingArguments` not patching `trl.Config` properly
|
2025-07-03 14:00:12 -07:00 |
|
Erland366
|
7a306bfbdc
|
Initialize parent class in UnslothTrainingArguments constructor
|
2025-07-03 15:47:58 +00:00 |
|
Erland366
|
d2d3875596
|
Refactor UnslothTrainingArguments to initialize embedding_learning_rate in constructor
|
2025-07-03 15:47:10 +00:00 |
|
Erland366
|
fe5358bacc
|
Refactor UnslothTrainingArguments to support fallback for TrainingArguments import
|
2025-07-03 15:39:56 +00:00 |
|
Erland366
|
80206ec1eb
|
Always use SFTConfig
|
2025-07-03 14:08:04 +00:00 |
|
DoubleMathew
|
bd32b2fd66
|
Update CSM for faster inference (no compile) (#2865)
|
2025-07-02 16:59:56 -07:00 |
|
Roland Tannous
|
59b30f335c
|
fix quantized model parameter count method (#2855)
* fix quantized model parameter count method
* function cleanup
* parameter space cleanup
|
2025-07-01 23:36:59 -07:00 |
|
Michael Han
|
f4a922fc6f
|
Update README.md
|
2025-07-01 09:28:59 -07:00 |
|
Daniel Han
|
9ad09f9ab2
|
Fix Gemma 3N (#2854)
* add llama model registration
* fix quant tag mapping
* add qwen2.5 models to registry
* add option to include original model in registry
* handle quant types per model size
* separate registration of base and instruct llama3.2
* add QwenQVQ to registry
* add gemma3 to registry
* add phi
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
|
2025-07-01 07:01:31 -07:00 |
|
Daniel Han
|
00c947798d
|
Update vision.py
|
2025-07-01 02:47:17 -07:00 |
|
Daniel Han
|
a98505a5ae
|
Update _utils.py
|
2025-07-01 02:36:54 -07:00 |
|
Daniel Han
|
19448b2517
|
Update pyproject.toml
|
2025-07-01 01:34:17 -07:00 |
|
Daniel Han
|
622f3fc85a
|
Move AMD to AMD branch
|
2025-07-01 01:10:40 -07:00 |
|
Daniel Han
|
f1e1b890ac
|
Move AMD to AMD branch
|
2025-07-01 01:02:51 -07:00 |
|
Daniel Han
|
9886a2a3a0
|
subprocess
|
2025-07-01 00:51:04 -07:00 |
|
Daniel Han
|
46bc57ce49
|
Update setup.py
|
2025-07-01 00:34:27 -07:00 |
|
Daniel Han
|
b4b75a9ea8
|
Update setup.py
|
2025-07-01 00:32:23 -07:00 |
|
Daniel Han
|
95d5d7dbcc
|
Update setup.py
|
2025-07-01 00:27:34 -07:00 |
|
Daniel Han
|
4f7185dc08
|
Update setup.py
|
2025-07-01 00:26:34 -07:00 |
|
Daniel Han
|
725c4616ef
|
Update setup.py
|
2025-07-01 00:19:25 -07:00 |
|
Daniel Han
|
71f7bb26df
|
Update setup.py
|
2025-07-01 00:18:22 -07:00 |
|
Daniel Han
|
ccd15f09bc
|
Update setup.py
|
2025-07-01 00:14:58 -07:00 |
|
Daniel Han
|
6093e18e26
|
Cmake and ninja move
|
2025-07-01 00:13:00 -07:00 |
|
Daniel Han
|
9d0f44cdf6
|
Fix setup.py
|
2025-07-01 00:05:56 -07:00 |
|
Daniel Han
|
507b5c41e4
|
Update _utils.py
|
2025-06-30 23:13:33 -07:00 |
|
Daniel Han
|
fba0bff2f4
|
Remove stale bot
|
2025-06-30 23:11:57 -07:00 |
|
billishyahao
|
25d73efe8a
|
[Feature] enable unsloth on amd gpu (#2520)
* [Feature] enable unsloth on amd gpu
* fix the comment
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
|
2025-06-30 16:52:05 -07:00 |
|
Rishabh
|
3ff04c3d09
|
Convert torch.bfloat16, torch.float16, etc. to vLLM valid dtypes (#2811)
* Convert torch.bfloat16, torch.float16, etc. to vLLM valid dtypes
* removed newlines and extra whitespace
|
2025-06-30 16:39:36 -07:00 |
|
DoubleMathew
|
35b09e2d2a
|
Fix loftq None config for FastBaseModel (#2848)
add new validate_loftq_config to __all__
|
2025-06-30 16:38:51 -07:00 |
|
Daniel Han
|
e1693c1caf
|
Gemma 3N bug fixes (#2842)
* Update vision.py
* Bug fix
* Update mapper.py
* check SDPA for Mistral 3, Pixtral
* Update vision.py
* Versioning
* Update rl_replacements.py
* Update README.md
* add model registry
* move hf hub utils to unsloth/utils
* refactor global model info dicts to dataclasses
* fix dataclass init
* fix llama registration
* remove deprecated key function
* start registry reog
* add llama vision
* quant types -> Enum
* remap literal quant types to QuantType Enum
* add llama model registration
* fix quant tag mapping
* add qwen2.5 models to registry
* add option to include original model in registry
* handle quant types per model size
* separate registration of base and instruct llama3.2
* add QwenQVQ to registry
* add gemma3 to registry
* add phi
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
---------
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
|
2025-06-30 07:15:48 -07:00 |
|
Roland Tannous
|
ed93ec6049
|
Added conda/mamba section to blackwell installation readme (#2817)
* Added conda/mamba section to blackwell installation readme
* fix conda creation suffix and vllm install syntax
|
2025-06-30 06:02:57 -07:00 |
|
Daniel Han
|
b0088817cd
|
Update stale.yml
|
2025-06-30 02:16:09 -07:00 |
|
Daniel Han
|
95d2bdbec3
|
Create stale.yml (#2836)
|
2025-06-29 21:59:43 -07:00 |
|
Daniel Han
|
550f19fc0d
|
Delete stale.yml
|
2025-06-29 21:58:55 -07:00 |
|