Daniel Han
|
13a32054b7
|
Merge branch 'main' into nightly
|
2025-07-10 01:50:14 -07:00 |
|
Daniel Han
|
62c5c315dd
|
Merge branch 'main' of https://github.com/unslothai/unsloth
|
2025-07-10 01:50:04 -07:00 |
|
Daniel Han
|
87e1a933d8
|
Update llama.py
|
2025-07-10 01:50:03 -07:00 |
|
DoubleMathew
|
643f9b068b
|
if mlp doesn't exist in layer module check for feed_forward name for falcon h1 (#2913)
|
2025-07-09 23:29:41 -07:00 |
|
Daniel Han
|
20f665a98a
|
Update __init__.py
|
2025-07-09 16:30:57 -07:00 |
|
Datta Nimmaturi
|
ced87c6059
|
Explicitly check if xformers exists for attention (#2889)
|
2025-07-09 14:15:35 -07:00 |
|
Lei Zhenyuan
|
6a36b6e1fc
|
[bugs] fix for casual mask (#2868)
* fix for casual mask
* use un_casual in sdpa
* add missing mask
* fix for type
|
2025-07-09 14:10:25 -07:00 |
|
Lei Zhenyuan
|
74b9feb674
|
add intel gpu with vllm support (#2903)
|
2025-07-09 14:08:38 -07:00 |
|
Datta Nimmaturi
|
772f15ca49
|
Dynamically adjust get_per_token_logps function and patch as well (#2911)
|
2025-07-09 14:07:33 -07:00 |
|
DoubleMathew
|
c4901fd894
|
silienty skip falcon h1 import is transformers_version < 4.53.0 (#2912)
|
2025-07-09 14:05:41 -07:00 |
|
Daniel Han
|
1fb1b72ae1
|
Merge branch 'main' into nightly
|
2025-07-09 14:03:38 -07:00 |
|
Daniel Han
|
7dde992481
|
Many bug fixes (#2908)
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
|
2025-07-09 07:14:18 -07:00 |
|
Daniel Han
|
3cd089ec02
|
Update __init__.py
|
2025-07-09 07:00:17 -07:00 |
|
Daniel Han
|
8cf37d23dc
|
Update __init__.py
|
2025-07-09 03:58:13 -07:00 |
|
Daniel Han
|
bf7bf02f3e
|
Update _utils.py
|
2025-07-07 04:56:04 -07:00 |
|
Daniel Han
|
45c73f7c36
|
Merge branch 'main' into nightly
|
2025-07-06 23:01:53 -07:00 |
|
Daniel Han
|
735466b102
|
versioning
|
2025-07-06 22:58:14 -07:00 |
|
Daniel Han
|
924283602a
|
Merge branch 'main' into nightly
|
2025-07-06 22:44:43 -07:00 |
|
Daniel Han
|
538558df53
|
MoE kernels AGPLv3
|
2025-07-06 22:44:35 -07:00 |
|
Daniel Han
|
6c98d33275
|
Merge branch 'main' into nightly
|
2025-07-06 22:40:31 -07:00 |
|
Daniel Han
|
f0a9442a06
|
Update README.md (#2885)
|
2025-07-05 02:07:20 -07:00 |
|
Michael Han
|
78e17304a0
|
Update README.md
Updating icon sizes
|
2025-07-04 15:50:31 -07:00 |
|
Michael Han
|
9ecc97a67c
|
Update README.md
Editing icon sizes
|
2025-07-04 15:37:44 -07:00 |
|
DoubleMathew
|
e858f08047
|
only warn about prepare causal attention mask when transformers<=4.52.4 (#2867)
|
2025-07-04 01:54:27 -07:00 |
|
Daniel Han
|
68c279eaef
|
Merge branch 'main' into nightly
|
2025-07-03 15:55:30 -07:00 |
|
Michael Han
|
eb97606c53
|
Merge pull request #2873 from Erland366/fix/unslothtrainingarguments
Fix `UnslothTrainingArguments` not patching `trl.Config` properly
|
2025-07-03 14:00:12 -07:00 |
|
Erland366
|
7a306bfbdc
|
Initialize parent class in UnslothTrainingArguments constructor
|
2025-07-03 15:47:58 +00:00 |
|
Erland366
|
d2d3875596
|
Refactor UnslothTrainingArguments to initialize embedding_learning_rate in constructor
|
2025-07-03 15:47:10 +00:00 |
|
Erland366
|
fe5358bacc
|
Refactor UnslothTrainingArguments to support fallback for TrainingArguments import
|
2025-07-03 15:39:56 +00:00 |
|
Erland366
|
80206ec1eb
|
Always use SFTConfig
|
2025-07-03 14:08:04 +00:00 |
|
Daniel Han
|
172084f14f
|
Merge branch 'main' into nightly
|
2025-07-02 18:02:57 -07:00 |
|
DoubleMathew
|
bd32b2fd66
|
Update CSM for faster inference (no compile) (#2865)
|
2025-07-02 16:59:56 -07:00 |
|
Roland Tannous
|
59b30f335c
|
fix quantized model parameter count method (#2855)
* fix quantized model parameter count method
* function cleanup
* parameter space cleanup
|
2025-07-01 23:36:59 -07:00 |
|
Michael Han
|
f4a922fc6f
|
Update README.md
|
2025-07-01 09:28:59 -07:00 |
|
Daniel Han
|
ed969515ee
|
Merge branch 'main' into nightly
|
2025-07-01 07:01:42 -07:00 |
|
Daniel Han
|
9ad09f9ab2
|
Fix Gemma 3N (#2854)
* add llama model registration
* fix quant tag mapping
* add qwen2.5 models to registry
* add option to include original model in registry
* handle quant types per model size
* separate registration of base and instruct llama3.2
* add QwenQVQ to registry
* add gemma3 to registry
* add phi
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
---------
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
|
2025-07-01 07:01:31 -07:00 |
|
Daniel Han
|
d11d7a2c16
|
Update vision.py
|
2025-07-01 06:59:30 -07:00 |
|
Daniel Han
|
0b1545d218
|
Update pyproject.toml
|
2025-07-01 06:57:58 -07:00 |
|
Daniel Han
|
93487dbf81
|
Update vision.py
|
2025-07-01 04:27:40 -07:00 |
|
Daniel Han
|
34464fa436
|
Update vision.py
|
2025-07-01 02:49:48 -07:00 |
|
Daniel Han
|
48986eb6c4
|
Merge branch 'main' into nightly
|
2025-07-01 02:47:20 -07:00 |
|
Daniel Han
|
00c947798d
|
Update vision.py
|
2025-07-01 02:47:17 -07:00 |
|
Daniel Han
|
c2ecdecd5c
|
Merge branch 'main' into nightly
|
2025-07-01 02:37:07 -07:00 |
|
Daniel Han
|
a98505a5ae
|
Update _utils.py
|
2025-07-01 02:36:54 -07:00 |
|
Daniel Han
|
19448b2517
|
Update pyproject.toml
|
2025-07-01 01:34:17 -07:00 |
|
Daniel Han
|
622f3fc85a
|
Move AMD to AMD branch
|
2025-07-01 01:10:40 -07:00 |
|
Daniel Han
|
f1e1b890ac
|
Move AMD to AMD branch
|
2025-07-01 01:02:51 -07:00 |
|
Daniel Han
|
9886a2a3a0
|
subprocess
|
2025-07-01 00:51:04 -07:00 |
|
Daniel Han
|
46bc57ce49
|
Update setup.py
|
2025-07-01 00:34:27 -07:00 |
|
Daniel Han
|
b4b75a9ea8
|
Update setup.py
|
2025-07-01 00:32:23 -07:00 |
|