Michael Han
|
96dec7dae1
|
Update README.md
|
2025-04-28 19:08:12 -07:00 |
|
Michael Han
|
f9d626c85c
|
Merge pull request #2211 from Datta0/qwen3_support
[WIP] Initial support for Qwen3. Will udpate when the model is released
|
2025-04-28 19:05:40 -07:00 |
|
Daniel Han
|
7a8f99e189
|
Update pyproject.toml
|
2025-04-26 03:45:29 -07:00 |
|
Daniel Han
|
3910ef099b
|
Versioning
|
2025-04-26 03:44:21 -07:00 |
|
Michael Han
|
6c234d5a66
|
Merge pull request #2381 from Erland366/fix/saving_vlm_4bit
Fix saving 4bit for VLM
|
2025-04-19 14:26:11 -07:00 |
|
Erland366
|
c1155dceef
|
feat: Add validation for 4bit save method and implement corresponding error handling
|
2025-04-19 20:36:30 +00:00 |
|
Michael Han
|
73d6fb2868
|
Merge pull request #2375 from unslothai/revert-2358-patch-1
Revert "fix: improved error handling when llama.cpp build fails"
|
2025-04-17 20:33:40 -07:00 |
|
Michael Han
|
d45997d9bd
|
Revert "fix: improved error handling when llama.cpp build fails"
|
2025-04-17 20:33:25 -07:00 |
|
Michael Han
|
03e2d45f03
|
Merge pull request #2358 from Hansehart/patch-1
fix: improved error handling when llama.cpp build fails
|
2025-04-17 14:03:45 -07:00 |
|
Richi
|
4d944511e4
|
fix: improved error handling when llama.cpp build fails
|
2025-04-16 09:17:25 +02:00 |
|
Etherll
|
f6f5e6397a
|
feat: Support custom auto_model for wider model compatibility (Whisper, Bert,etc) & attn_implementation support (#2263)
* Update loader.py
* Update vision.py
* Update vision.py
fix attn_implementation
* Refactor: Improve parameter handling and checks in loader/vision
|
2025-04-14 14:10:05 -07:00 |
|
Michael Han
|
05f4875aff
|
Update question.md
|
2025-04-09 15:31:56 -07:00 |
|
Michael Han
|
4892b633fa
|
Update feature_request.md
|
2025-04-09 15:30:56 -07:00 |
|
Michael Han
|
aa40cb6c05
|
Update documentation.md
|
2025-04-09 15:29:20 -07:00 |
|
Michael Han
|
215275f6b7
|
Update bug_report.md
|
2025-04-09 15:24:35 -07:00 |
|
Michael Han
|
76db0e9246
|
Update question.md
|
2025-04-09 15:20:44 -07:00 |
|
Michael Han
|
eaced577b9
|
Update feature_request.md
|
2025-04-09 15:20:06 -07:00 |
|
Michael Han
|
65e9ed8507
|
Update documentation.md
|
2025-04-09 15:19:40 -07:00 |
|
Michael Han
|
ab066ec1d9
|
Merge pull request #2323 from unslothai/shimmyshimmer-patch-2
Update bug_report.md
|
2025-04-09 15:19:21 -07:00 |
|
Michael Han
|
58bf4cc839
|
Update bug_report.md
|
2025-04-09 15:17:33 -07:00 |
|
Michael Han
|
c9b9a366e7
|
Update README.md
|
2025-04-05 14:56:01 -07:00 |
|
Michael Han
|
bb112e38ef
|
Merge pull request #2267 from Kimizhao/main
Update README.md
|
2025-04-02 02:07:35 -07:00 |
|
zhaozh
|
6088faf0e7
|
Update README.md
Gemma3 HF uploaded GGUFs, 4-bit models link.
|
2025-04-02 16:10:21 +08:00 |
|
datta0
|
fa1144171c
|
add comments and use modified function
|
2025-04-02 06:49:06 +00:00 |
|
Michael Han
|
b44f89e60a
|
Merge pull request #2250 from unslothai/jeromeku-patch-1
Fix feature_request ISSUE_TEMPLATE
|
2025-03-31 12:51:21 -07:00 |
|
jeromeku
|
26dbb47e07
|
Fix feature_request ISSUE_TEMPLATE
|
2025-03-31 12:28:44 -07:00 |
|
Michael Han
|
eefba34e94
|
Merge pull request #2242 from jeromeku/issues-templates
Issues templates
|
2025-03-30 22:04:47 -07:00 |
|
jeromeku
|
e54b0d4cc3
|
make wording more user-friendly
|
2025-03-30 15:52:31 -07:00 |
|
jeromeku
|
621c3ce656
|
improve wording
|
2025-03-30 15:47:33 -07:00 |
|
jeromeku
|
d736486ea2
|
more edits
|
2025-03-30 15:46:25 -07:00 |
|
jeromeku
|
69e6277d5a
|
fix typos, better wording
|
2025-03-30 15:39:20 -07:00 |
|
jeromeku
|
3f1c63b0c2
|
make templates more concise
|
2025-03-30 15:36:45 -07:00 |
|
jeromeku
|
7aa544aee9
|
more template edits
|
2025-03-30 15:34:01 -07:00 |
|
jeromeku
|
4f477ffcd9
|
generalize documentation template
|
2025-03-30 15:21:47 -07:00 |
|
jeromeku
|
e94f48430e
|
fix question template
|
2025-03-30 15:19:58 -07:00 |
|
jeromeku
|
96f4228104
|
clean up bug template
|
2025-03-30 15:19:00 -07:00 |
|
jeromeku
|
13788b354b
|
fix template labels
|
2025-03-30 15:11:00 -07:00 |
|
jeromeku
|
b09c425daf
|
add question template
|
2025-03-30 15:08:38 -07:00 |
|
jeromeku
|
77cfc8a5c0
|
Update custom.md
|
2025-03-30 15:06:42 -07:00 |
|
jeromeku
|
1e5582035b
|
Update issue templates
|
2025-03-30 15:06:42 -07:00 |
|
jeromeku
|
bf69db0809
|
Update issue templates
|
2025-03-30 15:06:41 -07:00 |
|
jeromeku
|
277e314361
|
Update and rename custom.md to documentation_request.md
|
2025-03-30 15:06:41 -07:00 |
|
jeromeku
|
588bc6d486
|
Update issue templates
|
2025-03-30 15:06:41 -07:00 |
|
datta0
|
53d820d31e
|
Enable qwen3 and qwen3moe
|
2025-03-28 05:58:01 +00:00 |
|
datta0
|
28e4c45507
|
Add Qwen3Moe and necessitate transformers version
|
2025-03-28 05:50:43 +00:00 |
|
datta0
|
d3ba5ef69a
|
Initial support for Qwen3. Will udpate when the model is released
|
2025-03-27 14:35:57 +00:00 |
|
Michael Han
|
2ff5dc1a8d
|
Update README.md
|
2025-03-27 00:26:18 -07:00 |
|
Daniel Han
|
158b25c30d
|
Bug Fixes (#2197)
* Update loader.py
* model names
* Gemma 3 chat template
* Bug fixes
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update llama.py
* Update llama.py
* Update rl.py
* Update chat_templates.py
* Update chat_templates.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update vision.py
* Revert
* Update _utils.py
* forced precision
* Autocast
* Update vision.py
* Update vision.py
* Update rl.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl.py
* vLLM fixes
* constexpr
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update save.py
* New models
* Triton windows update (#1976)
* Update pyproject.toml
* Update README.md
* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)
* Update RMS LayerNorm implementation with optimizations and testing suite
* perf: optimize list comprehension in get_ollama_eos_tokens
* Update Zoo
* Update llama.py
* Update llama.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* grpo fix
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update rl.py
* Update _utils.py
* Version
* Update pyproject.toml
* Update llama.py
* Update llama.py
* bug fix #2008 (#2039)
* fix (#2051)
* Update loader.py
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* more prints
* Update loader.py
* LoRA 16bit fix
* Update vision.py
* Update vision.py
* Update _utils.py
* Update vision.py
* move forced float32
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* move print
* Update _utils.py
* disable bfloat16
* Fix forced float32
* move float32
* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)
* Update _utils.py
* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:
```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```
This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
* fix error message (#2046)
* Update vision.py
* Update _utils.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Remove double generate patch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update mapper.py
* Update vision.py
* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)
* fix: config.torch_dtype in LlamaModel_fast_forward_inference
* Update llama.py
* update for consistency
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* versioning
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* model_type_arch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* check
* Update _utils.py
* Update loader.py
* Update loader.py
* Remove prints
* Update _utils.py
* Update _utils.py
* versioning
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update vision.py
* HF Transfer
* fix(utils): add missing importlib import to fix NameError (#2134)
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
* Add QLoRA Train and Merge16bit Test (#2130)
* add reference and unsloth lora merging tests
* add test / dataset printing to test scripts
* allow running tests from repo root
* add qlora test readme
* more readme edits
* ruff formatting
* additional readme comments
* forgot to add actual tests
* add apache license
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Revert
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Bug fix
* Update mapper.py
* check SDPA for Mistral 3, Pixtral
* Update vision.py
* Versioning
* Update rl_replacements.py
---------
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
|
2025-03-26 05:19:48 -07:00 |
|
Daniel Han
|
e80d642bc7
|
Update pyproject.toml
|
2025-03-21 18:02:05 -07:00 |
|
Daniel Han
|
05baf282c7
|
Fix Transformers 4.45 (#2151)
* Update pyproject.toml
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Batch samples
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update mapper.py
* Update vision.py
* Temporary patches
* Update loader.py
* model names
* Gemma 3 chat template
* Bug fixes
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update llama.py
* Update llama.py
* Update rl.py
* Update chat_templates.py
* Update chat_templates.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update vision.py
* Revert
* Update _utils.py
* forced precision
* Autocast
* Update vision.py
* Update vision.py
* Update rl.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl.py
* vLLM fixes
* constexpr
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update save.py
* New models
* Triton windows update (#1976)
* Update pyproject.toml
* Update README.md
* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)
* Update RMS LayerNorm implementation with optimizations and testing suite
* perf: optimize list comprehension in get_ollama_eos_tokens
* Update Zoo
* Update llama.py
* Update llama.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* grpo fix
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update rl.py
* Update _utils.py
* Version
* Update pyproject.toml
* Update llama.py
* Update llama.py
* bug fix #2008 (#2039)
* fix (#2051)
* Update loader.py
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* more prints
* Update loader.py
* LoRA 16bit fix
* Update vision.py
* Update vision.py
* Update _utils.py
* Update vision.py
* move forced float32
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* move print
* Update _utils.py
* disable bfloat16
* Fix forced float32
* move float32
* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)
* Update _utils.py
* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:
```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```
This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
* fix error message (#2046)
* Update vision.py
* Update _utils.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Remove double generate patch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update mapper.py
* Update vision.py
* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)
* fix: config.torch_dtype in LlamaModel_fast_forward_inference
* Update llama.py
* update for consistency
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* versioning
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* model_type_arch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* check
* Update _utils.py
* Update loader.py
* Update loader.py
* Remove prints
* Update _utils.py
* Update _utils.py
* versioning
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update vision.py
* HF Transfer
* fix(utils): add missing importlib import to fix NameError (#2134)
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
* Add QLoRA Train and Merge16bit Test (#2130)
* add reference and unsloth lora merging tests
* add test / dataset printing to test scripts
* allow running tests from repo root
* add qlora test readme
* more readme edits
* ruff formatting
* additional readme comments
* forgot to add actual tests
* add apache license
* Update pyproject.toml
---------
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
|
2025-03-21 17:55:12 -07:00 |
|