Michael Han
|
c4d0fd42be
|
Updating HQ logos
|
2025-05-04 05:25:06 -07:00 |
|
Daniel Han
|
84779ee11b
|
Better vllm deletion
|
2025-05-04 05:03:58 -07:00 |
|
Daniel Han
|
f9bf537130
|
Update pyproject.toml
|
2025-05-04 04:29:10 -07:00 |
|
Daniel Han
|
bad8069807
|
Update _utils.py
|
2025-05-04 03:03:50 -07:00 |
|
Michael Han
|
bb802c8a4a
|
Update README.md
|
2025-05-02 23:14:34 -07:00 |
|
Daniel Han
|
077fe260e6
|
Update pyproject.toml
|
2025-05-02 22:52:58 -07:00 |
|
Daniel Han
|
e287e55906
|
Update pyproject.toml
|
2025-05-02 22:47:09 -07:00 |
|
Daniel Han
|
fcaf726dda
|
Update pyproject.toml
|
2025-05-02 22:40:12 -07:00 |
|
Roland Tannous
|
4190502a1a
|
Added missing code of conduct (#2416)
* Added code of conduct
* fixed CONTRIBUTING -> CODE_OF_CONDUCT url link
|
2025-05-02 21:08:27 -07:00 |
|
Johnny
|
fb3fb77d43
|
Update pyproject.toml (#2458)
|
2025-05-02 21:07:59 -07:00 |
|
jeromeku
|
b7fc12c8be
|
MoE Kernel (#2465)
* add moe grouped gemm kernel
* add benchmark, README
* remove formatting from __init__.py
|
2025-05-02 20:59:23 -07:00 |
|
Mathew Mathew
|
bbe5e2a221
|
the pixtral vision notebook fails during inferenc with unused kwargs token_type_ids. This fixes the error
|
2025-05-02 21:40:15 -05:00 |
|
Daniel Han
|
9edbe23259
|
Bug fix
|
2025-05-02 14:06:14 -07:00 |
|
Daniel Han
|
d957caeae7
|
Fix Qwen 3 mapping
|
2025-05-02 09:44:01 -07:00 |
|
Michael Han
|
8bfe5fd4ab
|
Update README.md
|
2025-05-02 09:06:57 -07:00 |
|
Daniel Han
|
2249a5ff88
|
Qwen3 bug fixes
|
2025-05-02 07:18:33 -07:00 |
|
Daniel Han
|
8fbd80231c
|
Update mapper.py
|
2025-05-02 06:26:43 -07:00 |
|
Daniel Han
|
d74e7c19b3
|
Versioning
|
2025-05-02 05:05:09 -07:00 |
|
Daniel Han
|
439cae9fae
|
Remove hf_xet warning
|
2025-05-02 04:23:53 -07:00 |
|
Daniel Han
|
f90224b02f
|
Update __init__.py
|
2025-05-02 03:43:44 -07:00 |
|
Daniel Han
|
2a231c7ba4
|
Merge branch 'main' of https://github.com/unslothai/unsloth
|
2025-05-02 03:09:52 -07:00 |
|
Daniel Han
|
eb495f171f
|
Qwen 3
|
2025-05-02 03:09:44 -07:00 |
|
cblomert
|
629a3fcfe3
|
Added k_norm & q_norm to merged Qwen3 layers (#2452)
|
2025-05-02 03:07:37 -07:00 |
|
Michael Han
|
97a63f809f
|
Update README.md
Qwen3 notebook
|
2025-05-01 22:52:42 -07:00 |
|
Daniel Han
|
6e2b5a767f
|
Nightly (#2448)
* move float32
* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)
* Update _utils.py
* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:
```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```
This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
* fix error message (#2046)
* Update vision.py
* Update _utils.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Remove double generate patch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update mapper.py
* Update vision.py
* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)
* fix: config.torch_dtype in LlamaModel_fast_forward_inference
* Update llama.py
* update for consistency
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* versioning
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* model_type_arch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* check
* Update _utils.py
* Update loader.py
* Update loader.py
* Remove prints
* Update README.md
typo
* Update _utils.py
* Update _utils.py
* versioning
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update vision.py
* HF Transfer
* fix(utils): add missing importlib import to fix NameError (#2134)
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
* Add QLoRA Train and Merge16bit Test (#2130)
* add reference and unsloth lora merging tests
* add test / dataset printing to test scripts
* allow running tests from repo root
* add qlora test readme
* more readme edits
* ruff formatting
* additional readme comments
* forgot to add actual tests
* add apache license
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Revert
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Bug fix
* Update mapper.py
* check SDPA for Mistral 3, Pixtral
* Update vision.py
* Versioning
* Update rl_replacements.py
* Update README.md
* add model registry
* move hf hub utils to unsloth/utils
* refactor global model info dicts to dataclasses
* fix dataclass init
* fix llama registration
* remove deprecated key function
* start registry reog
* add llama vision
* quant types -> Enum
* remap literal quant types to QuantType Enum
* add llama model registration
* fix quant tag mapping
* add qwen2.5 models to registry
* add option to include original model in registry
* handle quant types per model size
* separate registration of base and instruct llama3.2
* add QwenQVQ to registry
* add gemma3 to registry
* add phi
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
---------
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
|
2025-05-01 07:42:08 -07:00 |
|
Daniel Han
|
88988a8eae
|
Update synthetic.py
|
2025-05-01 07:41:45 -07:00 |
|
Daniel Han
|
ea30448540
|
Update synthetic.py
|
2025-05-01 07:26:51 -07:00 |
|
Daniel Han
|
8590f903e0
|
Update pyproject.toml
|
2025-05-01 07:18:29 -07:00 |
|
Daniel Han
|
b6efc4f985
|
Update _utils.py
|
2025-05-01 07:17:36 -07:00 |
|
Daniel Han
|
9b8556a100
|
Update synthetic.py
|
2025-05-01 06:56:02 -07:00 |
|
Daniel Han
|
8e17139f21
|
Update synthetic.py
|
2025-05-01 06:55:43 -07:00 |
|
Daniel Han
|
3ff18046d4
|
Update synthetic.py
|
2025-05-01 06:49:46 -07:00 |
|
Daniel Han
|
9aff268a0c
|
Update synthetic.py
|
2025-05-01 06:46:04 -07:00 |
|
Daniel Han
|
be85c14fec
|
Update synthetic.py
|
2025-05-01 06:42:49 -07:00 |
|
Daniel Han
|
24f6940bf2
|
Update synthetic.py
|
2025-05-01 06:38:16 -07:00 |
|
Daniel Han
|
c7385aa85d
|
Update synthetic.py
|
2025-05-01 06:38:08 -07:00 |
|
Daniel Han
|
94c90d35be
|
Update synthetic.py
|
2025-05-01 06:36:16 -07:00 |
|
Daniel Han
|
f2fb23e532
|
Update synthetic.py
|
2025-05-01 06:35:28 -07:00 |
|
Daniel Han
|
a4d8dc31c4
|
Update synthetic.py
|
2025-05-01 06:32:20 -07:00 |
|
Daniel Han
|
c7d953c452
|
Update synthetic.py
|
2025-05-01 06:26:09 -07:00 |
|
Daniel Han
|
09470acdb8
|
Update synthetic.py
|
2025-05-01 06:23:54 -07:00 |
|
Daniel Han
|
72ca86306a
|
Update synthetic.py
|
2025-05-01 06:20:47 -07:00 |
|
Daniel Han
|
8853a0fee4
|
Update synthetic.py
|
2025-05-01 06:20:02 -07:00 |
|
Daniel Han
|
d93fe5e656
|
Update synthetic.py
|
2025-05-01 06:19:25 -07:00 |
|
Daniel Han
|
706d14ea51
|
Update synthetic.py
|
2025-05-01 06:16:58 -07:00 |
|
Daniel Han
|
9b31af17b4
|
Update synthetic.py
|
2025-05-01 06:16:35 -07:00 |
|
Daniel Han
|
080fd1b4da
|
Merge branch 'main' into nightly
|
2025-05-01 05:54:31 -07:00 |
|
Daniel Han
|
382961c9d3
|
Update mapper.py
|
2025-05-01 03:07:56 -07:00 |
|
Daniel Han
|
9a930bb095
|
Qwen 3, Bug Fixes (#2445)
* bug fix #2008 (#2039)
* fix (#2051)
* Update loader.py
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* more prints
* Update loader.py
* LoRA 16bit fix
* Update vision.py
* Update vision.py
* Update _utils.py
* Update vision.py
* move forced float32
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* move print
* Update _utils.py
* disable bfloat16
* Fix forced float32
* move float32
* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)
* Update _utils.py
* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:
```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```
This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
* fix error message (#2046)
* Update vision.py
* Update _utils.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Remove double generate patch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update mapper.py
* Update vision.py
* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)
* fix: config.torch_dtype in LlamaModel_fast_forward_inference
* Update llama.py
* update for consistency
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* versioning
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* model_type_arch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* check
* Update _utils.py
* Update loader.py
* Update loader.py
* Remove prints
* Update README.md
typo
* Update _utils.py
* Update _utils.py
* versioning
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update vision.py
* HF Transfer
* fix(utils): add missing importlib import to fix NameError (#2134)
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
* Add QLoRA Train and Merge16bit Test (#2130)
* add reference and unsloth lora merging tests
* add test / dataset printing to test scripts
* allow running tests from repo root
* add qlora test readme
* more readme edits
* ruff formatting
* additional readme comments
* forgot to add actual tests
* add apache license
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Revert
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Bug fix
* Update mapper.py
* check SDPA for Mistral 3, Pixtral
* Update vision.py
* Versioning
* Update rl_replacements.py
* Update README.md
* add model registry
* move hf hub utils to unsloth/utils
* refactor global model info dicts to dataclasses
* fix dataclass init
* fix llama registration
* remove deprecated key function
* start registry reog
* add llama vision
* quant types -> Enum
* remap literal quant types to QuantType Enum
* add llama model registration
* fix quant tag mapping
* add qwen2.5 models to registry
* add option to include original model in registry
* handle quant types per model size
* separate registration of base and instruct llama3.2
* add QwenQVQ to registry
* add gemma3 to registry
* add phi
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
---------
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
|
2025-04-30 22:38:39 -07:00 |
|
Daniel Han
|
962e788eb1
|
Delete .gitignore
|
2025-04-30 22:36:15 -07:00 |
|