Commit graph

2,295 commits

Author SHA1 Message Date
Daniel Han
0078d7bfb5 Merge branch 'main' into nightly 2025-05-16 23:02:00 -07:00
Etherll
99a2a36f73 Fix trust remote code (#2357)
* Update _utils.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update unsloth/models/vision.py

* Update unsloth/models/vision.py

* Update unsloth/models/vision.py

* Update unsloth/models/vision.py

* Update unsloth/models/_utils.py

* Update unsloth/models/vision.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-05-16 16:06:42 -07:00
Daniel Han
2524de493e Update pyproject.toml 2025-05-16 15:38:19 -07:00
Daniel Han
15b6ac613a Merge branch 'main' of https://github.com/unslothai/unsloth 2025-05-16 15:34:41 -07:00
Daniel Han
299c8a94a4 Update _utils.py 2025-05-16 15:33:49 -07:00
Michael Han
4937cd97f0 Merge pull request #2554 from Erland366/fix/generation_config
Quick fix on the CompileConfig error
2025-05-16 12:48:00 -07:00
Erland366
3cdbd879f7 Fix Nonetype on the compile_config 2025-05-16 13:16:34 +00:00
Michael Han
b22e654ef0 Update README.md 2025-05-16 01:56:40 -07:00
Michael Han
41e3701251 Update README.md
TTS support
2025-05-15 15:15:53 -07:00
Daniel Han
dc6c4dc385 TTS (#2545)
* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Remove double generate patch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)

* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* versioning

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* model_type_arch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* check

* Update _utils.py

* Update loader.py

* Update loader.py

* Remove prints

* Update README.md

typo

* Update _utils.py

* Update _utils.py

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update vision.py

* HF Transfer

* fix(utils): add missing importlib import to fix NameError (#2134)

This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.

* Add QLoRA Train and Merge16bit Test (#2130)

* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Revert

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Bug fix

* Update mapper.py

* check SDPA for Mistral 3, Pixtral

* Update vision.py

* Versioning

* Update rl_replacements.py

* Update README.md

* add model registry

* move hf hub utils to unsloth/utils

* refactor global model info dicts to dataclasses

* fix dataclass init

* fix llama registration

* remove deprecated key function

* start registry reog

* add llama vision

* quant types -> Enum

* remap literal quant types to QuantType Enum

* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

---------

Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-05-15 09:23:52 -07:00
Daniel Han
b9b7b2c054 Update loader.py 2025-05-15 09:23:11 -07:00
Daniel Han
2579cd982b Update loader.py 2025-05-15 08:52:10 -07:00
Daniel Han
ed5712c397 Update loader.py 2025-05-15 08:39:37 -07:00
Daniel Han
b425d9da9e Whisper 2025-05-15 08:27:17 -07:00
Daniel Han
a0dd7663c2 Sesame 2025-05-15 07:29:32 -07:00
Michael Han
b5ba71a3d3 Update README.md 2025-05-15 06:54:05 -07:00
Daniel Han
b77d59e97c Auto vision detection 2025-05-15 06:39:03 -07:00
Daniel Han
d77a4a9d5c Update vision.py 2025-05-15 04:52:10 -07:00
Daniel Han
2fe9067d6b UNSLOTH_DISABLE_STATIC_GENERATION 2025-05-15 04:48:42 -07:00
Daniel Han
b02f6035ae Update vision.py 2025-05-15 04:34:49 -07:00
Daniel Han
8865207ba4 Update vision.py 2025-05-15 04:26:05 -07:00
Janusz
b781a7ad38 Add use_rslora reference to LoraConfig inititalisation (#2539)
Co-authored-by: jkumz <janusz.kumor01@gmail.com>
2025-05-15 04:24:18 -07:00
omahs
28304e4101 Fix typos (#2540) 2025-05-15 04:23:27 -07:00
Daniel Han
dafdcbe88c Update vision.py 2025-05-15 03:54:22 -07:00
Daniel Han
ba6dcd2498 Update loader.py 2025-05-15 03:46:48 -07:00
Daniel Han
30a1b25752 Update loader.py 2025-05-15 03:39:20 -07:00
Daniel Han
fda9007d77 Update loader.py 2025-05-15 03:18:16 -07:00
Daniel Han
7f22fdd9f9 Update loader.py 2025-05-15 03:00:25 -07:00
Daniel Han
5982e34484 is_multimodal 2025-05-15 02:32:29 -07:00
Daniel Han
b4b073a59d Update loader.py 2025-05-15 02:30:12 -07:00
Daniel Han
f781c871c7 Update vision.py 2025-05-15 02:17:03 -07:00
Daniel Han
633221f8c9 Update vision.py 2025-05-15 02:07:29 -07:00
Daniel Han
151b1ae2e3 Update vision.py 2025-05-15 01:54:05 -07:00
Daniel Han
630f2b5f66 Update loader.py 2025-05-15 01:47:34 -07:00
Daniel Han
c4d8ed4939 Fix Seasame 2025-05-15 01:45:15 -07:00
Daniel Han
9dac587254 Seasame force float16 / float32 2025-05-15 01:27:14 -07:00
Daniel Han
189ed215e6 Update chat_templates.py 2025-05-15 01:13:20 -07:00
Daniel Han
992f9248bb Merge branch 'main' into nightly 2025-05-15 01:07:32 -07:00
Michael Han
b64c84ef33 Merge pull request #2537 from kiankyars/main
Add Qwen-3 chat template and Ollama template support
2025-05-14 20:45:53 -07:00
Daniel Han
c9b93f7b10 Merge branch 'main' into nightly 2025-05-14 20:30:41 -07:00
Kian Kyars
e147af330e undo accident 2025-05-14 19:00:23 -06:00
Kian Kyars
059ccd8221 style: Place Qwen-3 template after Gemma-3, match style with other templates 2025-05-14 18:59:17 -06:00
Kian Kyars
48dc104728 Update Qwen-3 chat and Ollama templates to official full version, placed after Gemma-3 2025-05-14 18:42:55 -06:00
Kian Kyars
40ac241994 Add Qwen-3 chat template and Ollama template support 2025-05-14 18:35:02 -06:00
Daniel Han
e18a41d10f Update pyproject.toml 2025-05-14 05:42:47 -07:00
Daniel Han
da41d4c21f Update _utils.py 2025-05-14 05:42:11 -07:00
Daniel Han
0bbf131238 Update synthetic.py 2025-05-14 04:05:23 -07:00
Daniel Han
f971fce721 Update synthetic.py 2025-05-14 03:54:46 -07:00
Daniel Han
17d8517144 Update synthetic.py 2025-05-14 03:49:27 -07:00
Daniel Han
b47bbd3f55 Update synthetic.py 2025-05-14 03:47:29 -07:00