Commit graph

2,297 commits

Author SHA1 Message Date
Daniel Han
f130fba1b2 Update vision.py 2025-05-16 23:03:04 -07:00
Daniel Han
41fea7de7a Update mapper.py 2025-05-16 23:02:06 -07:00
Daniel Han
08821bac5a Merge branch 'main' into nightly 2025-05-16 23:02:00 -07:00
Etherll
78c9f31c74 Fix trust remote code (#2357)
* Update _utils.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update unsloth/models/vision.py

* Update unsloth/models/vision.py

* Update unsloth/models/vision.py

* Update unsloth/models/vision.py

* Update unsloth/models/_utils.py

* Update unsloth/models/vision.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-05-16 16:06:42 -07:00
Daniel Han
8d7c4e13c1 Update pyproject.toml 2025-05-16 15:38:19 -07:00
Daniel Han
7f31d54dc0 Merge branch 'main' of https://github.com/unslothai/unsloth 2025-05-16 15:34:41 -07:00
Daniel Han
953bbdb778 Update _utils.py 2025-05-16 15:33:49 -07:00
Michael Han
0d73478808 Merge pull request #2554 from Erland366/fix/generation_config
Quick fix on the CompileConfig error
2025-05-16 12:48:00 -07:00
Erland366
9e9f2a6229 Fix Nonetype on the compile_config 2025-05-16 13:16:34 +00:00
Michael Han
84ab0b2fd0 Update README.md 2025-05-16 01:56:40 -07:00
Michael Han
2ccadeb474 Update README.md
TTS support
2025-05-15 15:15:53 -07:00
Daniel Han
532a43f828 TTS (#2545)
* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Remove double generate patch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)

* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* versioning

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* model_type_arch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* check

* Update _utils.py

* Update loader.py

* Update loader.py

* Remove prints

* Update README.md

typo

* Update _utils.py

* Update _utils.py

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update vision.py

* HF Transfer

* fix(utils): add missing importlib import to fix NameError (#2134)

This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.

* Add QLoRA Train and Merge16bit Test (#2130)

* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Revert

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Bug fix

* Update mapper.py

* check SDPA for Mistral 3, Pixtral

* Update vision.py

* Versioning

* Update rl_replacements.py

* Update README.md

* add model registry

* move hf hub utils to unsloth/utils

* refactor global model info dicts to dataclasses

* fix dataclass init

* fix llama registration

* remove deprecated key function

* start registry reog

* add llama vision

* quant types -> Enum

* remap literal quant types to QuantType Enum

* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

---------

Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-05-15 09:23:52 -07:00
Daniel Han
49661b50f4 Update loader.py 2025-05-15 09:23:11 -07:00
Daniel Han
4f54224492 Update loader.py 2025-05-15 08:52:10 -07:00
Daniel Han
3a28a496e0 Update loader.py 2025-05-15 08:39:37 -07:00
Daniel Han
a374ec8203 Whisper 2025-05-15 08:27:17 -07:00
Daniel Han
e332f91812 Sesame 2025-05-15 07:29:32 -07:00
Michael Han
f30b16b0d4 Update README.md 2025-05-15 06:54:05 -07:00
Daniel Han
efd07cd9a7 Auto vision detection 2025-05-15 06:39:03 -07:00
Daniel Han
d4975ca143 Update vision.py 2025-05-15 04:52:10 -07:00
Daniel Han
2b0fb84793 UNSLOTH_DISABLE_STATIC_GENERATION 2025-05-15 04:48:42 -07:00
Daniel Han
1d2ac1f1e8 Update vision.py 2025-05-15 04:34:49 -07:00
Daniel Han
a8884bc8c1 Update vision.py 2025-05-15 04:26:05 -07:00
Janusz
22f2fea2ea Add use_rslora reference to LoraConfig inititalisation (#2539)
Co-authored-by: jkumz <janusz.kumor01@gmail.com>
2025-05-15 04:24:18 -07:00
omahs
568a806fc8 Fix typos (#2540) 2025-05-15 04:23:27 -07:00
Daniel Han
e99dfc2589 Update vision.py 2025-05-15 03:54:22 -07:00
Daniel Han
98e48b88c0 Update loader.py 2025-05-15 03:46:48 -07:00
Daniel Han
6f00d6d3a9 Update loader.py 2025-05-15 03:39:20 -07:00
Daniel Han
6a1904c704 Update loader.py 2025-05-15 03:18:16 -07:00
Daniel Han
0eba0ed5b3 Update loader.py 2025-05-15 03:00:25 -07:00
Daniel Han
4f8027ad74 is_multimodal 2025-05-15 02:32:29 -07:00
Daniel Han
bcdd2d52e5 Update loader.py 2025-05-15 02:30:12 -07:00
Daniel Han
b4d0680de4 Update vision.py 2025-05-15 02:17:03 -07:00
Daniel Han
924a6f4952 Update vision.py 2025-05-15 02:07:29 -07:00
Daniel Han
ab31b9af62 Update vision.py 2025-05-15 01:54:05 -07:00
Daniel Han
505c27cd4c Update loader.py 2025-05-15 01:47:34 -07:00
Daniel Han
3a9c10c33c Fix Seasame 2025-05-15 01:45:15 -07:00
Daniel Han
8f42a99e49 Seasame force float16 / float32 2025-05-15 01:27:14 -07:00
Daniel Han
e51bec7618 Update chat_templates.py 2025-05-15 01:13:20 -07:00
Daniel Han
44053f4cfb Merge branch 'main' into nightly 2025-05-15 01:07:32 -07:00
Michael Han
e01f304c6d Merge pull request #2537 from kiankyars/main
Add Qwen-3 chat template and Ollama template support
2025-05-14 20:45:53 -07:00
Daniel Han
49c4bf1471 Merge branch 'main' into nightly 2025-05-14 20:30:41 -07:00
Kian Kyars
4e7b91f11d undo accident 2025-05-14 19:00:23 -06:00
Kian Kyars
973a0ddcd4 style: Place Qwen-3 template after Gemma-3, match style with other templates 2025-05-14 18:59:17 -06:00
Kian Kyars
d3fdd4193b Update Qwen-3 chat and Ollama templates to official full version, placed after Gemma-3 2025-05-14 18:42:55 -06:00
Kian Kyars
31887228d6 Add Qwen-3 chat template and Ollama template support 2025-05-14 18:35:02 -06:00
Daniel Han
4170900b47 Update pyproject.toml 2025-05-14 05:42:47 -07:00
Daniel Han
75cdebf9b7 Update _utils.py 2025-05-14 05:42:11 -07:00
Daniel Han
957c203f0e Update synthetic.py 2025-05-14 04:05:23 -07:00
Daniel Han
62e669b291 Update synthetic.py 2025-05-14 03:54:46 -07:00