ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
2,197 commits 391 branches 58 tags 304 MiB
Commit graph

2,197 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
b893b8e6f8 Update synthetic.py May-2025 2025-05-01 07:41:45 -07:00
Daniel Han
643fb9e818 Update synthetic.py 2025-05-01 07:26:51 -07:00
Daniel Han
6f513ad3a8 Update pyproject.toml 2025-05-01 07:18:29 -07:00
Daniel Han
05bdd7822d Update _utils.py 2025-05-01 07:17:36 -07:00
Daniel Han
e3bfb39b31 Update synthetic.py 2025-05-01 06:56:02 -07:00
Daniel Han
fc398c440e Update synthetic.py 2025-05-01 06:55:43 -07:00
Daniel Han
fdfab3674f Update synthetic.py 2025-05-01 06:49:46 -07:00
Daniel Han
a063c6368a Update synthetic.py 2025-05-01 06:46:04 -07:00
Daniel Han
b606fb438f Update synthetic.py 2025-05-01 06:42:49 -07:00
Daniel Han
ea745c5290 Update synthetic.py 2025-05-01 06:38:16 -07:00
Daniel Han
10e9692918 Update synthetic.py 2025-05-01 06:38:08 -07:00
Daniel Han
7b2282a2ae Update synthetic.py 2025-05-01 06:36:16 -07:00
Daniel Han
bb8ea039d7 Update synthetic.py 2025-05-01 06:35:28 -07:00
Daniel Han
0784cd272d Update synthetic.py 2025-05-01 06:32:20 -07:00
Daniel Han
5ede267773 Update synthetic.py 2025-05-01 06:26:09 -07:00
Daniel Han
83f6f65086 Update synthetic.py 2025-05-01 06:23:54 -07:00
Daniel Han
2bd33331f1 Update synthetic.py 2025-05-01 06:20:47 -07:00
Daniel Han
e9f1c64ccd Update synthetic.py 2025-05-01 06:20:02 -07:00
Daniel Han
660806c70a Update synthetic.py 2025-05-01 06:19:25 -07:00
Daniel Han
799921cb3b Update synthetic.py 2025-05-01 06:16:58 -07:00
Daniel Han
f0e276077f Update synthetic.py 2025-05-01 06:16:35 -07:00
Daniel Han
371a1355e5 Merge branch 'main' into nightly 2025-05-01 05:54:31 -07:00
Daniel Han
c20bd2d664 Update mapper.py 2025-05-01 03:07:56 -07:00
Daniel Han
ad9976450d Qwen 3, Bug Fixes (#2445) 
* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Remove double generate patch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)

* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* versioning

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* model_type_arch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* check

* Update _utils.py

* Update loader.py

* Update loader.py

* Remove prints

* Update README.md

typo

* Update _utils.py

* Update _utils.py

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update vision.py

* HF Transfer

* fix(utils): add missing importlib import to fix NameError (#2134)

This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.

* Add QLoRA Train and Merge16bit Test (#2130)

* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Revert

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Bug fix

* Update mapper.py

* check SDPA for Mistral 3, Pixtral

* Update vision.py

* Versioning

* Update rl_replacements.py

* Update README.md

* add model registry

* move hf hub utils to unsloth/utils

* refactor global model info dicts to dataclasses

* fix dataclass init

* fix llama registration

* remove deprecated key function

* start registry reog

* add llama vision

* quant types -> Enum

* remap literal quant types to QuantType Enum

* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

---------

Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
 2025-04-30 22:38:39 -07:00
Daniel Han
a53f9a3361 Delete .gitignore 2025-04-30 22:36:15 -07:00
Daniel Han
33016628a4 Update pyproject.toml 2025-04-30 22:35:22 -07:00
Daniel Han
2dd21ae9df Update pyproject.toml 2025-04-30 22:34:07 -07:00
Daniel Han
0fcc4d6435 Update synthetic.py 2025-04-30 12:58:58 -07:00
Daniel Han
003d820e2a Update synthetic.py 2025-04-30 11:17:00 -07:00
Daniel Han
e1ce16e393 Update synthetic.py 2025-04-30 10:49:13 -07:00
Daniel Han
be7a7636b7 Update synthetic.py 2025-04-30 10:22:31 -07:00
Daniel Han
17d8cb2dfe Update synthetic.py 2025-04-30 10:22:01 -07:00
Daniel Han
dd43ad8b40 Update synthetic.py 2025-04-30 10:08:50 -07:00
Daniel Han
61fafb57ab Update synthetic.py 2025-04-30 10:07:49 -07:00
Daniel Han
7d66c9535c Update synthetic.py 2025-04-30 10:07:38 -07:00
Daniel Han
a095ade663 Update synthetic.py 2025-04-30 09:59:54 -07:00
Daniel Han
7fafeca92e Update synthetic.py 2025-04-30 09:49:27 -07:00
Daniel Han
f97b7bd621 Update synthetic.py 2025-04-30 09:48:53 -07:00
Daniel Han
8b1015d0a4 Update synthetic.py 2025-04-30 09:40:13 -07:00
Daniel Han
97874d34fd Update synthetic.py 2025-04-30 09:32:57 -07:00
Daniel Han
6da77eba6a Update synthetic.py 2025-04-30 09:30:33 -07:00
Daniel Han
444768ca1c Update synthetic.py 2025-04-30 09:25:46 -07:00
Daniel Han
87b8ae4358 Update synthetic.py 2025-04-30 09:25:27 -07:00
Daniel Han
d1e6253ca9 Update synthetic.py 2025-04-30 09:24:31 -07:00
Daniel Han
64f99de662 Update synthetic.py 2025-04-30 09:22:40 -07:00
Daniel Han
f3020dc54e Update synthetic.py 2025-04-30 09:21:05 -07:00
Daniel Han
7c316798aa Update synthetic.py 2025-04-30 09:19:23 -07:00
Daniel Han
d1d9e89114 Update synthetic.py 2025-04-30 08:57:23 -07:00
Daniel Han
2a9cefb637 Update synthetic.py 2025-04-30 08:56:01 -07:00
Daniel Han
310337daa0 Update synthetic.py 2025-04-30 08:52:26 -07:00