ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
2,184 commits 391 branches 58 tags 304 MiB
Commit graph

2,184 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
a4d8dc31c4 Update synthetic.py 2025-05-01 06:32:20 -07:00
Daniel Han
c7d953c452 Update synthetic.py 2025-05-01 06:26:09 -07:00
Daniel Han
09470acdb8 Update synthetic.py 2025-05-01 06:23:54 -07:00
Daniel Han
72ca86306a Update synthetic.py 2025-05-01 06:20:47 -07:00
Daniel Han
8853a0fee4 Update synthetic.py 2025-05-01 06:20:02 -07:00
Daniel Han
d93fe5e656 Update synthetic.py 2025-05-01 06:19:25 -07:00
Daniel Han
706d14ea51 Update synthetic.py 2025-05-01 06:16:58 -07:00
Daniel Han
9b31af17b4 Update synthetic.py 2025-05-01 06:16:35 -07:00
Daniel Han
080fd1b4da Merge branch 'main' into nightly 2025-05-01 05:54:31 -07:00
Daniel Han
382961c9d3 Update mapper.py 2025-05-01 03:07:56 -07:00
Daniel Han
9a930bb095 Qwen 3, Bug Fixes (#2445) 
* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Remove double generate patch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)

* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* versioning

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* model_type_arch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* check

* Update _utils.py

* Update loader.py

* Update loader.py

* Remove prints

* Update README.md

typo

* Update _utils.py

* Update _utils.py

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update vision.py

* HF Transfer

* fix(utils): add missing importlib import to fix NameError (#2134)

This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.

* Add QLoRA Train and Merge16bit Test (#2130)

* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Revert

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Bug fix

* Update mapper.py

* check SDPA for Mistral 3, Pixtral

* Update vision.py

* Versioning

* Update rl_replacements.py

* Update README.md

* add model registry

* move hf hub utils to unsloth/utils

* refactor global model info dicts to dataclasses

* fix dataclass init

* fix llama registration

* remove deprecated key function

* start registry reog

* add llama vision

* quant types -> Enum

* remap literal quant types to QuantType Enum

* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

---------

Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
 2025-04-30 22:38:39 -07:00
Daniel Han
962e788eb1 Delete .gitignore 2025-04-30 22:36:15 -07:00
Daniel Han
64cf5d8e64 Update pyproject.toml 2025-04-30 22:35:22 -07:00
Daniel Han
599a15ea8d Update pyproject.toml 2025-04-30 22:34:07 -07:00
Daniel Han
86a4506309 Update synthetic.py 2025-04-30 12:58:58 -07:00
Daniel Han
676febe4f0 Update synthetic.py 2025-04-30 11:17:00 -07:00
Daniel Han
62d3a9aee2 Update synthetic.py 2025-04-30 10:49:13 -07:00
Daniel Han
a075028f00 Update synthetic.py 2025-04-30 10:22:31 -07:00
Daniel Han
e27063fd5c Update synthetic.py 2025-04-30 10:22:01 -07:00
Daniel Han
71095ce435 Update synthetic.py 2025-04-30 10:08:50 -07:00
Daniel Han
f7bd9718bb Update synthetic.py 2025-04-30 10:07:49 -07:00
Daniel Han
4c20d2a499 Update synthetic.py 2025-04-30 10:07:38 -07:00
Daniel Han
e0ba82eebb Update synthetic.py 2025-04-30 09:59:54 -07:00
Daniel Han
40b623a61d Update synthetic.py 2025-04-30 09:49:27 -07:00
Daniel Han
e08a4ceeb1 Update synthetic.py 2025-04-30 09:48:53 -07:00
Daniel Han
b60af64236 Update synthetic.py 2025-04-30 09:40:13 -07:00
Daniel Han
72b84b8e73 Update synthetic.py 2025-04-30 09:32:57 -07:00
Daniel Han
bc7ac80890 Update synthetic.py 2025-04-30 09:30:33 -07:00
Daniel Han
237075e18e Update synthetic.py 2025-04-30 09:25:46 -07:00
Daniel Han
1236aa851f Update synthetic.py 2025-04-30 09:25:27 -07:00
Daniel Han
b91e804a75 Update synthetic.py 2025-04-30 09:24:31 -07:00
Daniel Han
44cf9b6d37 Update synthetic.py 2025-04-30 09:22:40 -07:00
Daniel Han
6d3f8871d1 Update synthetic.py 2025-04-30 09:21:05 -07:00
Daniel Han
621a1316d6 Update synthetic.py 2025-04-30 09:19:23 -07:00
Daniel Han
c6d8158389 Update synthetic.py 2025-04-30 08:57:23 -07:00
Daniel Han
6d2bb0eda2 Update synthetic.py 2025-04-30 08:56:01 -07:00
Daniel Han
390d55ee8e Update synthetic.py 2025-04-30 08:52:26 -07:00
Daniel Han
69323c5498 Update synthetic.py 2025-04-30 08:50:27 -07:00
Daniel Han
7e70c81342 Update synthetic.py 2025-04-30 08:49:04 -07:00
Daniel Han
45a173217c Update synthetic.py 2025-04-30 08:47:23 -07:00
Daniel Han
ca3db2980d Update synthetic.py 2025-04-30 08:45:04 -07:00
Daniel Han
6c122be95e Update loader.py 2025-04-30 08:44:15 -07:00
Daniel Han
ec9892f636 Update synthetic.py 2025-04-30 08:39:49 -07:00
Daniel Han
ed9709bdcf Xet and Synthetic 2025-04-30 08:37:56 -07:00
Daniel Han
fd07824f0f Update mapper.py 2025-04-30 07:35:02 -07:00
Daniel Han
bf19381ea7 Merge branch 'main' into nightly 2025-04-30 07:31:43 -07:00
Daniel Han
43d483122f Merge branch 'main' of https://github.com/unslothai/unsloth 2025-04-30 07:31:34 -07:00
Daniel Han
46a0d8c7e5 Synthetic data 2025-04-30 07:31:27 -07:00
Michael Han
f4283a800e Merge pull request #2439 from Etherll/patch-1 
Update mapper.py to add Qwen3 base
 2025-04-30 06:18:46 -07:00
Daniel Han
6bde1af86e Update synthetic.py 2025-04-30 05:21:36 -07:00