ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
3,341 commits 391 branches 58 tags 304 MiB
Commit graph

3,341 commits

This branch
This branch
All branches
Author SHA1 Message Date
jeromeku
db1e94785e more template edits 2025-03-30 15:34:01 -07:00
jeromeku
3f85b33fb0 generalize documentation template 2025-03-30 15:21:47 -07:00
jeromeku
0f7c8c43b7 fix question template 2025-03-30 15:19:58 -07:00
jeromeku
0b5366cb1f clean up bug template 2025-03-30 15:19:00 -07:00
jeromeku
48f8db80c0 fix template labels 2025-03-30 15:11:00 -07:00
jeromeku
37f85cb520 add question template 2025-03-30 15:08:38 -07:00
jeromeku
3a7edad2dc Update custom.md 2025-03-30 15:06:42 -07:00
jeromeku
f8a4812aa8 Update issue templates 2025-03-30 15:06:42 -07:00
jeromeku
43d91745f0 Update issue templates 2025-03-30 15:06:41 -07:00
jeromeku
a765488768 Update and rename custom.md to documentation_request.md 2025-03-30 15:06:41 -07:00
jeromeku
2cccc7a1a0 Update issue templates 2025-03-30 15:06:41 -07:00
jeromeku
b78507a059 add llama model registration 2025-03-30 15:05:33 -07:00
jeromeku
7bb15a8806 remap literal quant types to QuantType Enum 2025-03-30 14:39:57 -07:00
jeromeku
01e67c20b1 quant types -> Enum 2025-03-30 14:37:30 -07:00
jeromeku
d7308fb984 add llama vision 2025-03-30 11:44:52 -07:00
jeromeku
73ac5bf9fb start registry reog 2025-03-30 11:36:48 -07:00
jeromeku
ab77cc7c0d remove deprecated key function 2025-03-30 11:06:59 -07:00
jeromeku
73c4c1702e fix llama registration 2025-03-30 11:06:11 -07:00
jeromeku
72da9ffd34 fix dataclass init 2025-03-30 10:58:51 -07:00
jeromeku
16fd50daeb refactor global model info dicts to dataclasses 2025-03-30 10:43:00 -07:00
jeromeku
5de4efe082 move hf hub utils to unsloth/utils 2025-03-28 16:54:38 -07:00
jeromeku
6522722f19 add model registry 2025-03-28 16:49:12 -07:00
datta0
da4f4d6a9f Enable qwen3 and qwen3moe 2025-03-28 05:58:01 +00:00
datta0
08f21535d9 Add Qwen3Moe and necessitate transformers version 2025-03-28 05:50:43 +00:00
datta0
7e928545b1 Initial support for Qwen3. Will udpate when the model is released 2025-03-27 14:35:57 +00:00
Michael Han
f6b8463b8d Update README.md 2025-03-27 00:26:18 -07:00
Jack Shi Wei Lun
0737a1403b Update README.md 2025-03-26 21:20:16 +08:00
Daniel Han
6cca9ff924 Merge branch 'main' into nightly 2025-03-26 05:21:24 -07:00
Daniel Han
bc790cc624 Bug Fixes (#2197) 
* Update loader.py

* model names

* Gemma 3 chat template

* Bug fixes

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update rl.py

* Update chat_templates.py

* Update chat_templates.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Revert

* Update _utils.py

* forced precision

* Autocast

* Update vision.py

* Update vision.py

* Update rl.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* vLLM fixes

* constexpr

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update save.py

* New models

* Triton windows update (#1976)

* Update pyproject.toml

* Update README.md

* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens

* Update Zoo

* Update llama.py

* Update llama.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* grpo fix

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update save.py

* Update rl.py

* Update _utils.py

* Version

* Update pyproject.toml

* Update llama.py

* Update llama.py

* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Remove double generate patch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)

* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* versioning

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* model_type_arch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* check

* Update _utils.py

* Update loader.py

* Update loader.py

* Remove prints

* Update _utils.py

* Update _utils.py

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update vision.py

* HF Transfer

* fix(utils): add missing importlib import to fix NameError (#2134)

This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.

* Add QLoRA Train and Merge16bit Test (#2130)

* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Revert

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Bug fix

* Update mapper.py

* check SDPA for Mistral 3, Pixtral

* Update vision.py

* Versioning

* Update rl_replacements.py

---------

Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
 2025-03-26 05:19:48 -07:00
Daniel Han
19da8369bd Update rl_replacements.py 2025-03-26 05:18:18 -07:00
Daniel Han
d02b105d62 Versioning 2025-03-26 04:29:44 -07:00
Daniel Han
7a581bdbe2 Update vision.py 2025-03-26 04:13:43 -07:00
Daniel Han
cb7157c4bf check SDPA for Mistral 3, Pixtral 2025-03-26 04:11:27 -07:00
Daniel Han
3710fe8384 Update mapper.py 2025-03-26 03:54:57 -07:00
Daniel Han
fcf162a476 Bug fix 2025-03-26 03:50:46 -07:00
Daniel Han
f754445f9f Update vision.py 2025-03-26 03:13:48 -07:00
Daniel Han
e0cc96f26f Update vision.py 2025-03-25 23:46:35 -07:00
Daniel Han
cfea901f64 Update vision.py 2025-03-25 23:31:33 -07:00
Daniel Han
1794cff6aa Update vision.py 2025-03-25 23:20:15 -07:00
Daniel Han
b58c264e05 Update vision.py 2025-03-25 23:20:00 -07:00
Daniel Han
0a8f92d6f7 Revert 2025-03-25 23:17:19 -07:00
Daniel Han
329a3a6663 Update loader.py 2025-03-25 23:15:14 -07:00
Daniel Han
eb0017194e Update loader.py 2025-03-25 23:13:26 -07:00
Daniel Han
b67c0f95dd Update vision.py 2025-03-25 23:07:35 -07:00
Daniel Han
966d6aabd3 Update vision.py 2025-03-25 23:04:11 -07:00
Daniel Han
09814321b4 Update vision.py 2025-03-25 22:50:08 -07:00
Daniel Han
ed081f2879 Update vision.py 2025-03-25 22:26:24 -07:00
Daniel Han
35dc57a8b4 Merge branch 'main' into nightly 2025-03-21 18:02:09 -07:00
Daniel Han
31c4a78945 Update pyproject.toml 2025-03-21 18:02:05 -07:00
Daniel Han
eb4796363b Merge branch 'main' into nightly 2025-03-21 17:55:39 -07:00