ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
2,007 commits 391 branches 58 tags 304 MiB
Commit graph

2,007 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
3710fe8384 Update mapper.py 2025-03-26 03:54:57 -07:00
Daniel Han
fcf162a476 Bug fix 2025-03-26 03:50:46 -07:00
Daniel Han
f754445f9f Update vision.py 2025-03-26 03:13:48 -07:00
Daniel Han
e0cc96f26f Update vision.py 2025-03-25 23:46:35 -07:00
Daniel Han
cfea901f64 Update vision.py 2025-03-25 23:31:33 -07:00
Daniel Han
1794cff6aa Update vision.py 2025-03-25 23:20:15 -07:00
Daniel Han
b58c264e05 Update vision.py 2025-03-25 23:20:00 -07:00
Daniel Han
0a8f92d6f7 Revert 2025-03-25 23:17:19 -07:00
Daniel Han
329a3a6663 Update loader.py 2025-03-25 23:15:14 -07:00
Daniel Han
eb0017194e Update loader.py 2025-03-25 23:13:26 -07:00
Daniel Han
b67c0f95dd Update vision.py 2025-03-25 23:07:35 -07:00
Daniel Han
966d6aabd3 Update vision.py 2025-03-25 23:04:11 -07:00
Daniel Han
09814321b4 Update vision.py 2025-03-25 22:50:08 -07:00
Daniel Han
ed081f2879 Update vision.py 2025-03-25 22:26:24 -07:00
Daniel Han
35dc57a8b4 Merge branch 'main' into nightly 2025-03-21 18:02:09 -07:00
Daniel Han
31c4a78945 Update pyproject.toml 2025-03-21 18:02:05 -07:00
Daniel Han
eb4796363b Merge branch 'main' into nightly 2025-03-21 17:55:39 -07:00
Daniel Han
84c2871a22 Fix Transformers 4.45 (#2151) 
* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Temporary patches

* Update loader.py

* model names

* Gemma 3 chat template

* Bug fixes

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update rl.py

* Update chat_templates.py

* Update chat_templates.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Revert

* Update _utils.py

* forced precision

* Autocast

* Update vision.py

* Update vision.py

* Update rl.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* vLLM fixes

* constexpr

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update save.py

* New models

* Triton windows update (#1976)

* Update pyproject.toml

* Update README.md

* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens

* Update Zoo

* Update llama.py

* Update llama.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* grpo fix

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update save.py

* Update rl.py

* Update _utils.py

* Version

* Update pyproject.toml

* Update llama.py

* Update llama.py

* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Remove double generate patch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)

* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* versioning

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* model_type_arch

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* check

* Update _utils.py

* Update loader.py

* Update loader.py

* Remove prints

* Update _utils.py

* Update _utils.py

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update vision.py

* HF Transfer

* fix(utils): add missing importlib import to fix NameError (#2134)

This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.

* Add QLoRA Train and Merge16bit Test (#2130)

* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license

* Update pyproject.toml

---------

Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
 2025-03-21 17:55:12 -07:00
Daniel Han
a8cb852d6f Update pyproject.toml 2025-03-21 17:54:07 -07:00
jeromeku
656d19c899 Add QLoRA Train and Merge16bit Test (#2130) 
* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license
 2025-03-21 17:53:37 -07:00
naliazheli
1ddcee387e fix(utils): add missing importlib import to fix NameError (#2134) 
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
 2025-03-21 17:44:25 -07:00
Daniel Han
d56b82439d HF Transfer 2025-03-21 17:41:40 -07:00
Daniel Han
1a2ce2cb26 Update vision.py 2025-03-21 17:39:51 -07:00
Daniel Han
45cc03be71 Update llama.py 2025-03-21 17:38:39 -07:00
Daniel Han
2c84a69f73 Update llama.py 2025-03-21 17:34:27 -07:00
Daniel Han
f5e49ab58f Update llama.py 2025-03-21 17:26:20 -07:00
Daniel Han
e3a96ebbe4 Update llama.py 2025-03-21 17:24:41 -07:00
Daniel Han
41d7a3e8c1 Update llama.py 2025-03-21 17:14:52 -07:00
Daniel Han
0a750da927 Update llama.py 2025-03-21 17:13:14 -07:00
Daniel Han
a7a223070b Update llama.py 2025-03-21 17:08:00 -07:00
Daniel Han
0a9bfc59b7 Update llama.py 2025-03-21 17:06:06 -07:00
Daniel Han
e99808d571 Update llama.py 2025-03-21 17:05:43 -07:00
Daniel Han
2a29a006da Update llama.py 2025-03-21 17:01:11 -07:00
Daniel Han
f0b531b5b5 Update llama.py 2025-03-21 17:00:35 -07:00
Daniel Han
54a0ddeba4 Update llama.py 2025-03-21 16:58:00 -07:00
Daniel Han
2b91bc983d Update llama.py 2025-03-21 16:53:44 -07:00
Daniel Han
2c6f0fb24d Update llama.py 2025-03-21 16:50:29 -07:00
Daniel Han
0e76ffffad Update llama.py 2025-03-21 16:48:43 -07:00
Daniel Han
8720678ba6 Update llama.py 2025-03-21 16:44:10 -07:00
Daniel Han
1e103a3e23 Update llama.py 2025-03-21 16:42:32 -07:00
Daniel Han
d0c4b8109d Update llama.py 2025-03-21 15:50:32 -07:00
Daniel Han
0afd088a59 Update llama.py 2025-03-21 15:50:05 -07:00
Daniel Han
961a672158 Update llama.py 2025-03-21 15:46:47 -07:00
Daniel Han
8aeb3c0e1c Update llama.py 2025-03-21 15:44:38 -07:00
Daniel Han
9985182ed0 Update llama.py 2025-03-21 15:43:21 -07:00
Daniel Han
8d746c04b6 Update llama.py 2025-03-21 15:39:43 -07:00
Daniel Han
7ff2d3357f Update llama.py 2025-03-21 15:31:00 -07:00
Daniel Han
c659560c68 Update llama.py 2025-03-21 15:27:47 -07:00
Daniel Han
9799373b13 Update _utils.py 2025-03-21 15:25:06 -07:00
Daniel Han
33393783b9 Update _utils.py 2025-03-21 15:24:17 -07:00