ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,879 commits 391 branches 58 tags 304 MiB
Commit graph

1,879 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
098692bd96 Update _utils.py 2025-03-18 01:05:58 -07:00
Daniel Han
28b96e7e77 Update vision.py 2025-03-18 01:01:46 -07:00
Kareem
5d87090e4d fix error message (#2046) 2025-03-17 21:46:20 -07:00
Isaac Breen
7eba1b9708 Show both peft_error and autoconfig_error, not just autoconfig_error (#2080) 
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
 2025-03-17 21:45:29 -07:00
Daniel Han
a22a6ba6bc Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-03-17 21:44:00 -07:00
Daniel Han
1bd7c733a6 Update _utils.py 2025-03-17 21:43:51 -07:00
Xander Hawthorne
04bcab022c Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075) 2025-03-17 21:43:47 -07:00
Daniel Han
ebf2a4abb6 move float32 2025-03-17 19:42:49 -07:00
Daniel Han
56a8dc6067 Fix forced float32 2025-03-17 19:24:21 -07:00
Daniel Han
a731e2fb6c disable bfloat16 2025-03-17 18:28:46 -07:00
Daniel Han
7dd9817bd0 Update _utils.py 2025-03-17 16:57:14 -07:00
Daniel Han
845a253ed4 move print 2025-03-17 04:51:28 -07:00
Daniel Han
f8d198a947 Update _utils.py 2025-03-17 04:49:26 -07:00
Daniel Han
96f4073208 Update _utils.py 2025-03-17 04:47:58 -07:00
Daniel Han
5a2c87fa5d Update _utils.py 2025-03-17 04:45:49 -07:00
Daniel Han
d247f1e20d Update _utils.py 2025-03-17 04:42:50 -07:00
Daniel Han
3679194e0e move forced float32 2025-03-17 04:41:44 -07:00
Daniel Han
947f201856 Update vision.py 2025-03-17 04:17:59 -07:00
Daniel Han
47a2492f87 Update _utils.py 2025-03-16 23:37:46 -07:00
Daniel Han
d50f42a8b4 Update vision.py 2025-03-16 23:27:59 -07:00
Daniel Han
74fc293c99 Update vision.py 2025-03-16 23:20:43 -07:00
Daniel Han
268930e2cd LoRA 16bit fix 2025-03-16 23:18:57 -07:00
Daniel Han
3c1dfe2f58 Update loader.py 2025-03-16 22:15:54 -07:00
Daniel Han
ce2884f563 more prints 2025-03-16 22:13:57 -07:00
Daniel Han
f01757601f Update vision.py 2025-03-16 22:10:36 -07:00
Daniel Han
1eafb4a3b3 Update pyproject.toml 2025-03-16 20:31:54 -07:00
Daniel Han
35caede8ea Update pyproject.toml 2025-03-16 20:30:46 -07:00
Daniel Han
4824e17063 Update loader.py 2025-03-16 20:18:53 -07:00
Kareem
136837e5cc fix (#2051) 2025-03-16 15:19:58 -07:00
Mukkesh Ganesh
745e0da8ae bug fix #2008 (#2039) 2025-03-16 15:19:14 -07:00
Daniel Han
9aa93db23c Update llama.py 2025-03-15 23:34:52 -07:00
Daniel Han
344e6616a8 Update llama.py 2025-03-15 22:39:09 -07:00
Daniel Han
7b020eff46 Update pyproject.toml 2025-03-15 19:40:02 -07:00
Daniel Han
10ab6e32b8 Version 2025-03-15 19:22:44 -07:00
Daniel Han
79aab4b74a Merge branch 'main' into nightly 2025-03-15 19:15:26 -07:00
Daniel Han
9233e42c9e Update _utils.py 2025-03-15 17:58:14 -07:00
Michael Han
d82a707a4a Update README.md 2025-03-15 17:47:25 -07:00
Daniel Han
ad08cb9730 Update rl.py 2025-03-15 17:13:18 -07:00
Daniel Han
50d41d6d9f Merge branch 'main' into nightly 2025-03-15 16:36:18 -07:00
Daniel Han
e1c24a01f8 Update README.md (#2028) 2025-03-14 22:06:53 -07:00
Daniel Han
05fdaff970 Gemma 3 readme (#2019) 
* Update README.md

* Update README.md

* Update README.md

---------

Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
 2025-03-14 11:12:02 -07:00
Daniel Han
71baea8e55 Update _utils.py 2025-03-14 10:04:10 -07:00
Daniel Han
0f1d78d8e4 Update save.py 2025-03-14 09:54:48 -07:00
Daniel Han
8cfe8a57e6 Precision issues 2025-03-14 08:33:33 -07:00
Daniel Han
b4cd82d59f Update vision.py 2025-03-14 08:19:02 -07:00
Daniel Han
360cc66779 Update _utils.py 2025-03-14 08:17:49 -07:00
Daniel Han
afd297d281 Update vision.py 2025-03-14 08:17:36 -07:00
Daniel Han
0f587bfe2c Update save.py 2025-03-14 08:08:43 -07:00
Daniel Han
b8aaf550a7 GGUF saving (#2017) 
* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update pyproject.toml

* Update pyproject.toml

* Export Model to ollama.com  (#1648)

* Ollama Export Model to ollama.com

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Check for model_name

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* subprocess use instead of requests | added check for ollama server

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model | fix

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Push to Ollama

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Update cross_entropy_loss.py

* torch_cuda_device

* Update utils.py

* Update utils.py

* Update utils.py

* device

* device

* Update loader.py

* Update llama.py

* Update README.md

* Update llama.py

* Update llama.py

* Update _utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* __version__

* Update rl.py

* Bug fixes

* Bug fixes

* Update llama.py

* Update _utils.py

* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Temporary patches

* Update loader.py

* model names

* Gemma 3 chat template

* Bug fixes

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update rl.py

* Update chat_templates.py

* Update chat_templates.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Revert

* Update _utils.py

* forced precision

* Autocast

* Update vision.py

* Update vision.py

* Update rl.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* vLLM fixes

* constexpr

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update save.py

* New models

* Triton windows update (#1976)

* Update pyproject.toml

* Update README.md

* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens

* Update Zoo

* Update llama.py

* Update llama.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* grpo fix

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update save.py

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
Co-authored-by: Jyotin Goel <120490013+gjyotin305@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
 2025-03-14 07:58:57 -07:00
Daniel Han
fecb6492de Update save.py 2025-03-14 07:56:56 -07:00