ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,911 commits 391 branches 58 tags 304 MiB
Commit graph

1,911 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
ea20b0a2fe Update vision.py 2025-03-18 22:46:30 -07:00
Daniel Han
724f994237 Update vision.py 2025-03-18 22:33:18 -07:00
Daniel Han
2ec02b6b82 Update vision.py 2025-03-18 22:29:55 -07:00
Daniel Han
206a898708 Update vision.py 2025-03-18 22:26:58 -07:00
Daniel Han
ac15d6ba84 Update vision.py 2025-03-18 21:08:07 -07:00
Daniel Han
4b635bef12 Update vision.py 2025-03-18 05:29:09 -07:00
Daniel Han
2b15768670 Merge branch 'main' into nightly 2025-03-18 05:25:09 -07:00
Daniel Han
a3f14dde3f Many bug fixes (#2087) 
* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Temporary patches

* Update loader.py

* model names

* Gemma 3 chat template

* Bug fixes

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update rl.py

* Update chat_templates.py

* Update chat_templates.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Revert

* Update _utils.py

* forced precision

* Autocast

* Update vision.py

* Update vision.py

* Update rl.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* vLLM fixes

* constexpr

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update save.py

* New models

* Triton windows update (#1976)

* Update pyproject.toml

* Update README.md

* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens

* Update Zoo

* Update llama.py

* Update llama.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* grpo fix

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update save.py

* Update rl.py

* Update _utils.py

* Version

* Update pyproject.toml

* Update llama.py

* Update llama.py

* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

---------

Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
 2025-03-18 05:15:57 -07:00
Daniel Han
98020933fe Update rl_replacements.py 2025-03-18 05:09:35 -07:00
Daniel Han
1b7ca6e3e1 Update vision.py 2025-03-18 05:01:27 -07:00
Daniel Han
3851ce78f9 Update rl_replacements.py 2025-03-18 04:59:01 -07:00
Daniel Han
aaf5003bad Update vision.py 2025-03-18 04:51:06 -07:00
Daniel Han
e24059fb03 Update vision.py 2025-03-18 04:50:18 -07:00
Daniel Han
f0fc74cd9b Update vision.py 2025-03-18 04:49:35 -07:00
Daniel Han
5d5602d260 Update vision.py 2025-03-18 03:45:55 -07:00
Daniel Han
b1e451249f Update vision.py 2025-03-18 02:27:20 -07:00
Daniel Han
8f6fcf8f52 Update rl_replacements.py 2025-03-18 02:26:50 -07:00
Daniel Han
fe73b86c61 Update rl_replacements.py 2025-03-18 02:23:03 -07:00
Daniel Han
442d3170e8 Update rl_replacements.py 2025-03-18 02:05:49 -07:00
Daniel Han
dd54005c74 Update rl_replacements.py 2025-03-18 02:05:30 -07:00
Daniel Han
965880360f Update vision.py 2025-03-18 01:59:39 -07:00
Daniel Han
0fcfce3d21 Update vision.py 2025-03-18 01:53:52 -07:00
Daniel Han
f0d2475e60 Update vision.py 2025-03-18 01:44:50 -07:00
Daniel Han
ee75d8b552 Update vision.py 2025-03-18 01:43:34 -07:00
Daniel Han
15a3d91675 Update vision.py 2025-03-18 01:42:28 -07:00
Daniel Han
abc50d7def Update vision.py 2025-03-18 01:33:38 -07:00
Daniel Han
dddd5de8f3 Update vision.py 2025-03-18 01:33:29 -07:00
Daniel Han
94e73495d1 Update vision.py 2025-03-18 01:28:49 -07:00
Daniel Han
afb2cfa36d Update vision.py 2025-03-18 01:27:39 -07:00
Daniel Han
7aaf36eefd Update __init__.py 2025-03-18 01:10:14 -07:00
Daniel Han
b130ae5e76 Update __init__.py 2025-03-18 01:10:04 -07:00
Daniel Han
acfee8ebfe Update pyproject.toml 2025-03-18 01:09:51 -07:00
Daniel Han
a7f984e22e Update _utils.py 2025-03-18 01:05:58 -07:00
Daniel Han
44f3ab88aa Update vision.py 2025-03-18 01:01:46 -07:00
Kareem
50e94d383a fix error message (#2046) 2025-03-17 21:46:20 -07:00
Isaac Breen
f80cc13149 Show both peft_error and autoconfig_error, not just autoconfig_error (#2080) 
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
 2025-03-17 21:45:29 -07:00
Daniel Han
46b3986304 Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-03-17 21:44:00 -07:00
Daniel Han
8373a00139 Update _utils.py 2025-03-17 21:43:51 -07:00
Xander Hawthorne
0738eac901 Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075) 2025-03-17 21:43:47 -07:00
Daniel Han
4fff3a484f move float32 2025-03-17 19:42:49 -07:00
Daniel Han
5ac30c10b0 Fix forced float32 2025-03-17 19:24:21 -07:00
Daniel Han
8766b15f9b disable bfloat16 2025-03-17 18:28:46 -07:00
Daniel Han
85cd214363 Update _utils.py 2025-03-17 16:57:14 -07:00
Daniel Han
311bdd6b63 move print 2025-03-17 04:51:28 -07:00
Daniel Han
308dcd703c Update _utils.py 2025-03-17 04:49:26 -07:00
Daniel Han
77670ab5f0 Update _utils.py 2025-03-17 04:47:58 -07:00
Daniel Han
5f04f870aa Update _utils.py 2025-03-17 04:45:49 -07:00
Daniel Han
0aadae45eb Update _utils.py 2025-03-17 04:42:50 -07:00
Daniel Han
c257d3f259 move forced float32 2025-03-17 04:41:44 -07:00
Daniel Han
d43b339ebd Update vision.py 2025-03-17 04:17:59 -07:00