Commit graph

1,908 commits

Author SHA1 Message Date
Daniel Han
f19967ea3e Update vision.py 2025-03-18 22:26:58 -07:00
Daniel Han
645493de9b Update vision.py 2025-03-18 21:08:07 -07:00
Daniel Han
2c41fc90c6 Update vision.py 2025-03-18 05:29:09 -07:00
Daniel Han
0f73f129aa Merge branch 'main' into nightly 2025-03-18 05:25:09 -07:00
Daniel Han
6df04a32f2
Many bug fixes (#2087)
* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Temporary patches

* Update loader.py

* model names

* Gemma 3 chat template

* Bug fixes

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update rl.py

* Update chat_templates.py

* Update chat_templates.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Revert

* Update _utils.py

* forced precision

* Autocast

* Update vision.py

* Update vision.py

* Update rl.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* vLLM fixes

* constexpr

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update save.py

* New models

* Triton windows update (#1976)

* Update pyproject.toml

* Update README.md

* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens

* Update Zoo

* Update llama.py

* Update llama.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* grpo fix

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update save.py

* Update rl.py

* Update _utils.py

* Version

* Update pyproject.toml

* Update llama.py

* Update llama.py

* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

---------

Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
2025-03-18 05:15:57 -07:00
Daniel Han
8753a59eb7 Update rl_replacements.py 2025-03-18 05:09:35 -07:00
Daniel Han
800a465110 Update vision.py 2025-03-18 05:01:27 -07:00
Daniel Han
558b0527be Update rl_replacements.py 2025-03-18 04:59:01 -07:00
Daniel Han
45377be18f Update vision.py 2025-03-18 04:51:06 -07:00
Daniel Han
a09f3dce3d Update vision.py 2025-03-18 04:50:18 -07:00
Daniel Han
beed394af5 Update vision.py 2025-03-18 04:49:35 -07:00
Daniel Han
ce766f21f7 Update vision.py 2025-03-18 03:45:55 -07:00
Daniel Han
b9e3455615 Update vision.py 2025-03-18 02:27:20 -07:00
Daniel Han
8d2885fe69 Update rl_replacements.py 2025-03-18 02:26:50 -07:00
Daniel Han
2a620fc7d8 Update rl_replacements.py 2025-03-18 02:23:03 -07:00
Daniel Han
e87368fc48 Update rl_replacements.py 2025-03-18 02:05:49 -07:00
Daniel Han
948626820f Update rl_replacements.py 2025-03-18 02:05:30 -07:00
Daniel Han
ea19392247 Update vision.py 2025-03-18 01:59:39 -07:00
Daniel Han
d767920e65 Update vision.py 2025-03-18 01:53:52 -07:00
Daniel Han
0372df7760 Update vision.py 2025-03-18 01:44:50 -07:00
Daniel Han
eb959caa68 Update vision.py 2025-03-18 01:43:34 -07:00
Daniel Han
d9e984e0f3 Update vision.py 2025-03-18 01:42:28 -07:00
Daniel Han
c965c860ff Update vision.py 2025-03-18 01:33:38 -07:00
Daniel Han
5d64bffa40 Update vision.py 2025-03-18 01:33:29 -07:00
Daniel Han
2e377bc6bf Update vision.py 2025-03-18 01:28:49 -07:00
Daniel Han
f0de41756d Update vision.py 2025-03-18 01:27:39 -07:00
Daniel Han
7fcda1a26e Update __init__.py 2025-03-18 01:10:14 -07:00
Daniel Han
aed7d20c46 Update __init__.py 2025-03-18 01:10:04 -07:00
Daniel Han
23bac1dae5 Update pyproject.toml 2025-03-18 01:09:51 -07:00
Daniel Han
50c98b5d90 Update _utils.py 2025-03-18 01:05:58 -07:00
Daniel Han
4756979ae9 Update vision.py 2025-03-18 01:01:46 -07:00
Kareem
0e54be4c44
fix error message (#2046) 2025-03-17 21:46:20 -07:00
Isaac Breen
420380d829
Show both peft_error and autoconfig_error, not just autoconfig_error (#2080)
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
2025-03-17 21:45:29 -07:00
Daniel Han
e2dc4b37fa Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-03-17 21:44:00 -07:00
Daniel Han
997fa41db2 Update _utils.py 2025-03-17 21:43:51 -07:00
Xander Hawthorne
457fc127db
Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075) 2025-03-17 21:43:47 -07:00
Daniel Han
984273a405 move float32 2025-03-17 19:42:49 -07:00
Daniel Han
d3eaf9e10c Fix forced float32 2025-03-17 19:24:21 -07:00
Daniel Han
0cf990f53e disable bfloat16 2025-03-17 18:28:46 -07:00
Daniel Han
07ea763472 Update _utils.py 2025-03-17 16:57:14 -07:00
Daniel Han
78e85e3c16 move print 2025-03-17 04:51:28 -07:00
Daniel Han
3cf8d07875 Update _utils.py 2025-03-17 04:49:26 -07:00
Daniel Han
5ca4f5c381 Update _utils.py 2025-03-17 04:47:58 -07:00
Daniel Han
12de176afd Update _utils.py 2025-03-17 04:45:49 -07:00
Daniel Han
9f558850f0 Update _utils.py 2025-03-17 04:42:50 -07:00
Daniel Han
9a356a7f79 move forced float32 2025-03-17 04:41:44 -07:00
Daniel Han
6d596da2aa Update vision.py 2025-03-17 04:17:59 -07:00
Daniel Han
28b4128c2b Update _utils.py 2025-03-16 23:37:46 -07:00
Daniel Han
682de7427e Update vision.py 2025-03-16 23:27:59 -07:00
Daniel Han
82debd25cc Update vision.py 2025-03-16 23:20:43 -07:00