ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,932 commits 391 branches 58 tags 304 MiB
Commit graph

1,932 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
f5569ca2b4 Update vision.py 2025-03-19 02:59:40 -07:00
Daniel Han
f2dffa4537 Update vision.py 2025-03-19 02:52:25 -07:00
Daniel Han
a706ec3d17 Update vision.py 2025-03-19 02:50:24 -07:00
Daniel Han
ab1441ccfd Update vision.py 2025-03-19 02:50:08 -07:00
Daniel Han
a6ae11a426 Update vision.py 2025-03-19 02:47:29 -07:00
Daniel Han
52c62b9420 Update vision.py 2025-03-19 02:41:43 -07:00
Daniel Han
69ab65dfc7 Update vision.py 2025-03-19 02:39:50 -07:00
Daniel Han
67b48d9db4 Update vision.py 2025-03-19 02:29:32 -07:00
Daniel Han
a4d9b192b5 Update vision.py 2025-03-19 02:28:09 -07:00
Daniel Han
17a6bc1bd4 Update vision.py 2025-03-19 02:17:17 -07:00
Daniel Han
c417b1f67e Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-03-19 02:17:05 -07:00
Daniel Han
333aff6e84 versioning 2025-03-19 02:14:54 -07:00
lurf21
00a98f17f5 fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091) 
* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-03-19 02:06:48 -07:00
Daniel Han
10d27a5179 Update vision.py 2025-03-19 02:04:12 -07:00
Daniel Han
09b1d254f8 Update mapper.py 2025-03-19 01:59:17 -07:00
Daniel Han
1f9e5769f3 Update vision.py 2025-03-19 01:33:43 -07:00
Daniel Han
d14b36e157 Update vision.py 2025-03-19 01:31:26 -07:00
Daniel Han
cdd005bf5a Update vision.py 2025-03-18 23:53:39 -07:00
Daniel Han
8886f3aa31 Update vision.py 2025-03-18 23:42:26 -07:00
Daniel Han
71c405eda5 Update vision.py 2025-03-18 23:37:34 -07:00
Daniel Han
2795865d6f Remove double generate patch 2025-03-18 23:06:20 -07:00
Daniel Han
897aef9899 Update vision.py 2025-03-18 22:46:30 -07:00
Daniel Han
3109603785 Update vision.py 2025-03-18 22:33:18 -07:00
Daniel Han
3622d7e76d Update vision.py 2025-03-18 22:29:55 -07:00
Daniel Han
f5c94ba3a7 Update vision.py 2025-03-18 22:26:58 -07:00
Daniel Han
8831d1d440 Update vision.py 2025-03-18 21:08:07 -07:00
Daniel Han
9660605540 Update vision.py 2025-03-18 05:29:09 -07:00
Daniel Han
1556e64864 Merge branch 'main' into nightly 2025-03-18 05:25:09 -07:00
Daniel Han
49eece4d94 Many bug fixes (#2087) 
* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Temporary patches

* Update loader.py

* model names

* Gemma 3 chat template

* Bug fixes

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update rl.py

* Update chat_templates.py

* Update chat_templates.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Revert

* Update _utils.py

* forced precision

* Autocast

* Update vision.py

* Update vision.py

* Update rl.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* vLLM fixes

* constexpr

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update save.py

* New models

* Triton windows update (#1976)

* Update pyproject.toml

* Update README.md

* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens

* Update Zoo

* Update llama.py

* Update llama.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* grpo fix

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update save.py

* Update rl.py

* Update _utils.py

* Version

* Update pyproject.toml

* Update llama.py

* Update llama.py

* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

---------

Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
 2025-03-18 05:15:57 -07:00
Daniel Han
53d1fac54f Update rl_replacements.py 2025-03-18 05:09:35 -07:00
Daniel Han
51503620cc Update vision.py 2025-03-18 05:01:27 -07:00
Daniel Han
3eb4d76b28 Update rl_replacements.py 2025-03-18 04:59:01 -07:00
Daniel Han
a8f24ea882 Update vision.py 2025-03-18 04:51:06 -07:00
Daniel Han
cc0b7135e3 Update vision.py 2025-03-18 04:50:18 -07:00
Daniel Han
fad1ad9122 Update vision.py 2025-03-18 04:49:35 -07:00
Daniel Han
aca62cfa01 Update vision.py 2025-03-18 03:45:55 -07:00
Daniel Han
141084e7a1 Update vision.py 2025-03-18 02:27:20 -07:00
Daniel Han
16237517de Update rl_replacements.py 2025-03-18 02:26:50 -07:00
Daniel Han
0c91c02196 Update rl_replacements.py 2025-03-18 02:23:03 -07:00
Daniel Han
a3f76fb4ad Update rl_replacements.py 2025-03-18 02:05:49 -07:00
Daniel Han
9a60fdce08 Update rl_replacements.py 2025-03-18 02:05:30 -07:00
Daniel Han
f906b6de13 Update vision.py 2025-03-18 01:59:39 -07:00
Daniel Han
043c9f12b8 Update vision.py 2025-03-18 01:53:52 -07:00
Daniel Han
28f80c8957 Update vision.py 2025-03-18 01:44:50 -07:00
Daniel Han
1f12ce24c8 Update vision.py 2025-03-18 01:43:34 -07:00
Daniel Han
1ce93de34b Update vision.py 2025-03-18 01:42:28 -07:00
Daniel Han
f095c5d51d Update vision.py 2025-03-18 01:33:38 -07:00
Daniel Han
f9dee6fd1f Update vision.py 2025-03-18 01:33:29 -07:00
Daniel Han
e1470efb3d Update vision.py 2025-03-18 01:28:49 -07:00
Daniel Han
6b7f14f5b1 Update vision.py 2025-03-18 01:27:39 -07:00