ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,926 commits 391 branches 58 tags 304 MiB
Commit graph

1,926 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
b785bf63cd Update vision.py 2025-03-19 02:39:50 -07:00
Daniel Han
d2f1688205 Update vision.py 2025-03-19 02:29:32 -07:00
Daniel Han
58f3c94fce Update vision.py 2025-03-19 02:28:09 -07:00
Daniel Han
a38e5cb23b Update vision.py 2025-03-19 02:17:17 -07:00
Daniel Han
fd150a18ef Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-03-19 02:17:05 -07:00
Daniel Han
50490c03e9 versioning 2025-03-19 02:14:54 -07:00
lurf21
7d47557b77
 		fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091) 
* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-03-19 02:06:48 -07:00
Daniel Han
cca0d38ab9 Update vision.py 2025-03-19 02:04:12 -07:00
Daniel Han
0b95576bc4 Update mapper.py 2025-03-19 01:59:17 -07:00
Daniel Han
8aaaa44ced Update vision.py 2025-03-19 01:33:43 -07:00
Daniel Han
8f3658a159 Update vision.py 2025-03-19 01:31:26 -07:00
Daniel Han
36c052c8c3 Update vision.py 2025-03-18 23:53:39 -07:00
Daniel Han
9e04f883b5 Update vision.py 2025-03-18 23:42:26 -07:00
Daniel Han
d1ee347077 Update vision.py 2025-03-18 23:37:34 -07:00
Daniel Han
c6b956fd1f Remove double generate patch 2025-03-18 23:06:20 -07:00
Daniel Han
1098955794 Update vision.py 2025-03-18 22:46:30 -07:00
Daniel Han
369ce004df Update vision.py 2025-03-18 22:33:18 -07:00
Daniel Han
0f20d665bd Update vision.py 2025-03-18 22:29:55 -07:00
Daniel Han
f19967ea3e Update vision.py 2025-03-18 22:26:58 -07:00
Daniel Han
645493de9b Update vision.py 2025-03-18 21:08:07 -07:00
Daniel Han
2c41fc90c6 Update vision.py 2025-03-18 05:29:09 -07:00
Daniel Han
0f73f129aa Merge branch 'main' into nightly 2025-03-18 05:25:09 -07:00
Daniel Han
6df04a32f2
 		Many bug fixes (#2087) 
* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Temporary patches

* Update loader.py

* model names

* Gemma 3 chat template

* Bug fixes

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update rl.py

* Update chat_templates.py

* Update chat_templates.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Revert

* Update _utils.py

* forced precision

* Autocast

* Update vision.py

* Update vision.py

* Update rl.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* vLLM fixes

* constexpr

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update save.py

* New models

* Triton windows update (#1976)

* Update pyproject.toml

* Update README.md

* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens

* Update Zoo

* Update llama.py

* Update llama.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* grpo fix

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update save.py

* Update rl.py

* Update _utils.py

* Version

* Update pyproject.toml

* Update llama.py

* Update llama.py

* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

---------

Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
 2025-03-18 05:15:57 -07:00
Daniel Han
8753a59eb7 Update rl_replacements.py 2025-03-18 05:09:35 -07:00
Daniel Han
800a465110 Update vision.py 2025-03-18 05:01:27 -07:00
Daniel Han
558b0527be Update rl_replacements.py 2025-03-18 04:59:01 -07:00
Daniel Han
45377be18f Update vision.py 2025-03-18 04:51:06 -07:00
Daniel Han
a09f3dce3d Update vision.py 2025-03-18 04:50:18 -07:00
Daniel Han
beed394af5 Update vision.py 2025-03-18 04:49:35 -07:00
Daniel Han
ce766f21f7 Update vision.py 2025-03-18 03:45:55 -07:00
Daniel Han
b9e3455615 Update vision.py 2025-03-18 02:27:20 -07:00
Daniel Han
8d2885fe69 Update rl_replacements.py 2025-03-18 02:26:50 -07:00
Daniel Han
2a620fc7d8 Update rl_replacements.py 2025-03-18 02:23:03 -07:00
Daniel Han
e87368fc48 Update rl_replacements.py 2025-03-18 02:05:49 -07:00
Daniel Han
948626820f Update rl_replacements.py 2025-03-18 02:05:30 -07:00
Daniel Han
ea19392247 Update vision.py 2025-03-18 01:59:39 -07:00
Daniel Han
d767920e65 Update vision.py 2025-03-18 01:53:52 -07:00
Daniel Han
0372df7760 Update vision.py 2025-03-18 01:44:50 -07:00
Daniel Han
eb959caa68 Update vision.py 2025-03-18 01:43:34 -07:00
Daniel Han
d9e984e0f3 Update vision.py 2025-03-18 01:42:28 -07:00
Daniel Han
c965c860ff Update vision.py 2025-03-18 01:33:38 -07:00
Daniel Han
5d64bffa40 Update vision.py 2025-03-18 01:33:29 -07:00
Daniel Han
2e377bc6bf Update vision.py 2025-03-18 01:28:49 -07:00
Daniel Han
f0de41756d Update vision.py 2025-03-18 01:27:39 -07:00
Daniel Han
7fcda1a26e Update __init__.py 2025-03-18 01:10:14 -07:00
Daniel Han
aed7d20c46 Update __init__.py 2025-03-18 01:10:04 -07:00
Daniel Han
23bac1dae5 Update pyproject.toml 2025-03-18 01:09:51 -07:00
Daniel Han
50c98b5d90 Update _utils.py 2025-03-18 01:05:58 -07:00
Daniel Han
4756979ae9 Update vision.py 2025-03-18 01:01:46 -07:00
Kareem
0e54be4c44
 		fix error message (#2046) 2025-03-17 21:46:20 -07:00