ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,943 commits 391 branches 58 tags 304 MiB
Commit graph

1,943 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
03e91efbdf Merge branch 'main' into nightly 2025-03-19 05:37:36 -07:00
Daniel Han
013b18584a Update vision.py 2025-03-19 04:34:39 -07:00
Daniel Han
d45b1b17d8 Update vision.py 2025-03-19 04:30:06 -07:00
Michael Han
a379b256eb
 		Merge pull request #2110 from unslothai/shimmyshimmer-patch-1 
Updating new FFT 8bit support
 2025-03-19 04:24:32 -07:00
Michael Han
37dbadb366
 		Update README.md 2025-03-19 04:23:52 -07:00
Michael Han
1a43974dfe
 		Update README.md 2025-03-19 04:21:39 -07:00
Daniel Han
a9cbff5422 Update vision.py 2025-03-19 03:45:28 -07:00
Daniel Han
d1edf54817 Update vision.py 2025-03-19 03:27:49 -07:00
Daniel Han
37dd658804 Update vision.py 2025-03-19 03:20:55 -07:00
Daniel Han
e7128de4ba Update vision.py 2025-03-19 03:08:17 -07:00
Daniel Han
3bbdb99e7f model_type_arch 2025-03-19 03:03:43 -07:00
Daniel Han
8fda1f0f55 Update vision.py 2025-03-19 02:59:40 -07:00
Daniel Han
1b2b2d2a6b Update vision.py 2025-03-19 02:52:25 -07:00
Daniel Han
2ef2724543 Update vision.py 2025-03-19 02:50:24 -07:00
Daniel Han
95b4e83782 Update vision.py 2025-03-19 02:50:08 -07:00
Daniel Han
88f8a2e66d Update vision.py 2025-03-19 02:47:29 -07:00
Daniel Han
418ad9a6db Update vision.py 2025-03-19 02:41:43 -07:00
Daniel Han
b785bf63cd Update vision.py 2025-03-19 02:39:50 -07:00
Daniel Han
d2f1688205 Update vision.py 2025-03-19 02:29:32 -07:00
Daniel Han
58f3c94fce Update vision.py 2025-03-19 02:28:09 -07:00
Daniel Han
a38e5cb23b Update vision.py 2025-03-19 02:17:17 -07:00
Daniel Han
fd150a18ef Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-03-19 02:17:05 -07:00
Daniel Han
50490c03e9 versioning 2025-03-19 02:14:54 -07:00
lurf21
7d47557b77
 		fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091) 
* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-03-19 02:06:48 -07:00
Daniel Han
cca0d38ab9 Update vision.py 2025-03-19 02:04:12 -07:00
Daniel Han
0b95576bc4 Update mapper.py 2025-03-19 01:59:17 -07:00
Daniel Han
8aaaa44ced Update vision.py 2025-03-19 01:33:43 -07:00
Daniel Han
8f3658a159 Update vision.py 2025-03-19 01:31:26 -07:00
Daniel Han
36c052c8c3 Update vision.py 2025-03-18 23:53:39 -07:00
Daniel Han
9e04f883b5 Update vision.py 2025-03-18 23:42:26 -07:00
Daniel Han
d1ee347077 Update vision.py 2025-03-18 23:37:34 -07:00
Daniel Han
c6b956fd1f Remove double generate patch 2025-03-18 23:06:20 -07:00
Daniel Han
1098955794 Update vision.py 2025-03-18 22:46:30 -07:00
Daniel Han
369ce004df Update vision.py 2025-03-18 22:33:18 -07:00
Daniel Han
0f20d665bd Update vision.py 2025-03-18 22:29:55 -07:00
Daniel Han
f19967ea3e Update vision.py 2025-03-18 22:26:58 -07:00
Daniel Han
645493de9b Update vision.py 2025-03-18 21:08:07 -07:00
Daniel Han
2c41fc90c6 Update vision.py 2025-03-18 05:29:09 -07:00
Daniel Han
0f73f129aa Merge branch 'main' into nightly 2025-03-18 05:25:09 -07:00
Daniel Han
6df04a32f2
 		Many bug fixes (#2087) 
* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Temporary patches

* Update loader.py

* model names

* Gemma 3 chat template

* Bug fixes

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update rl.py

* Update chat_templates.py

* Update chat_templates.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Revert

* Update _utils.py

* forced precision

* Autocast

* Update vision.py

* Update vision.py

* Update rl.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* vLLM fixes

* constexpr

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update save.py

* New models

* Triton windows update (#1976)

* Update pyproject.toml

* Update README.md

* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens

* Update Zoo

* Update llama.py

* Update llama.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* grpo fix

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update save.py

* Update rl.py

* Update _utils.py

* Version

* Update pyproject.toml

* Update llama.py

* Update llama.py

* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

---------

Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
 2025-03-18 05:15:57 -07:00
Daniel Han
8753a59eb7 Update rl_replacements.py 2025-03-18 05:09:35 -07:00
Daniel Han
800a465110 Update vision.py 2025-03-18 05:01:27 -07:00
Daniel Han
558b0527be Update rl_replacements.py 2025-03-18 04:59:01 -07:00
Daniel Han
45377be18f Update vision.py 2025-03-18 04:51:06 -07:00
Daniel Han
a09f3dce3d Update vision.py 2025-03-18 04:50:18 -07:00
Daniel Han
beed394af5 Update vision.py 2025-03-18 04:49:35 -07:00
Daniel Han
ce766f21f7 Update vision.py 2025-03-18 03:45:55 -07:00
Daniel Han
b9e3455615 Update vision.py 2025-03-18 02:27:20 -07:00
Daniel Han
8d2885fe69 Update rl_replacements.py 2025-03-18 02:26:50 -07:00
Daniel Han
2a620fc7d8 Update rl_replacements.py 2025-03-18 02:23:03 -07:00