ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,943 commits 391 branches 58 tags 304 MiB
Commit graph

1,943 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
4bd2c00436 Merge branch 'main' into nightly 2025-03-19 05:37:36 -07:00
Daniel Han
ff7608bfa0 Update vision.py 2025-03-19 04:34:39 -07:00
Daniel Han
88dd06edbf Update vision.py 2025-03-19 04:30:06 -07:00
Michael Han
cac587d6fb Merge pull request #2110 from unslothai/shimmyshimmer-patch-1 
Updating new FFT 8bit support
 2025-03-19 04:24:32 -07:00
Michael Han
537621e39c Update README.md 2025-03-19 04:23:52 -07:00
Michael Han
3e19f5dfdf Update README.md 2025-03-19 04:21:39 -07:00
Daniel Han
28108608b8 Update vision.py 2025-03-19 03:45:28 -07:00
Daniel Han
3f90d0268b Update vision.py 2025-03-19 03:27:49 -07:00
Daniel Han
b9d6b5bc68 Update vision.py 2025-03-19 03:20:55 -07:00
Daniel Han
540a6b6aa3 Update vision.py 2025-03-19 03:08:17 -07:00
Daniel Han
d2c3a87060 model_type_arch 2025-03-19 03:03:43 -07:00
Daniel Han
59b542baaa Update vision.py 2025-03-19 02:59:40 -07:00
Daniel Han
5a522a2fbd Update vision.py 2025-03-19 02:52:25 -07:00
Daniel Han
53a9d17ef7 Update vision.py 2025-03-19 02:50:24 -07:00
Daniel Han
538d2167ca Update vision.py 2025-03-19 02:50:08 -07:00
Daniel Han
e3fe2cd2d6 Update vision.py 2025-03-19 02:47:29 -07:00
Daniel Han
68baacfbc6 Update vision.py 2025-03-19 02:41:43 -07:00
Daniel Han
65a4fc4e2d Update vision.py 2025-03-19 02:39:50 -07:00
Daniel Han
0b0cffe0e6 Update vision.py 2025-03-19 02:29:32 -07:00
Daniel Han
ca62733281 Update vision.py 2025-03-19 02:28:09 -07:00
Daniel Han
77dbbb6e74 Update vision.py 2025-03-19 02:17:17 -07:00
Daniel Han
5505445b70 Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-03-19 02:17:05 -07:00
Daniel Han
7c30fe0ca0 versioning 2025-03-19 02:14:54 -07:00
lurf21
59463ce864 fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091) 
* fix: config.torch_dtype in LlamaModel_fast_forward_inference

* Update llama.py

* update for consistency

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-03-19 02:06:48 -07:00
Daniel Han
08ccd3822c Update vision.py 2025-03-19 02:04:12 -07:00
Daniel Han
79df5d4523 Update mapper.py 2025-03-19 01:59:17 -07:00
Daniel Han
a1169ef8da Update vision.py 2025-03-19 01:33:43 -07:00
Daniel Han
5ae93e426d Update vision.py 2025-03-19 01:31:26 -07:00
Daniel Han
7c73c6d3d4 Update vision.py 2025-03-18 23:53:39 -07:00
Daniel Han
2d3ff4918b Update vision.py 2025-03-18 23:42:26 -07:00
Daniel Han
ee3b433288 Update vision.py 2025-03-18 23:37:34 -07:00
Daniel Han
ff8e0837e1 Remove double generate patch 2025-03-18 23:06:20 -07:00
Daniel Han
ea20b0a2fe Update vision.py 2025-03-18 22:46:30 -07:00
Daniel Han
724f994237 Update vision.py 2025-03-18 22:33:18 -07:00
Daniel Han
2ec02b6b82 Update vision.py 2025-03-18 22:29:55 -07:00
Daniel Han
206a898708 Update vision.py 2025-03-18 22:26:58 -07:00
Daniel Han
ac15d6ba84 Update vision.py 2025-03-18 21:08:07 -07:00
Daniel Han
4b635bef12 Update vision.py 2025-03-18 05:29:09 -07:00
Daniel Han
2b15768670 Merge branch 'main' into nightly 2025-03-18 05:25:09 -07:00
Daniel Han
a3f14dde3f Many bug fixes (#2087) 
* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Temporary patches

* Update loader.py

* model names

* Gemma 3 chat template

* Bug fixes

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update rl.py

* Update chat_templates.py

* Update chat_templates.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Revert

* Update _utils.py

* forced precision

* Autocast

* Update vision.py

* Update vision.py

* Update rl.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* vLLM fixes

* constexpr

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update save.py

* New models

* Triton windows update (#1976)

* Update pyproject.toml

* Update README.md

* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)

* Update RMS LayerNorm implementation with optimizations and testing suite

* perf: optimize list comprehension in get_ollama_eos_tokens

* Update Zoo

* Update llama.py

* Update llama.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* grpo fix

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update save.py

* Update rl.py

* Update _utils.py

* Version

* Update pyproject.toml

* Update llama.py

* Update llama.py

* bug fix #2008 (#2039)

* fix (#2051)

* Update loader.py

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* more prints

* Update loader.py

* LoRA 16bit fix

* Update vision.py

* Update vision.py

* Update _utils.py

* Update vision.py

* move forced float32

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* move print

* Update _utils.py

* disable bfloat16

* Fix forced float32

* move float32

* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)

* Update _utils.py

* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)

When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:

```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```

This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.

* fix error message (#2046)

* Update vision.py

* Update _utils.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update rl_replacements.py

* Update vision.py

* Update rl_replacements.py

---------

Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
 2025-03-18 05:15:57 -07:00
Daniel Han
98020933fe Update rl_replacements.py 2025-03-18 05:09:35 -07:00
Daniel Han
1b7ca6e3e1 Update vision.py 2025-03-18 05:01:27 -07:00
Daniel Han
3851ce78f9 Update rl_replacements.py 2025-03-18 04:59:01 -07:00
Daniel Han
aaf5003bad Update vision.py 2025-03-18 04:51:06 -07:00
Daniel Han
e24059fb03 Update vision.py 2025-03-18 04:50:18 -07:00
Daniel Han
f0fc74cd9b Update vision.py 2025-03-18 04:49:35 -07:00
Daniel Han
5d5602d260 Update vision.py 2025-03-18 03:45:55 -07:00
Daniel Han
b1e451249f Update vision.py 2025-03-18 02:27:20 -07:00
Daniel Han
8f6fcf8f52 Update rl_replacements.py 2025-03-18 02:26:50 -07:00
Daniel Han
fe73b86c61 Update rl_replacements.py 2025-03-18 02:23:03 -07:00