Daniel Han
26b0c83f69
Update vision.py
2025-03-25 23:46:35 -07:00
Daniel Han
9f34d47cb5
Update vision.py
2025-03-25 23:31:33 -07:00
Daniel Han
6ebcae0d7c
Update vision.py
2025-03-25 23:20:15 -07:00
Daniel Han
cafd05e02d
Update vision.py
2025-03-25 23:20:00 -07:00
Daniel Han
87dc533229
Revert
2025-03-25 23:17:19 -07:00
Daniel Han
9ceabbebcd
Update loader.py
2025-03-25 23:15:14 -07:00
Daniel Han
fce9e82866
Update loader.py
2025-03-25 23:13:26 -07:00
Daniel Han
781887fb9e
Update vision.py
2025-03-25 23:07:35 -07:00
Daniel Han
da6ad9fb8c
Update vision.py
2025-03-25 23:04:11 -07:00
Daniel Han
172fe3c126
Update vision.py
2025-03-25 22:50:08 -07:00
Daniel Han
3fdfff81e3
Update vision.py
2025-03-25 22:26:24 -07:00
Daniel Han
206465684a
Merge branch 'main' into nightly
2025-03-21 18:02:09 -07:00
Daniel Han
e80d642bc7
Update pyproject.toml
2025-03-21 18:02:05 -07:00
Daniel Han
d28b92997e
Merge branch 'main' into nightly
2025-03-21 17:55:39 -07:00
Daniel Han
05baf282c7
Fix Transformers 4.45 ( #2151 )
...
* Update pyproject.toml
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Batch samples
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update mapper.py
* Update vision.py
* Temporary patches
* Update loader.py
* model names
* Gemma 3 chat template
* Bug fixes
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update llama.py
* Update llama.py
* Update rl.py
* Update chat_templates.py
* Update chat_templates.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update vision.py
* Revert
* Update _utils.py
* forced precision
* Autocast
* Update vision.py
* Update vision.py
* Update rl.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl.py
* vLLM fixes
* constexpr
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update save.py
* New models
* Triton windows update (#1976 )
* Update pyproject.toml
* Update README.md
* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974 )
* Update RMS LayerNorm implementation with optimizations and testing suite
* perf: optimize list comprehension in get_ollama_eos_tokens
* Update Zoo
* Update llama.py
* Update llama.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* grpo fix
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update rl.py
* Update _utils.py
* Version
* Update pyproject.toml
* Update llama.py
* Update llama.py
* bug fix #2008 (#2039 )
* fix (#2051 )
* Update loader.py
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* more prints
* Update loader.py
* LoRA 16bit fix
* Update vision.py
* Update vision.py
* Update _utils.py
* Update vision.py
* move forced float32
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* move print
* Update _utils.py
* disable bfloat16
* Fix forced float32
* move float32
* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075 )
* Update _utils.py
* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080 )
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:
```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```
This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
* fix error message (#2046 )
* Update vision.py
* Update _utils.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Remove double generate patch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update mapper.py
* Update vision.py
* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091 )
* fix: config.torch_dtype in LlamaModel_fast_forward_inference
* Update llama.py
* update for consistency
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* versioning
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* model_type_arch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* check
* Update _utils.py
* Update loader.py
* Update loader.py
* Remove prints
* Update _utils.py
* Update _utils.py
* versioning
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update vision.py
* HF Transfer
* fix(utils): add missing importlib import to fix NameError (#2134 )
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
* Add QLoRA Train and Merge16bit Test (#2130 )
* add reference and unsloth lora merging tests
* add test / dataset printing to test scripts
* allow running tests from repo root
* add qlora test readme
* more readme edits
* ruff formatting
* additional readme comments
* forgot to add actual tests
* add apache license
* Update pyproject.toml
---------
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
2025-03-21 17:55:12 -07:00
Daniel Han
167b4824e7
Update pyproject.toml
2025-03-21 17:54:07 -07:00
jeromeku
1d7b57062b
Add QLoRA Train and Merge16bit Test ( #2130 )
...
* add reference and unsloth lora merging tests
* add test / dataset printing to test scripts
* allow running tests from repo root
* add qlora test readme
* more readme edits
* ruff formatting
* additional readme comments
* forgot to add actual tests
* add apache license
2025-03-21 17:53:37 -07:00
naliazheli
ef71732591
fix(utils): add missing importlib import to fix NameError ( #2134 )
...
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
2025-03-21 17:44:25 -07:00
Daniel Han
33194f1cf4
HF Transfer
2025-03-21 17:41:40 -07:00
Daniel Han
4d7e3a1d80
Update vision.py
2025-03-21 17:39:51 -07:00
Daniel Han
855695d04d
Update llama.py
2025-03-21 17:38:39 -07:00
Daniel Han
cd5e1955db
Update llama.py
2025-03-21 17:34:27 -07:00
Daniel Han
5ba087859a
Update llama.py
2025-03-21 17:26:20 -07:00
Daniel Han
0c995e8efc
Update llama.py
2025-03-21 17:24:41 -07:00
Daniel Han
a015c38295
Update llama.py
2025-03-21 17:14:52 -07:00
Daniel Han
1eba050ce8
Update llama.py
2025-03-21 17:13:14 -07:00
Daniel Han
62e4ae5e02
Update llama.py
2025-03-21 17:08:00 -07:00
Daniel Han
e716e1563a
Update llama.py
2025-03-21 17:06:06 -07:00
Daniel Han
beecad0c3a
Update llama.py
2025-03-21 17:05:43 -07:00
Daniel Han
ebb10cd91f
Update llama.py
2025-03-21 17:01:11 -07:00
Daniel Han
38dd9d1555
Update llama.py
2025-03-21 17:00:35 -07:00
Daniel Han
18ab3c1231
Update llama.py
2025-03-21 16:58:00 -07:00
Daniel Han
f26f7724f3
Update llama.py
2025-03-21 16:53:44 -07:00
Daniel Han
6ff1aa2095
Update llama.py
2025-03-21 16:50:29 -07:00
Daniel Han
1718438676
Update llama.py
2025-03-21 16:48:43 -07:00
Daniel Han
b5f672778d
Update llama.py
2025-03-21 16:44:10 -07:00
Daniel Han
f016b01089
Update llama.py
2025-03-21 16:42:32 -07:00
Daniel Han
f63306b1c0
Update llama.py
2025-03-21 15:50:32 -07:00
Daniel Han
6de56942e9
Update llama.py
2025-03-21 15:50:05 -07:00
Daniel Han
25ca0f8888
Update llama.py
2025-03-21 15:46:47 -07:00
Daniel Han
b728a014c5
Update llama.py
2025-03-21 15:44:38 -07:00
Daniel Han
6b5bab84d6
Update llama.py
2025-03-21 15:43:21 -07:00
Daniel Han
a0ebbb2119
Update llama.py
2025-03-21 15:39:43 -07:00
Daniel Han
7cd95f5f91
Update llama.py
2025-03-21 15:31:00 -07:00
Daniel Han
fa910abecf
Update llama.py
2025-03-21 15:27:47 -07:00
Daniel Han
2d4c40741b
Update _utils.py
2025-03-21 15:25:06 -07:00
Daniel Han
d94e161691
Update _utils.py
2025-03-21 15:24:17 -07:00
Daniel Han
cd49eaf3de
Update _utils.py
2025-03-21 15:20:48 -07:00
Daniel Han
8bffb7a9c3
versioning
2025-03-21 15:18:11 -07:00
Daniel Han
372979e72d
Update _utils.py
2025-03-21 15:17:40 -07:00
