jeromeku
|
7fbde42bc1
|
refactor model registration tests for new registry apis
|
2025-03-31 17:22:26 -07:00 |
|
jeromeku
|
02fbb8780e
|
add global register models
|
2025-03-31 17:11:35 -07:00 |
|
jeromeku
|
a2a4366430
|
refactor naming for mistral and phi
|
2025-03-31 17:08:11 -07:00 |
|
jeromeku
|
a7747263f6
|
rename deepseek registration methods
|
2025-03-31 17:03:05 -07:00 |
|
jeromeku
|
6d4ede4152
|
rename model registration methods
|
2025-03-31 17:01:51 -07:00 |
|
jeromeku
|
4e1df71549
|
add mistral small to registry
|
2025-03-31 15:31:01 -07:00 |
|
jeromeku
|
6439e88498
|
remove redundant code when constructing model names
|
2025-03-31 15:06:08 -07:00 |
|
jeromeku
|
229ae10c66
|
add deepseek distill models
|
2025-03-31 12:04:57 -07:00 |
|
jeromeku
|
975d263fe7
|
add deepseek distill llama
|
2025-03-31 11:47:51 -07:00 |
|
jeromeku
|
17358e6495
|
add deepseek r1 zero
|
2025-03-31 11:32:21 -07:00 |
|
jeromeku
|
0755b457ad
|
add deepseek r1 base
|
2025-03-31 11:30:47 -07:00 |
|
jeromeku
|
d633179220
|
add deepseek v3
|
2025-03-31 11:23:22 -07:00 |
|
jeromeku
|
44e227bbf8
|
add phi
|
2025-03-31 10:22:50 -07:00 |
|
jeromeku
|
6b08fc37f6
|
add gemma3 to registry
|
2025-03-31 10:10:20 -07:00 |
|
jeromeku
|
baab018a73
|
add QwenQVQ to registry
|
2025-03-31 09:45:15 -07:00 |
|
jeromeku
|
1237075d9a
|
separate registration of base and instruct llama3.2
|
2025-03-31 09:35:11 -07:00 |
|
jeromeku
|
8dc3d66449
|
handle quant types per model size
|
2025-03-31 09:27:43 -07:00 |
|
jeromeku
|
6049310582
|
add option to include original model in registry
|
2025-03-31 09:09:34 -07:00 |
|
jeromeku
|
fdafa7841a
|
add qwen2.5 models to registry
|
2025-03-31 08:45:53 -07:00 |
|
jeromeku
|
fa95aa0fd9
|
fix quant tag mapping
|
2025-03-30 16:14:33 -07:00 |
|
jeromeku
|
03de6dfb6c
|
add llama model registration
|
2025-03-30 15:05:33 -07:00 |
|
jeromeku
|
c3a1affb23
|
remap literal quant types to QuantType Enum
|
2025-03-30 14:39:57 -07:00 |
|
jeromeku
|
7e2207c543
|
quant types -> Enum
|
2025-03-30 14:37:30 -07:00 |
|
jeromeku
|
de1fe25730
|
add llama vision
|
2025-03-30 11:44:52 -07:00 |
|
jeromeku
|
e70d035c50
|
start registry reog
|
2025-03-30 11:36:48 -07:00 |
|
jeromeku
|
310c59800a
|
remove deprecated key function
|
2025-03-30 11:06:59 -07:00 |
|
jeromeku
|
9899a72572
|
fix llama registration
|
2025-03-30 11:06:11 -07:00 |
|
jeromeku
|
7cd27638da
|
fix dataclass init
|
2025-03-30 10:58:51 -07:00 |
|
jeromeku
|
dc8f34e3f9
|
refactor global model info dicts to dataclasses
|
2025-03-30 10:43:00 -07:00 |
|
jeromeku
|
a5e7b3a357
|
move hf hub utils to unsloth/utils
|
2025-03-28 16:54:38 -07:00 |
|
jeromeku
|
f6dfa802a2
|
add model registry
|
2025-03-28 16:49:12 -07:00 |
|
Daniel Han
|
c493054d61
|
Merge branch 'main' into nightly
|
2025-03-26 05:21:24 -07:00 |
|
Daniel Han
|
158b25c30d
|
Bug Fixes (#2197)
* Update loader.py
* model names
* Gemma 3 chat template
* Bug fixes
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update llama.py
* Update llama.py
* Update rl.py
* Update chat_templates.py
* Update chat_templates.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update vision.py
* Revert
* Update _utils.py
* forced precision
* Autocast
* Update vision.py
* Update vision.py
* Update rl.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl.py
* vLLM fixes
* constexpr
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update save.py
* New models
* Triton windows update (#1976)
* Update pyproject.toml
* Update README.md
* Update RMS LayerNorm implementation, and list compr. change in chat templates (#1974)
* Update RMS LayerNorm implementation with optimizations and testing suite
* perf: optimize list comprehension in get_ollama_eos_tokens
* Update Zoo
* Update llama.py
* Update llama.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* grpo fix
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update rl.py
* Update _utils.py
* Version
* Update pyproject.toml
* Update llama.py
* Update llama.py
* bug fix #2008 (#2039)
* fix (#2051)
* Update loader.py
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* more prints
* Update loader.py
* LoRA 16bit fix
* Update vision.py
* Update vision.py
* Update _utils.py
* Update vision.py
* move forced float32
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* move print
* Update _utils.py
* disable bfloat16
* Fix forced float32
* move float32
* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075)
* Update _utils.py
* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080)
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:
```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```
This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
* fix error message (#2046)
* Update vision.py
* Update _utils.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Remove double generate patch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update mapper.py
* Update vision.py
* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091)
* fix: config.torch_dtype in LlamaModel_fast_forward_inference
* Update llama.py
* update for consistency
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* versioning
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* model_type_arch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* check
* Update _utils.py
* Update loader.py
* Update loader.py
* Remove prints
* Update _utils.py
* Update _utils.py
* versioning
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update vision.py
* HF Transfer
* fix(utils): add missing importlib import to fix NameError (#2134)
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
* Add QLoRA Train and Merge16bit Test (#2130)
* add reference and unsloth lora merging tests
* add test / dataset printing to test scripts
* allow running tests from repo root
* add qlora test readme
* more readme edits
* ruff formatting
* additional readme comments
* forgot to add actual tests
* add apache license
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Revert
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Bug fix
* Update mapper.py
* check SDPA for Mistral 3, Pixtral
* Update vision.py
* Versioning
* Update rl_replacements.py
---------
Co-authored-by: Akshay Behl <126911424+Captain-T2004@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Mukkesh Ganesh <mukmckenzie@gmail.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
|
2025-03-26 05:19:48 -07:00 |
|
Daniel Han
|
d4c0550cb4
|
Update rl_replacements.py
|
2025-03-26 05:18:18 -07:00 |
|
Daniel Han
|
86c6060aaa
|
Versioning
|
2025-03-26 04:29:44 -07:00 |
|
Daniel Han
|
75ce1068ef
|
Update vision.py
|
2025-03-26 04:13:43 -07:00 |
|
Daniel Han
|
b3c2975c16
|
check SDPA for Mistral 3, Pixtral
|
2025-03-26 04:11:27 -07:00 |
|
Daniel Han
|
bfa1b9f021
|
Update mapper.py
|
2025-03-26 03:54:57 -07:00 |
|
Daniel Han
|
10cfe6279f
|
Bug fix
|
2025-03-26 03:50:46 -07:00 |
|
Daniel Han
|
f9dd304320
|
Update vision.py
|
2025-03-26 03:13:48 -07:00 |
|
Daniel Han
|
26b0c83f69
|
Update vision.py
|
2025-03-25 23:46:35 -07:00 |
|
Daniel Han
|
9f34d47cb5
|
Update vision.py
|
2025-03-25 23:31:33 -07:00 |
|
Daniel Han
|
6ebcae0d7c
|
Update vision.py
|
2025-03-25 23:20:15 -07:00 |
|
Daniel Han
|
cafd05e02d
|
Update vision.py
|
2025-03-25 23:20:00 -07:00 |
|
Daniel Han
|
87dc533229
|
Revert
|
2025-03-25 23:17:19 -07:00 |
|
Daniel Han
|
9ceabbebcd
|
Update loader.py
|
2025-03-25 23:15:14 -07:00 |
|
Daniel Han
|
fce9e82866
|
Update loader.py
|
2025-03-25 23:13:26 -07:00 |
|
Daniel Han
|
781887fb9e
|
Update vision.py
|
2025-03-25 23:07:35 -07:00 |
|
Daniel Han
|
da6ad9fb8c
|
Update vision.py
|
2025-03-25 23:04:11 -07:00 |
|
Daniel Han
|
172fe3c126
|
Update vision.py
|
2025-03-25 22:50:08 -07:00 |
|