Daniel Han
71b22abd54
Update synthetic.py
2025-05-13 08:26:17 -07:00
Daniel Han
87adce5e61
Update synthetic.py
2025-05-13 08:25:48 -07:00
Daniel Han
829b79c050
Merge branch 'main' into nightly
2025-05-13 03:39:49 -07:00
Michael Han
99e12bcc78
Update README.md
2025-05-13 01:39:59 -07:00
Daniel Han
1b71e6d542
Update loader_utils.py
2025-05-12 21:06:30 -07:00
Daniel Han
c0ac1cdb01
Update pyproject.toml
2025-05-12 16:28:50 -07:00
feng lui
c9ca2096b7
vLLM Windows CUDA support [tested] ( #2158 )
...
* Update loader.py
change vllm installed check by transformers utils function
* Update llama.py
change vllm installed check by transformers utils function
* add sample notebook
* fix Indentation
* add global is_vLLM_available function
* Pythonic style
* Delete nb/Qwen2.5_(3B)-GRPO-windows.ipynb
Would be great to move it to https://github.com/unslothai/notebooks - appreciate it!
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-05-12 05:33:42 -07:00
Daniel Han
32ba81f076
Update pyproject.toml
2025-05-12 04:24:18 -07:00
Daniel Han
ac5fc0bc46
Fix Intel GPU
2025-05-12 03:10:21 -07:00
Lei Zhenyuan
6d61258dd3
[2/N] Enable intel GPU for unsloth ( #2388 )
...
* add DEVICE_TYPE and resolve device specific API
* reuse import torch
* move env under device typr
* resolve comments
* add more comments
* add more comments
2025-05-12 02:58:21 -07:00
Lei Zhenyuan
7215651d84
first pr for intel GPU, resolve __init__.py and pyproject.toml ( #2350 )
...
add better comments
2025-05-12 02:38:40 -07:00
Daniel Han
47c9ce4ab3
Fix GRPO eval
2025-05-12 02:35:31 -07:00
Michael Han
05bb37893a
Merge pull request #2466 from mmathew23/fix_pop_token_type_ids
...
the pixtral vision notebook fails during inference
2025-05-09 14:57:31 -07:00
Michael Han
9eb086acd8
Merge pull request #2492 from yuanzhedong/yz/dev/fix-readme
...
Fix readme example
2025-05-07 23:29:59 -07:00
Yuanzhe Dong
bfbf1f886d
Fix readme example
2025-05-06 19:26:35 -07:00
Michael Han
4ac9529cc0
Update README.md
...
Adding extra synthetic data notebook, cleaning repo
2025-05-05 20:56:01 -07:00
Daniel Han
d977d1064f
Update __init__.py
2025-05-04 18:06:39 -07:00
Michael Han
732cf5bcc2
Uploading HQ Unsloth Sticker
2025-05-04 05:31:57 -07:00
Michael Han
aa6089b3f2
Updating HQ logos
2025-05-04 05:25:06 -07:00
Daniel Han
a6439e9424
Better vllm deletion
2025-05-04 05:03:58 -07:00
Daniel Han
718961ded9
Update pyproject.toml
2025-05-04 04:29:10 -07:00
Daniel Han
08afb5001e
Update _utils.py
2025-05-04 03:03:50 -07:00
Michael Han
c4e1bd9b52
Update README.md
2025-05-02 23:14:34 -07:00
Daniel Han
cae0612e1d
Update pyproject.toml
2025-05-02 22:52:58 -07:00
Daniel Han
adf6d00c06
Update pyproject.toml
2025-05-02 22:47:09 -07:00
Daniel Han
d922366112
Update pyproject.toml
2025-05-02 22:40:12 -07:00
Roland Tannous
b462943bde
Added missing code of conduct ( #2416 )
...
* Added code of conduct
* fixed CONTRIBUTING -> CODE_OF_CONDUCT url link
2025-05-02 21:08:27 -07:00
Johnny
27a558a456
Update pyproject.toml ( #2458 )
2025-05-02 21:07:59 -07:00
jeromeku
1050117310
MoE Kernel ( #2465 )
...
* add moe grouped gemm kernel
* add benchmark, README
* remove formatting from __init__.py
2025-05-02 20:59:23 -07:00
Mathew Mathew
9e4b1ef70c
the pixtral vision notebook fails during inferenc with unused kwargs token_type_ids. This fixes the error
2025-05-02 21:40:15 -05:00
Daniel Han
3857e67192
Bug fix
2025-05-02 14:06:14 -07:00
Daniel Han
5e51d53219
Fix Qwen 3 mapping
2025-05-02 09:44:01 -07:00
Michael Han
4a54ed8288
Update README.md
2025-05-02 09:06:57 -07:00
Daniel Han
6a6c213c3e
Qwen3 bug fixes
2025-05-02 07:18:33 -07:00
Daniel Han
fbc76fe7a9
Update mapper.py
2025-05-02 06:26:43 -07:00
Daniel Han
5510563417
Versioning
2025-05-02 05:05:09 -07:00
Daniel Han
90935a7106
Remove hf_xet warning
2025-05-02 04:23:53 -07:00
Daniel Han
03e7509c59
Update __init__.py
2025-05-02 03:43:44 -07:00
Daniel Han
c6b602c8c9
Merge branch 'main' of https://github.com/unslothai/unsloth
2025-05-02 03:09:52 -07:00
Daniel Han
3b401f8317
Qwen 3
2025-05-02 03:09:44 -07:00
cblomert
28a942b430
Added k_norm & q_norm to merged Qwen3 layers ( #2452 )
2025-05-02 03:07:37 -07:00
Michael Han
43115edaa4
Update README.md
...
Qwen3 notebook
2025-05-01 22:52:42 -07:00
Daniel Han
2e07ee2346
Nightly ( #2448 )
...
* move float32
* Ensure trust_remote_code propegates down to unsloth_compile_transformers (#2075 )
* Update _utils.py
* Show both `peft_error` and `autoconfig_error`, not just `autoconfig_error` (#2080 )
When loading a PEFT model fails, only the `autoconfig_error` is shown. Instead of the `peft_error`, which is what really matters when we're trying to load a PEFT adapter, the user will see something like this:
```
RuntimeError: Unrecognized model in my_model. Should have a `model_type` key in its config.json, or contain one of the following strings in its name: albert, align, altclip, ...
```
This PR just changes it so `autoconfig_error` and `peft_error` are both displayed.
* fix error message (#2046 )
* Update vision.py
* Update _utils.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update rl_replacements.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Remove double generate patch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update mapper.py
* Update vision.py
* fix: config.torch_dtype in LlamaModel_fast_forward_inference (#2091 )
* fix: config.torch_dtype in LlamaModel_fast_forward_inference
* Update llama.py
* update for consistency
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* versioning
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* model_type_arch
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* check
* Update _utils.py
* Update loader.py
* Update loader.py
* Remove prints
* Update README.md
typo
* Update _utils.py
* Update _utils.py
* versioning
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update vision.py
* HF Transfer
* fix(utils): add missing importlib import to fix NameError (#2134 )
This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.
* Add QLoRA Train and Merge16bit Test (#2130 )
* add reference and unsloth lora merging tests
* add test / dataset printing to test scripts
* allow running tests from repo root
* add qlora test readme
* more readme edits
* ruff formatting
* additional readme comments
* forgot to add actual tests
* add apache license
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Revert
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Bug fix
* Update mapper.py
* check SDPA for Mistral 3, Pixtral
* Update vision.py
* Versioning
* Update rl_replacements.py
* Update README.md
* add model registry
* move hf hub utils to unsloth/utils
* refactor global model info dicts to dataclasses
* fix dataclass init
* fix llama registration
* remove deprecated key function
* start registry reog
* add llama vision
* quant types -> Enum
* remap literal quant types to QuantType Enum
* add llama model registration
* fix quant tag mapping
* add qwen2.5 models to registry
* add option to include original model in registry
* handle quant types per model size
* separate registration of base and instruct llama3.2
* add QwenQVQ to registry
* add gemma3 to registry
* add phi
* add deepseek v3
* add deepseek r1 base
* add deepseek r1 zero
* add deepseek distill llama
* add deepseek distill models
* remove redundant code when constructing model names
* add mistral small to registry
* rename model registration methods
* rename deepseek registration methods
* refactor naming for mistral and phi
* add global register models
* refactor model registration tests for new registry apis
* add model search method
* remove deprecated registration api
* add quant type test
* add registry readme
* make llama registration more specific
* clear registry when executing individual model registration file
* more registry readme updates
* Update _auto_install.py
* Llama4
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Synthetic data
* Update mapper.py
* Xet and Synthetic
* Update synthetic.py
* Update loader.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
---------
Co-authored-by: Xander Hawthorne <167850078+CuppaXanax@users.noreply.github.com>
Co-authored-by: Isaac Breen <isaac.breen@icloud.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: lurf21 <93976703+lurf21@users.noreply.github.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2025-05-01 07:42:08 -07:00
Daniel Han
b893b8e6f8
Update synthetic.py
2025-05-01 07:41:45 -07:00
Daniel Han
643fb9e818
Update synthetic.py
2025-05-01 07:26:51 -07:00
Daniel Han
6f513ad3a8
Update pyproject.toml
2025-05-01 07:18:29 -07:00
Daniel Han
05bdd7822d
Update _utils.py
2025-05-01 07:17:36 -07:00
Daniel Han
e3bfb39b31
Update synthetic.py
2025-05-01 06:56:02 -07:00
Daniel Han
fc398c440e
Update synthetic.py
2025-05-01 06:55:43 -07:00
Daniel Han
fdfab3674f
Update synthetic.py
2025-05-01 06:49:46 -07:00
