ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,366 commits 391 branches 58 tags 304 MiB
Commit graph

1,366 commits

This branch
This branch
All branches
Author SHA1 Message Date
Datta Nimmaturi
e402be69b7 Fix grpo sleep regex and indentation (#2804) 2025-06-26 01:50:47 -07:00
Lei Zhenyuan
48d51bac5f fix for inductor no attribute prop.multi_processor_count (#2803) 2025-06-26 01:44:15 -07:00
DoubleMathew
c928612ee0 [4/N] Enable intel GPU for unsloth (#2801) 
* add code for xpu llama

* refine code

* change version check to 2.6.0

* remove unuse blank

* reslove commits

* Cleaned up statistics printing

* Update unsloth/models/_utils.py

---------

Co-authored-by: lei,zhenyuan <zhenyuan.lei@intel.com>
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-06-25 20:28:07 -07:00
Michael Han
b017f2395a Update README.md 
Updating links
 2025-06-25 01:32:24 -07:00
Lei Zhenyuan
dcf26ac3fb [3/N] Enable intel GPU for unsloth (#2620) 
* enable intel xpu changes within kernels

* reslove torch.version < 2.6

* change version check to 2.6.0

* resolve comments for torch_gpu_device

* resolve amp fwd comments

* fix typo

* change cuda default logic

* clean this pr

* add HAS_CUDA_STREAM as default False

* split GPU streams to cuda and xpu streams

* add optional
 2025-06-24 02:01:28 -07:00
DoubleMathew
0a14b795d0 move min_sms in is_big_gpu inside DEVICE_TYPE if else (#2792) 
log is not defined in torch inductor so remove

Remove log.warning entirely
 2025-06-23 18:57:55 -07:00
pluesclues
22c4d45d48 Fixed Sequence Classification errors, loaded model weirdly (#2793) 2025-06-23 18:56:56 -07:00
Michael Han
853a72592b Update issue templates 2025-06-23 05:34:46 -07:00
Daniel Han
97c10f9494 Update issue templates 2025-06-23 05:26:28 -07:00
Lei Zhenyuan
1ae3425b07 [5/N] Enable intel GPU for unsloth (#2768) 
* add is_big_gpu support for xpu

* make code unsloth's style
 2025-06-23 04:47:34 -07:00
kilavvy
1d5af06e00 Docs: Fix typo and improve MoE docstrings (#2784) 
* Update qwen3_moe.py

* Update interface.py
 2025-06-23 01:09:23 -07:00
Daniel Han
d7b0653a2a Fix GRPO (#2787) 
* Update _utils.py

* Update _utils.py

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update vision.py

* HF Transfer

* fix(utils): add missing importlib import to fix NameError (#2134)

This commit fixes a NameError that occurs when `importlib` is referenced in _utils.py
without being imported, especially when UNSLOTH_USE_MODELSCOPE=1 is enabled.
By adding the missing import statement, the code will no longer throw a NameError.

* Add QLoRA Train and Merge16bit Test (#2130)

* add reference and unsloth lora merging tests

* add test / dataset printing to test scripts

* allow running tests from repo root

* add qlora test readme

* more readme edits

* ruff formatting

* additional readme comments

* forgot to add actual tests

* add apache license

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Revert

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Bug fix

* Update mapper.py

* check SDPA for Mistral 3, Pixtral

* Update vision.py

* Versioning

* Update rl_replacements.py

* Update README.md

* add model registry

* move hf hub utils to unsloth/utils

* refactor global model info dicts to dataclasses

* fix dataclass init

* fix llama registration

* remove deprecated key function

* start registry reog

* add llama vision

* quant types -> Enum

* remap literal quant types to QuantType Enum

* add llama model registration

* fix quant tag mapping

* add qwen2.5 models to registry

* add option to include original model in registry

* handle quant types per model size

* separate registration of base and instruct llama3.2

* add QwenQVQ to registry

* add gemma3 to registry

* add phi

* add deepseek v3

* add deepseek r1 base

* add deepseek r1 zero

* add deepseek distill llama

* add deepseek distill models

* remove redundant code when constructing model names

* add mistral small to registry

* rename model registration methods

* rename deepseek registration methods

* refactor naming for mistral and phi

* add global register models

* refactor model registration tests for new registry apis

* add model search method

* remove deprecated registration api

* add quant type test

* add registry readme

* make llama registration more specific

* clear registry when executing individual model registration file

* more registry readme updates

* Update _auto_install.py

* Llama4

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Synthetic data

* Update mapper.py

* Xet and Synthetic

* Update synthetic.py

* Update loader.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

---------

Co-authored-by: naliazheli <nalia0316@gmail.com>
Co-authored-by: jeromeku <jerome.ku@gmail.com>
Co-authored-by: Jack Shi Wei Lun <87535974+jackswl@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
 2025-06-22 05:54:29 -07:00
Daniel Han
c7c6f2c88d Update rl.py 2025-06-21 23:29:08 -07:00
Daniel Han
d9be145849 Fix bf16 = None 2025-06-21 22:50:29 -07:00
Daniel Han
2f2930ee50 Update rl.py 2025-06-21 22:26:46 -07:00
Daniel Han
05867537c1 Update _utils.py 2025-06-21 22:20:46 -07:00
Daniel Han
d71dfb1d01 Update rl_replacements.py 2025-06-21 22:20:32 -07:00
Daniel Han
3461b987fd Fix DAPO, TRL 0.19.0 2025-06-21 22:14:21 -07:00
simpissa
8a202d6175 Fix for grpo_compute_loss_slow (#2702) 
* slice last logit

* move slicing
 2025-06-21 21:58:06 -07:00
Daniel Han
447ce0fb4f Mistral Small 3.2 2025-06-21 06:44:14 -07:00
amrothemich
ca150bb27a Update pyproject.toml (#2778) 
Switched pyproject license to dictionary type
 2025-06-21 02:44:24 -07:00
Michael Han
2a200e739a Merge pull request #2780 from rolandtannous/fix/gemma3-grpo-self-llm 
Fix AttributeError in GRPO trainer for models without llm attribute
 2025-06-20 21:15:54 -07:00
Roland Tannous
8c563abb87 Fix Gemma3ForCausalLm does not have attribute self.llm 2025-06-21 01:07:32 +00:00
Roland Tannous
061f038ec7 Additional tests for unsloth-zoo PR#174 2025-06-21 00:22:00 +00:00
Daniel Han
1be2a6e90a Merge branch 'main' of https://github.com/unslothai/unsloth 2025-06-20 06:30:43 -07:00
Daniel Han
d8846ebdfd Update pyproject.toml 2025-06-20 06:30:35 -07:00
marcandrelarochelle
481292a96a Fix TRL 1.8.2 (#2774) 
* Fix for TRL 1.8.2

Regex matching LLM initialization

* Update Regex
 2025-06-20 06:28:58 -07:00
Daniel Han
e43babe76f Update __init__.py 2025-06-20 06:13:45 -07:00
Daniel Han
2e9724f279 Fix bugs 2025-06-20 06:09:03 -07:00
Datta Nimmaturi
b87ff3f528 Enable vLLM to share memory space (#2712) 
* vLLM sleep once generation is done

* Make enable_sleep_model configurable

* Make default to false

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>

* Force standby under environment variable

---------

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
 2025-06-19 04:04:14 -07:00
Edd
a398484d0a Fix renaming on other model than Llama (#2762) 2025-06-18 13:38:36 -07:00
leopardracer
c6e0366e0d Fix Typos in Documentation and Comments (#2721) 
* Update ocr_eval.md

* Update backward.py
 2025-06-17 04:34:51 -07:00
pluesclues
440bbf5b52 Reward modeling update (There seems to be another patch) (#2710) 
* Update llama.py, sequence_classifcaiton update

* Update llama.py, adapting to original commit

* Update llama.py, for seqeuence classifcation update

* Update llama.py, added transformer import

* Update llama.py, dealt with output weight

* Update llama.py, renamed it peft model fast forward

* Update llama.py, set up is classification varaiable

* Update llama.py, updated lora dict to initialize sequence classification object

* Update llama.py, gets model name correctly before Lora dict is initialized

* Update llama.py, Task_type_SEQ_CLS doesnt work but it does work with Task_type.CAUSAL_LM
 2025-06-17 04:33:45 -07:00
Michael Han
ee76be7d58 Update issue templates 
Adding Reddit link
 2025-06-12 01:23:36 -07:00
Roland Tannous
efe2cc43a7 tests for additional merge fix unsloth zoo pr 163 (#2719) 
* tests for additional merge fix unsloth zoo pr 163

* fixed load_dataset indent in mistral perplexity test file
 2025-06-11 14:08:41 -07:00
Daniel Han
d535bf067e Versioning 2025-06-10 06:51:07 -07:00
user799595
19399e09f9 Making protobuf version more flexible (#2637) 
* Making protobuf version more flexible

* Update pyproject.toml

* Update pyproject.toml

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-06-10 04:13:25 -07:00
Daniel Han
af47cfb9a3 Update pyproject.toml 2025-06-10 04:04:25 -07:00
Lei Zhenyuan
fc78af6d76 add support for torch270 (#2709) 2025-06-10 03:59:15 -07:00
Daniel Han
16af0ceb8e versioning 2025-06-06 05:46:49 -07:00
Salpingopharyngeus
0012b13573 Ignore None to Subprocess_Commands (#2680) 
Ignores none params when building the subprocess_command for vllm. As none values stop vllm from deploying properly, as --quantize will be passed with none if quantization type isn't specified in the model name.
 2025-06-05 01:25:12 -07:00
DoubleMathew
aa50ef2862 Update prepare 4d causal attention call (#2678) 2025-06-04 12:58:50 -07:00
Daniel Han
8f465e21c5 Update rl.py 2025-06-03 00:07:52 -07:00
DoubleMathew
9bf691061d patch sft_trainer to favor max_seq_length over max_length in config (#2669) 2025-06-03 00:06:44 -07:00
DoubleMathew
90a4aacbf8 unsloth checkpointing fix for latest transformers==4.52.x (#2674) 2025-06-03 00:06:06 -07:00
Roland Tannous
58f3a6e29d reroute merge logic language models + comprehensive tests + eval kits (#2673) 2025-06-02 20:32:57 -07:00
RunFMe
332eabf309 Fix batched generation for prompts of different lengths (#2216) 
* fix ignoring of attention mask after prefill stage in decoding

* update naming to avoid confusion

---------

Co-authored-by: Неизвестный Пользователь722497 <dolegosmirnov@sberbank.ru>
 2025-06-02 03:59:10 -07:00
Michael Han
e76172c638 Merge pull request #2662 from Datta0/model_param_fix 
Fix quant model param fetch regex
 2025-06-01 04:19:12 -07:00
datta0
e8d6ede1fd Make replacement logic conscise 2025-06-01 05:57:43 +00:00
Michael Han
45a32bc599 Update issue templates 2025-05-31 14:38:55 -07:00