ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
2,735 commits 391 branches 58 tags 304 MiB
Commit graph

2,735 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
d2a038d5cb Update _utils.py 2025-08-18 05:28:30 -07:00
Roland Tannous
6facca167d
 		fix save_to_gguf_generic quantization_method type error (#3173) 2025-08-18 04:10:17 -07:00
Roland Tannous
b7fdfefdab
 		Convert generator expression to list to prevent potential bugs if the files variable is used multiple times in future modifications. (#3167) 2025-08-18 04:10:08 -07:00
Daniel Han
146b5f7fac Fix Blackwell 2025-08-18 03:46:39 -07:00
QL
13cb037b36
 		Update install instructions for latest vLLM release (#3175) 
1. Removed the `--extra-index-url https://wheels.vllm.ai/nightly` from the uv install instructions because this causes it to crash; Removing that flag solves the issue and is more stable overall. Tested with RTX 5090 CUDA 12.8 on Linux. 

2. Removed `uv pip install -U triton>=3.3.1` because triton 3.3.1 is already installed with the vllm command.
 2025-08-18 03:39:05 -07:00
Daniel Han
dc26a7a0eb
 		Nightly (#3169) 
* Fix mamba

* Update loader.py

* Update vision.py

* Update loader.py

* Filter vLLM standby logs (#3131)

* filter vLLM standby logs

* safeguard standby logger patch

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Add scaler

* Update llama.py

* Update _utils.py

* Versioning

* GPT OSS fix

* GPT OSS fix

* Update loader.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update llama.py

* Versioning

* Update mapper.py

---------

Co-authored-by: Datta Nimmaturi <venkatadattasainimmaturi@gmail.com>
 2025-08-15 05:03:38 -07:00
Daniel Han
92ea94e479 Update loader.py 2025-08-15 04:08:21 -07:00
Daniel Han
5fd61cf82d GPT OSS MXFP4 fix 2025-08-15 04:00:00 -07:00
Daniel Han
511841d349 Update tokenizer_utils.py 2025-08-14 19:30:33 -07:00
Daniel Han
0f2fc19076 Encoding UTF-8 2025-08-14 15:24:25 -07:00
Daniel Han
8b41001035
 		Fix GPT OSS (#3154) 
* Fix mamba

* Update loader.py

* Update vision.py

* Update loader.py

* Filter vLLM standby logs (#3131)

* filter vLLM standby logs

* safeguard standby logger patch

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Add scaler

* Update llama.py

* Update _utils.py

* Versioning

* GPT OSS fix

* GPT OSS fix

* Update loader.py

* Update vision.py

* Update vision.py

* Update loader.py

---------

Co-authored-by: Datta Nimmaturi <venkatadattasainimmaturi@gmail.com>
 2025-08-14 05:06:58 -07:00
Daniel Han
920b25b52c Update loader.py 2025-08-13 06:33:39 -07:00
Daniel Han
f18331c9d1
 		Nightly (#3148) 
* Fix mamba

* Update loader.py

* Update vision.py

* Update loader.py

* Filter vLLM standby logs (#3131)

* filter vLLM standby logs

* safeguard standby logger patch

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Add scaler

* Update llama.py

* Update _utils.py

* Versioning

---------

Co-authored-by: Datta Nimmaturi <venkatadattasainimmaturi@gmail.com>
 2025-08-13 06:12:38 -07:00
Michael Han
7dd4e1dd5d
 		Update README.md 2025-08-09 15:53:29 -07:00
Michael Han
79b46f71b2
 		Merge pull request #3120 from Etherll/patch-8825 
Add Qwen3 4B to mapper.py
 2025-08-08 14:31:31 -07:00
Etherll
8b80a00015
 		Update mapper.py 2025-08-08 23:27:21 +03:00
Michael Han
63199569fa
 		Update README.md 2025-08-08 12:14:38 -07:00
Daniel Han
96541982ad Update pyproject.toml 2025-08-08 11:49:56 -07:00
Daniel Han
c08da646e4 Update _utils.py 2025-08-08 11:48:13 -07:00
Daniel Han
2b78d95701 Update loader.py 2025-08-08 11:44:07 -07:00
Daniel Han
59e9ec06b6 Update loader.py 2025-08-08 11:38:03 -07:00
Daniel Han
c7183fa5c0 Merge branch 'main' into nightly 2025-08-08 10:55:52 -07:00
Daniel Han
164fd8c895 Update loader.py 2025-08-08 10:55:30 -07:00
Daniel Han
a70c8e2bcf Update _utils.py 2025-08-08 09:59:24 -07:00
Daniel Han
65d7912bf7 Update vision.py 2025-08-08 09:35:54 -07:00
Daniel Han
1a1d4f9bc9 Update vision.py 2025-08-08 09:31:38 -07:00
Michael Han
67e4fa58e8
 		Merge pull request #3110 from Etherll/qwen3-chat-template 
Add Qwen3 Instruct / Thinking chat templates
 2025-08-08 09:27:12 -07:00
Daniel Han
59d6457443 Update _utils.py 2025-08-08 09:16:37 -07:00
Daniel Han
f1be7e955f Update vision.py 2025-08-08 09:15:52 -07:00
Daniel Han
35ce4227ba Update chat_templates.py 2025-08-08 08:29:52 -07:00
Daniel Han
49b053c844 Update vision.py 2025-08-08 03:35:56 -07:00
Daniel Han
5a5cfc70a1 Update vision.py 2025-08-07 16:21:25 -07:00
Daniel Han
09f3663ed3 Update vision.py 2025-08-07 16:19:31 -07:00
Daniel Han
9ce4cef84b Merge branch 'main' into nightly 2025-08-07 16:19:20 -07:00
Etherll
fd1c5557f6
 		Update chat_templates.py 
add qwen3-instruct/thinking-chat-template
 2025-08-08 01:01:58 +03:00
Daniel Han
84c7e3dd65 Update loader.py 2025-08-07 09:38:49 -07:00
Daniel Han
5332b41003 Update loader.py 2025-08-07 09:38:24 -07:00
Daniel Han
ca35992c7a Update mapper.py 2025-08-07 08:15:59 -07:00
Daniel Han
10d6ffb5d0 Update vision.py 2025-08-07 07:13:40 -07:00
Daniel Han
25478f5171 Update vision.py 2025-08-07 07:10:36 -07:00
Daniel Han
078ca5e2a7 Update loader.py 2025-08-07 05:18:53 -07:00
Daniel Han
243283e5f5 Update vision.py 2025-08-07 05:03:21 -07:00
Daniel Han
6f99d65fdd Update mapper.py 2025-08-07 04:59:19 -07:00
Daniel Han
36bc2655fd Update pyproject.toml 2025-08-07 03:47:08 -07:00
Daniel Han
a783c1deed Update pyproject.toml 2025-08-07 03:43:25 -07:00
Daniel Han
bbddf37b7e Update pyproject.toml 2025-08-07 03:29:44 -07:00
Daniel Han
f1508c9259 GPT OSS fixes 2025-08-07 02:57:19 -07:00
DoubleMathew
76be074f26
 		gpt-oss manually call temporary patch (#3104) 
Co-authored-by: Mathew Mathew <mathew@Mathews-MacBook-Pro.local>
 2025-08-06 12:13:35 -07:00
Daniel Han
4d378762a1 Merge branch 'main' into nightly 2025-08-06 06:56:44 -07:00
Daniel Han
17688b54ea
 		Nightly (#3102) 
* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Debugging only

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Generic efficient GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* Remove debugging

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update llama.py

* Update rl_replacements.py

* versioning

* Update _utils.py

* Update vision.py

* Update mapper.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update _utils.py

* Update vision.py

* gradient checkpointing

* Gemma 3N fixes

* Update loader.py

* Versioning

* Gemma 3N fixes

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Fix setup.py

* setup.py

* Prints

* Update setup.py

* Update setup.py

* Update setup.py

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update pyproject.toml

* Update vision.py

* Update _utils.py

* Update __init__.py

* Update __init__.py

* Small fixes

* Update vision.py

* Update vision.py

* versioning

* Update __init__.py

* Update llama.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update vision.py

* Update vision.py

* compiler stance

* Update _utils.py

* Update pyproject.toml

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Revert "Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model me…" (#2990)

This reverts commit 204fc46e19.

* skip_guard_eval_unsafe fix

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update llama.py

* Update llama.py

* Fix `quantization_method`

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* check stride

* Cleanup

* Update rope_embedding.py

* Update gemma2.py

* Fix `set_stance`

* Update _utils.py

* Update vision.py
 2025-08-06 06:40:59 -07:00