ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
2,731 commits 391 branches 58 tags 304 MiB
Commit graph

2,731 commits

This branch
This branch
All branches
Author SHA1 Message Date
QL
ea4b7c2c6b Update install instructions for latest vLLM release (#3175) 
1. Removed the `--extra-index-url https://wheels.vllm.ai/nightly` from the uv install instructions because this causes it to crash; Removing that flag solves the issue and is more stable overall. Tested with RTX 5090 CUDA 12.8 on Linux. 

2. Removed `uv pip install -U triton>=3.3.1` because triton 3.3.1 is already installed with the vllm command.
 2025-08-18 03:39:05 -07:00
Daniel Han
7e1581b929 Nightly (#3169) 
* Fix mamba

* Update loader.py

* Update vision.py

* Update loader.py

* Filter vLLM standby logs (#3131)

* filter vLLM standby logs

* safeguard standby logger patch

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Add scaler

* Update llama.py

* Update _utils.py

* Versioning

* GPT OSS fix

* GPT OSS fix

* Update loader.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update llama.py

* Versioning

* Update mapper.py

---------

Co-authored-by: Datta Nimmaturi <venkatadattasainimmaturi@gmail.com>
 2025-08-15 05:03:38 -07:00
Daniel Han
b45a977c8d Update loader.py 2025-08-15 04:08:21 -07:00
Daniel Han
64dff1456b GPT OSS MXFP4 fix 2025-08-15 04:00:00 -07:00
Daniel Han
bbac3e3de7 Update tokenizer_utils.py 2025-08-14 19:30:33 -07:00
Daniel Han
b11d9cc935 Encoding UTF-8 2025-08-14 15:24:25 -07:00
Daniel Han
abbf1f0a43 Fix GPT OSS (#3154) 
* Fix mamba

* Update loader.py

* Update vision.py

* Update loader.py

* Filter vLLM standby logs (#3131)

* filter vLLM standby logs

* safeguard standby logger patch

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Add scaler

* Update llama.py

* Update _utils.py

* Versioning

* GPT OSS fix

* GPT OSS fix

* Update loader.py

* Update vision.py

* Update vision.py

* Update loader.py

---------

Co-authored-by: Datta Nimmaturi <venkatadattasainimmaturi@gmail.com>
 2025-08-14 05:06:58 -07:00
Daniel Han
6b5fb59eb7 Update loader.py 2025-08-13 06:33:39 -07:00
Daniel Han
806bee2433 Nightly (#3148) 
* Fix mamba

* Update loader.py

* Update vision.py

* Update loader.py

* Filter vLLM standby logs (#3131)

* filter vLLM standby logs

* safeguard standby logger patch

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

* Update unsloth/models/_utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Add scaler

* Update llama.py

* Update _utils.py

* Versioning

---------

Co-authored-by: Datta Nimmaturi <venkatadattasainimmaturi@gmail.com>
 2025-08-13 06:12:38 -07:00
Michael Han
413ec45d8b Update README.md 2025-08-09 15:53:29 -07:00
Michael Han
230061cd48 Merge pull request #3120 from Etherll/patch-8825 
Add Qwen3 4B to mapper.py
 2025-08-08 14:31:31 -07:00
Etherll
b0004c0001 Update mapper.py 2025-08-08 23:27:21 +03:00
Michael Han
2a8ca1ef5a Update README.md 2025-08-08 12:14:38 -07:00
Daniel Han
9975cf889a Update pyproject.toml 2025-08-08 11:49:56 -07:00
Daniel Han
424e648005 Update _utils.py 2025-08-08 11:48:13 -07:00
Daniel Han
3fc4e4dff9 Update loader.py 2025-08-08 11:44:07 -07:00
Daniel Han
628bb6c97f Update loader.py 2025-08-08 11:38:03 -07:00
Daniel Han
20e7c33550 Merge branch 'main' into nightly 2025-08-08 10:55:52 -07:00
Daniel Han
84ff585855 Update loader.py 2025-08-08 10:55:30 -07:00
Daniel Han
b277a09401 Update _utils.py 2025-08-08 09:59:24 -07:00
Daniel Han
5931011d6c Update vision.py 2025-08-08 09:35:54 -07:00
Daniel Han
34a0f2901f Update vision.py 2025-08-08 09:31:38 -07:00
Michael Han
22326b7b15 Merge pull request #3110 from Etherll/qwen3-chat-template 
Add Qwen3 Instruct / Thinking chat templates
 2025-08-08 09:27:12 -07:00
Daniel Han
6220a4c700 Update _utils.py 2025-08-08 09:16:37 -07:00
Daniel Han
52c6458fdd Update vision.py 2025-08-08 09:15:52 -07:00
Daniel Han
8372b318c5 Update chat_templates.py 2025-08-08 08:29:52 -07:00
Daniel Han
34776a6b84 Update vision.py 2025-08-08 03:35:56 -07:00
Daniel Han
f83f3f0efe Update vision.py 2025-08-07 16:21:25 -07:00
Daniel Han
11b5136d99 Update vision.py 2025-08-07 16:19:31 -07:00
Daniel Han
82c4bd6005 Merge branch 'main' into nightly 2025-08-07 16:19:20 -07:00
Etherll
ab03d44d9b Update chat_templates.py 
add qwen3-instruct/thinking-chat-template
 2025-08-08 01:01:58 +03:00
Daniel Han
180917f148 Update loader.py 2025-08-07 09:38:49 -07:00
Daniel Han
aa96d65534 Update loader.py 2025-08-07 09:38:24 -07:00
Daniel Han
9889015485 Update mapper.py 2025-08-07 08:15:59 -07:00
Daniel Han
1a8eabebab Update vision.py 2025-08-07 07:13:40 -07:00
Daniel Han
accb7b1ead Update vision.py 2025-08-07 07:10:36 -07:00
Daniel Han
5a31edef5f Update loader.py 2025-08-07 05:18:53 -07:00
Daniel Han
4d89527df6 Update vision.py 2025-08-07 05:03:21 -07:00
Daniel Han
d605b629ec Update mapper.py 2025-08-07 04:59:19 -07:00
Daniel Han
a1746fc03e Update pyproject.toml 2025-08-07 03:47:08 -07:00
Daniel Han
b7dcf7e5ed Update pyproject.toml 2025-08-07 03:43:25 -07:00
Daniel Han
0171432daf Update pyproject.toml 2025-08-07 03:29:44 -07:00
Daniel Han
382042f3b0 GPT OSS fixes 2025-08-07 02:57:19 -07:00
DoubleMathew
92c024df79 gpt-oss manually call temporary patch (#3104) 
Co-authored-by: Mathew Mathew <mathew@Mathews-MacBook-Pro.local>
 2025-08-06 12:13:35 -07:00
Daniel Han
3cfdd5f59c Merge branch 'main' into nightly 2025-08-06 06:56:44 -07:00
Daniel Han
806f926750 Nightly (#3102) 
* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update pyproject.toml

* Delete .gitignore

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update _utils.py

* Update pyproject.toml

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update chat_templates.py

* Seasame force float16 / float32

* Fix Seasame

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* is_multimodal

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* UNSLOTH_DISABLE_STATIC_GENERATION

* Update vision.py

* Auto vision detection

* Sesame

* Whisper

* Update loader.py

* Update loader.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* logging

* Update pyproject.toml

* Update rl.py

* versioning

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* logits / temperature

* Update rl_replacements.py

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Debugging only

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Generic efficient GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* Remove debugging

* Update rl_replacements.py

* Update rl_replacements.py

* Update vision.py

* Update llama.py

* Update rl_replacements.py

* versioning

* Update _utils.py

* Update vision.py

* Update mapper.py

* Update loader.py

* Update mapper.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update _utils.py

* Update vision.py

* gradient checkpointing

* Gemma 3N fixes

* Update loader.py

* Versioning

* Gemma 3N fixes

* Update vision.py

* Update vision.py

* Update loader.py

* Update vision.py

* Fix setup.py

* setup.py

* Prints

* Update setup.py

* Update setup.py

* Update setup.py

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update pyproject.toml

* Update vision.py

* Update vision.py

* Update pyproject.toml

* Update vision.py

* Update _utils.py

* Update __init__.py

* Update __init__.py

* Small fixes

* Update vision.py

* Update vision.py

* versioning

* Update __init__.py

* Update llama.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update vision.py

* Update vision.py

* compiler stance

* Update _utils.py

* Update pyproject.toml

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Revert "Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model me…" (#2990)

This reverts commit 4021da634a.

* skip_guard_eval_unsafe fix

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update synthetic.py

* Update llama.py

* Update llama.py

* Fix `quantization_method`

* versioning

* Update _utils.py

* Update _utils.py

* Update _utils.py

* check stride

* Cleanup

* Update rope_embedding.py

* Update gemma2.py

* Fix `set_stance`

* Update _utils.py

* Update vision.py
 2025-08-06 06:40:59 -07:00
Daniel Han
45b6f6e860 Update vision.py 2025-08-06 06:37:03 -07:00
Daniel Han
57d858b27a Update _utils.py 2025-08-06 06:34:07 -07:00
Daniel Han
31fb573e1e Merge branch 'main' into nightly 2025-08-06 06:24:27 -07:00
Daniel Han
5fa56a5cda GPT-OSS 2025-08-06 06:21:28 -07:00