ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,220 commits 391 branches 58 tags 304 MiB
Commit graph

1,220 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
2a12e2f93f Update utils.py 2025-02-05 04:02:40 -08:00
Daniel Han
04d2d4c959 Update llama.py 2025-02-05 02:56:16 -08:00
Daniel Han
f159e21e14 Update llama.py 2025-02-05 02:30:51 -08:00
Daniel Han
e3051647ae Fast Inference via vLLM 2025-02-05 02:21:15 -08:00
Daniel Han
d701b8fcec Update mapper.py 2025-02-03 19:43:52 -08:00
Daniel Han
655d853e60 Update utils.py 2025-02-03 15:43:40 -08:00
Daniel Han
f3a4d082fd Update utils.py 2025-02-02 17:12:21 -08:00
Daniel Han
67819bb57c Update utils.py 2025-02-02 17:07:31 -08:00
Daniel Han
19ae4b1864 Update utils.py 2025-02-02 17:04:37 -08:00
Daniel Han
3f1fcc619c Update utils.py 2025-02-02 17:00:24 -08:00
Daniel Han
13c6ef7904 Update utils.py 2025-02-02 16:31:28 -08:00
Daniel Han
91c1964ba4 Update utils.py 2025-02-02 16:29:26 -08:00
Daniel Han
8a6f9d4f05 Update utils.py 2025-02-02 16:26:55 -08:00
Daniel Han
379356c5f2 Update utils.py 2025-02-02 16:24:10 -08:00
Daniel Han
0f732c06b3 Update utils.py 2025-02-02 16:23:31 -08:00
Daniel Han
02c47526ea Update utils.py 2025-02-02 16:18:56 -08:00
Daniel Han
98a8899813 Update utils.py 2025-02-02 15:23:05 -08:00
Daniel Han
64f1e817b3 Update utils.py 2025-02-02 15:17:50 -08:00
Daniel Han
b6851a3760 Update llama.py 2025-02-02 14:54:58 -08:00
Daniel Han
693ae8ddfc Update llama.py 2025-02-02 14:51:14 -08:00
Daniel Han
88544eeb67 Update utils.py 2025-02-02 13:52:15 -08:00
Daniel Han
06188007ee Update llama.py 2025-02-02 13:49:25 -08:00
Daniel Han
00c4fab065 Update llama.py 2025-02-02 13:47:14 -08:00
Daniel Han
5a609b9d34 Faster inference? 2025-02-02 13:45:25 -08:00
Daniel Han
2eece58c27 Update llama.py 2025-02-02 04:00:47 -08:00
Daniel Han
6364232757 Update llama.py 2025-02-02 03:57:24 -08:00
Daniel Han
8123210d7e Update llama.py 2025-02-02 03:56:25 -08:00
Daniel Han
46d65ac993 Update llama.py 2025-02-02 03:56:13 -08:00
Daniel Han
3b63fd4dbf Update llama.py 2025-02-02 03:49:18 -08:00
Daniel Han
f23f5e1b59 Update llama.py 2025-02-02 02:23:53 -08:00
Daniel Han
3ca0abfb32 Update llama.py 2025-02-02 02:18:33 -08:00
Daniel Han
5c5761a72d Update llama.py 2025-02-02 02:15:54 -08:00
Daniel Han
11e43e9639 Update llama.py 2025-02-02 02:14:13 -08:00
Daniel Han
01cd3c3284 Update llama.py 2025-02-02 02:11:33 -08:00
Daniel Han
358e3c2f21 Update llama.py 2025-02-02 02:10:17 -08:00
Daniel Han
cbc3401649 Update llama.py 2025-02-02 02:06:13 -08:00
Daniel Han
0d680d87f4 Torch 2.6 support 2025-02-02 00:43:26 -08:00
Daniel Han
360f090a8e Merge branch 'main' into nightly 2025-02-01 23:46:58 -08:00
Daniel Han
a54bac5d14 Update _utils.py 2025-02-01 23:46:40 -08:00
Daniel Han
578ed29771 dim fix 2025-02-01 19:27:33 -08:00
Daniel Han
0dce4ffc2d Update gemma.py 2025-02-01 19:15:55 -08:00
Daniel Han
885d917645 Update gemma.py 2025-02-01 19:11:20 -08:00
Daniel Han
7ddeea39cc Update gemma.py 2025-02-01 19:02:36 -08:00
Daniel Han
caf252f193 Update gemma.py 2025-02-01 17:54:00 -08:00
Daniel Han
8bc38fe60c Mistral 24B, Qwen 2.5 VL support (#1598) 
* use exact model name

* Update save.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* print

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update vision.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update loader.py

* accurate_accumulation

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update pyproject.toml

* Update __init__.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Fix Triton heuristics

https://github.com/triton-lang/triton/issues/5224

* Update __init__.py

* Update __init__.py

* Update __init__.py

* Update __init__.py

* Xformers

* Update loader.py

* Update loader.py

* Rewind

* Update _utils.py

* Update _utils.py

* requires grad

* Update loader.py

* Update _utils.py

* Update loader.py

* changing model to base_model if peft model is already used

* Improve debugging experience (#1512)

* Create CONTRIBUTING.md (#1472)

Creating contributing guidelines

* Update CONTRIBUTING.md

improved sentence

* Improve logging control in `unsloth_compile_transformers` by conditionally redirecting stdout based on UNSLOTH_DISABLE_LOGGER environment variable

---------

Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>

* Update loader.py

* Update llama.py

* Update llama.py

* Revert "Update llama.py"

This reverts commit 67bb995878.

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Auto change is_bfloat16_supported

* Update llama.py

* Force data-type

* Update llama.py

* All attention refactor fix (#1491)

* change initilization of n_heads, n_kv_heads, hidden_size in llama.py

* do the same for cohere, mistral, gemma2, granite

* do the same for flexattention,cohere, mistral, granite

* Update llama.py

* Update llama.py

* Update granite to work with latest post_patch methods (#1502)

* Update granite to work with latest post_patch methods

* Pass position_embeddings for granite even if transformers<4.47

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Minor fixes for granite models (#1503)

* Update granite.py

Grab residual multiplier directly from layer

* Update llama.py

Version should read >= 4.47.1 as that is the version requiring the changes

* Update granite.py

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* support modelscope models and datasets (#1481)

* support modelscope

* change modelscope args

* remove useless import

* remove useless import

* fix

* wip

* fix

* remove useless code

* add readme

* add some comments

* change print to raise error

* update comment

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Merge branch 'main' into nightly

* Phi 4

* Update llama.py

* Torch.Cuda Is Available Condition and Warning (#1545)

* check for torch.cuda and triton if available
on my machine(mac m3) the cuda were not available

* Update pyproject.toml

* Update __init__.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update mistral.py

* Update mistral.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Fix

* Bug fixes

* Update mapper.py

* Add dropout to granite to match HF's implementation (#1557)

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>

* Update llama.py

* Update llama.py

* Bug fixes

* fix: flash_attn_detection_error (#1556)

* fix: flash_attn_detection_error

* Update _utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update mapper.py

---------

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
Co-authored-by: Itsuro Tajima <tajima@georepublic.de>
Co-authored-by: Muhammad Osama <muhammadosama1994@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Z <coffeevampirebusiness@gmail.com>
Co-authored-by: tastelikefeet <58414341+tastelikefeet@users.noreply.github.com>
Co-authored-by: AminWhat <88392440+aminwhat@users.noreply.github.com>
Co-authored-by: Zhe Zhang <2631992879@qq.com>
 2025-01-31 03:34:36 -08:00
Daniel Han
b082759291 Merge branch 'main' into nightly 2025-01-31 03:33:30 -08:00
Daniel Han
6e4ab3efee Update _utils.py 2025-01-31 03:33:24 -08:00
Daniel Han
054297b2c8 Merge branch 'main' into nightly 2025-01-31 03:02:42 -08:00
Daniel Han
830479ea48 Update mapper.py 2025-01-31 03:02:37 -08:00
Michael Han
7c0f204ff5 Merge pull request #1595 from unslothai/shimmyshimmer-patch-3 
Update README.md
 2025-01-30 21:05:57 -08:00