ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,186 commits 391 branches 58 tags 304 MiB
Commit graph

1,186 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
358e3c2f21 Update llama.py 2025-02-02 02:10:17 -08:00
Daniel Han
cbc3401649 Update llama.py 2025-02-02 02:06:13 -08:00
Daniel Han
0d680d87f4 Torch 2.6 support 2025-02-02 00:43:26 -08:00
Daniel Han
360f090a8e Merge branch 'main' into nightly 2025-02-01 23:46:58 -08:00
Daniel Han
a54bac5d14 Update _utils.py 2025-02-01 23:46:40 -08:00
Daniel Han
578ed29771 dim fix 2025-02-01 19:27:33 -08:00
Daniel Han
0dce4ffc2d Update gemma.py 2025-02-01 19:15:55 -08:00
Daniel Han
885d917645 Update gemma.py 2025-02-01 19:11:20 -08:00
Daniel Han
7ddeea39cc Update gemma.py 2025-02-01 19:02:36 -08:00
Daniel Han
caf252f193 Update gemma.py 2025-02-01 17:54:00 -08:00
Daniel Han
8bc38fe60c Mistral 24B, Qwen 2.5 VL support (#1598) 
* use exact model name

* Update save.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* print

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update vision.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update loader.py

* accurate_accumulation

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update pyproject.toml

* Update __init__.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Fix Triton heuristics

https://github.com/triton-lang/triton/issues/5224

* Update __init__.py

* Update __init__.py

* Update __init__.py

* Update __init__.py

* Xformers

* Update loader.py

* Update loader.py

* Rewind

* Update _utils.py

* Update _utils.py

* requires grad

* Update loader.py

* Update _utils.py

* Update loader.py

* changing model to base_model if peft model is already used

* Improve debugging experience (#1512)

* Create CONTRIBUTING.md (#1472)

Creating contributing guidelines

* Update CONTRIBUTING.md

improved sentence

* Improve logging control in `unsloth_compile_transformers` by conditionally redirecting stdout based on UNSLOTH_DISABLE_LOGGER environment variable

---------

Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>

* Update loader.py

* Update llama.py

* Update llama.py

* Revert "Update llama.py"

This reverts commit 67bb995878.

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Auto change is_bfloat16_supported

* Update llama.py

* Force data-type

* Update llama.py

* All attention refactor fix (#1491)

* change initilization of n_heads, n_kv_heads, hidden_size in llama.py

* do the same for cohere, mistral, gemma2, granite

* do the same for flexattention,cohere, mistral, granite

* Update llama.py

* Update llama.py

* Update granite to work with latest post_patch methods (#1502)

* Update granite to work with latest post_patch methods

* Pass position_embeddings for granite even if transformers<4.47

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Minor fixes for granite models (#1503)

* Update granite.py

Grab residual multiplier directly from layer

* Update llama.py

Version should read >= 4.47.1 as that is the version requiring the changes

* Update granite.py

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* support modelscope models and datasets (#1481)

* support modelscope

* change modelscope args

* remove useless import

* remove useless import

* fix

* wip

* fix

* remove useless code

* add readme

* add some comments

* change print to raise error

* update comment

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Merge branch 'main' into nightly

* Phi 4

* Update llama.py

* Torch.Cuda Is Available Condition and Warning (#1545)

* check for torch.cuda and triton if available
on my machine(mac m3) the cuda were not available

* Update pyproject.toml

* Update __init__.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update mistral.py

* Update mistral.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Fix

* Bug fixes

* Update mapper.py

* Add dropout to granite to match HF's implementation (#1557)

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>

* Update llama.py

* Update llama.py

* Bug fixes

* fix: flash_attn_detection_error (#1556)

* fix: flash_attn_detection_error

* Update _utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update mapper.py

---------

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
Co-authored-by: Itsuro Tajima <tajima@georepublic.de>
Co-authored-by: Muhammad Osama <muhammadosama1994@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Z <coffeevampirebusiness@gmail.com>
Co-authored-by: tastelikefeet <58414341+tastelikefeet@users.noreply.github.com>
Co-authored-by: AminWhat <88392440+aminwhat@users.noreply.github.com>
Co-authored-by: Zhe Zhang <2631992879@qq.com>
 2025-01-31 03:34:36 -08:00
Daniel Han
b082759291 Merge branch 'main' into nightly 2025-01-31 03:33:30 -08:00
Daniel Han
6e4ab3efee Update _utils.py 2025-01-31 03:33:24 -08:00
Daniel Han
054297b2c8 Merge branch 'main' into nightly 2025-01-31 03:02:42 -08:00
Daniel Han
830479ea48 Update mapper.py 2025-01-31 03:02:37 -08:00
Michael Han
7c0f204ff5 Merge pull request #1595 from unslothai/shimmyshimmer-patch-3 
Update README.md
 2025-01-30 21:05:57 -08:00
Michael Han
9ce5dbe14f Update README.md 2025-01-30 21:05:45 -08:00
Michael Han
b339b6a9cd Merge pull request #1580 from unslothai/shimmyshimmer-patch-2 
Update README.md
 2025-01-26 14:12:10 -08:00
Michael Han
c2f90d3dac Update README.md 
Updating super old benchmarks
 2025-01-26 14:11:58 -08:00
Daniel Han
52928b3f9a Fix triton.ops 2025-01-22 17:49:20 -08:00
Daniel Han
545e420ce6 move TritonOps 2025-01-22 16:56:01 -08:00
Daniel Han
efd5382708 triton.ops error 2025-01-22 16:53:35 -08:00
Daniel Han
78b756fd6e Update __init__.py 2025-01-22 16:46:54 -08:00
Daniel Han
8f95022daa Merge branch 'main' into nightly 2025-01-22 16:46:04 -08:00
Daniel Han
c7fe83ad4e Update __init__.py 2025-01-22 16:45:41 -08:00
Daniel Han
6f6a986215 Fix triton.ops missing Triton 3.2 2025-01-22 16:44:48 -08:00
Michael Han
485da1f135 Merge pull request #1569 from unslothai/shimmyshimmer-patch-1 
Update README.md
 2025-01-20 22:13:30 -08:00
Michael Han
92de7eb40c Update README.md 2025-01-20 22:13:07 -08:00
Daniel Han
3effbaf319 Update mapper.py 2025-01-20 08:10:20 -08:00
Daniel Han
65863f979e Fix Mistral, Qwen (#1565) 
* use exact model name

* Update save.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* print

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update vision.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update loader.py

* accurate_accumulation

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update pyproject.toml

* Update __init__.py

* Update pyproject.toml

* Update __init__.py

* Update __init__.py

* Fix Triton heuristics

https://github.com/triton-lang/triton/issues/5224

* Update __init__.py

* Update __init__.py

* Update __init__.py

* Update __init__.py

* Xformers

* Update loader.py

* Update loader.py

* Rewind

* Update _utils.py

* Update _utils.py

* requires grad

* Update loader.py

* Update _utils.py

* Update loader.py

* changing model to base_model if peft model is already used

* Improve debugging experience (#1512)

* Create CONTRIBUTING.md (#1472)

Creating contributing guidelines

* Update CONTRIBUTING.md

improved sentence

* Improve logging control in `unsloth_compile_transformers` by conditionally redirecting stdout based on UNSLOTH_DISABLE_LOGGER environment variable

---------

Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>

* Update loader.py

* Update llama.py

* Update llama.py

* Revert "Update llama.py"

This reverts commit 67bb995878.

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Auto change is_bfloat16_supported

* Update llama.py

* Force data-type

* Update llama.py

* All attention refactor fix (#1491)

* change initilization of n_heads, n_kv_heads, hidden_size in llama.py

* do the same for cohere, mistral, gemma2, granite

* do the same for flexattention,cohere, mistral, granite

* Update llama.py

* Update llama.py

* Update granite to work with latest post_patch methods (#1502)

* Update granite to work with latest post_patch methods

* Pass position_embeddings for granite even if transformers<4.47

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Minor fixes for granite models (#1503)

* Update granite.py

Grab residual multiplier directly from layer

* Update llama.py

Version should read >= 4.47.1 as that is the version requiring the changes

* Update granite.py

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* support modelscope models and datasets (#1481)

* support modelscope

* change modelscope args

* remove useless import

* remove useless import

* fix

* wip

* fix

* remove useless code

* add readme

* add some comments

* change print to raise error

* update comment

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Merge branch 'main' into nightly

* Phi 4

* Update llama.py

* Torch.Cuda Is Available Condition and Warning (#1545)

* check for torch.cuda and triton if available
on my machine(mac m3) the cuda were not available

* Update pyproject.toml

* Update __init__.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update mistral.py

* Update mistral.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Fix

* Bug fixes

* Update mapper.py

* Add dropout to granite to match HF's implementation (#1557)

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>

* Update llama.py

* Update llama.py

* Bug fixes

* fix: flash_attn_detection_error (#1556)

* fix: flash_attn_detection_error

* Update _utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

---------

Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
Co-authored-by: Itsuro Tajima <tajima@georepublic.de>
Co-authored-by: Muhammad Osama <muhammadosama1994@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Z <coffeevampirebusiness@gmail.com>
Co-authored-by: tastelikefeet <58414341+tastelikefeet@users.noreply.github.com>
Co-authored-by: AminWhat <88392440+aminwhat@users.noreply.github.com>
Co-authored-by: Zhe Zhang <2631992879@qq.com>
 2025-01-20 01:27:24 -08:00
Zhe Zhang
082b8d1e9c fix: flash_attn_detection_error (#1556) 
* fix: flash_attn_detection_error

* Update _utils.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-01-20 01:25:31 -08:00
Daniel Han
a99d3953d5 Bug fixes 2025-01-20 01:10:55 -08:00
Daniel Han
2f64408f6b Update llama.py 2025-01-19 19:19:08 -08:00
Daniel Han
d3bd1e82c2 Merge branch 'main' into nightly 2025-01-19 19:18:05 -08:00
Daniel Han
e67651e7c3 Update llama.py 2025-01-19 15:24:14 -08:00
Daniel Han
c028262085 Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly 2025-01-19 14:03:11 -08:00
Datta Nimmaturi
cc33bd05dc Add dropout to granite to match HF's implementation (#1557) 
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
 2025-01-19 03:54:12 -08:00
Daniel Han
3a36b5279b Update mapper.py 2025-01-19 01:37:13 -08:00
Daniel Han
57daf802ba Update issue templates 2025-01-17 00:43:11 -08:00
Daniel Han
76debb6817 Bug fixes 2025-01-16 03:09:02 -08:00
Daniel Han
69b09d80c8 Fix 2025-01-16 01:22:13 -08:00
Daniel Han
b99b2c5211 Update _utils.py 2025-01-16 01:18:15 -08:00
Daniel Han
7b144ebdaa Update _utils.py 2025-01-16 01:15:42 -08:00
Daniel Han
8cbfdd5aac Update _utils.py 2025-01-16 01:10:40 -08:00
Daniel Han
1262831bf2 Update _utils.py 2025-01-16 01:09:23 -08:00
Daniel Han
cf3291f278 Update _utils.py 2025-01-16 01:07:23 -08:00
Daniel Han
8ed010b4a5 Update mistral.py 2025-01-16 00:58:46 -08:00
Daniel Han
724cec30e9 Update mistral.py 2025-01-16 00:56:56 -08:00
AminWhat
e3a2dbbab6 Torch.Cuda Is Available Condition and Warning (#1545) 
* check for torch.cuda and triton if available
on my machine(mac m3) the cuda were not available

* Update pyproject.toml

* Update __init__.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-01-15 23:02:23 -08:00
Daniel Han
bf0fe0e63e Merge branch 'main' into nightly 2025-01-15 22:55:45 -08:00