Daniel Han
|
02c47526ea
|
Update utils.py
|
2025-02-02 16:18:56 -08:00 |
|
Daniel Han
|
98a8899813
|
Update utils.py
|
2025-02-02 15:23:05 -08:00 |
|
Daniel Han
|
64f1e817b3
|
Update utils.py
|
2025-02-02 15:17:50 -08:00 |
|
Daniel Han
|
b6851a3760
|
Update llama.py
|
2025-02-02 14:54:58 -08:00 |
|
Daniel Han
|
693ae8ddfc
|
Update llama.py
|
2025-02-02 14:51:14 -08:00 |
|
Daniel Han
|
88544eeb67
|
Update utils.py
|
2025-02-02 13:52:15 -08:00 |
|
Daniel Han
|
06188007ee
|
Update llama.py
|
2025-02-02 13:49:25 -08:00 |
|
Daniel Han
|
00c4fab065
|
Update llama.py
|
2025-02-02 13:47:14 -08:00 |
|
Daniel Han
|
5a609b9d34
|
Faster inference?
|
2025-02-02 13:45:25 -08:00 |
|
Daniel Han
|
2eece58c27
|
Update llama.py
|
2025-02-02 04:00:47 -08:00 |
|
Daniel Han
|
6364232757
|
Update llama.py
|
2025-02-02 03:57:24 -08:00 |
|
Daniel Han
|
8123210d7e
|
Update llama.py
|
2025-02-02 03:56:25 -08:00 |
|
Daniel Han
|
46d65ac993
|
Update llama.py
|
2025-02-02 03:56:13 -08:00 |
|
Daniel Han
|
3b63fd4dbf
|
Update llama.py
|
2025-02-02 03:49:18 -08:00 |
|
Daniel Han
|
f23f5e1b59
|
Update llama.py
|
2025-02-02 02:23:53 -08:00 |
|
Daniel Han
|
3ca0abfb32
|
Update llama.py
|
2025-02-02 02:18:33 -08:00 |
|
Daniel Han
|
5c5761a72d
|
Update llama.py
|
2025-02-02 02:15:54 -08:00 |
|
Daniel Han
|
11e43e9639
|
Update llama.py
|
2025-02-02 02:14:13 -08:00 |
|
Daniel Han
|
01cd3c3284
|
Update llama.py
|
2025-02-02 02:11:33 -08:00 |
|
Daniel Han
|
358e3c2f21
|
Update llama.py
|
2025-02-02 02:10:17 -08:00 |
|
Daniel Han
|
cbc3401649
|
Update llama.py
|
2025-02-02 02:06:13 -08:00 |
|
Daniel Han
|
0d680d87f4
|
Torch 2.6 support
|
2025-02-02 00:43:26 -08:00 |
|
Daniel Han
|
360f090a8e
|
Merge branch 'main' into nightly
|
2025-02-01 23:46:58 -08:00 |
|
Daniel Han
|
a54bac5d14
|
Update _utils.py
|
2025-02-01 23:46:40 -08:00 |
|
Daniel Han
|
578ed29771
|
dim fix
|
2025-02-01 19:27:33 -08:00 |
|
Daniel Han
|
0dce4ffc2d
|
Update gemma.py
|
2025-02-01 19:15:55 -08:00 |
|
Daniel Han
|
885d917645
|
Update gemma.py
|
2025-02-01 19:11:20 -08:00 |
|
Daniel Han
|
7ddeea39cc
|
Update gemma.py
|
2025-02-01 19:02:36 -08:00 |
|
Daniel Han
|
caf252f193
|
Update gemma.py
|
2025-02-01 17:54:00 -08:00 |
|
Daniel Han
|
8bc38fe60c
|
Mistral 24B, Qwen 2.5 VL support (#1598)
* use exact model name
* Update save.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* print
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update vision.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* accurate_accumulation
* Update loader.py
* Update loader.py
* Update _utils.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update pyproject.toml
* Update __init__.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Fix Triton heuristics
https://github.com/triton-lang/triton/issues/5224
* Update __init__.py
* Update __init__.py
* Update __init__.py
* Update __init__.py
* Xformers
* Update loader.py
* Update loader.py
* Rewind
* Update _utils.py
* Update _utils.py
* requires grad
* Update loader.py
* Update _utils.py
* Update loader.py
* changing model to base_model if peft model is already used
* Improve debugging experience (#1512)
* Create CONTRIBUTING.md (#1472)
Creating contributing guidelines
* Update CONTRIBUTING.md
improved sentence
* Improve logging control in `unsloth_compile_transformers` by conditionally redirecting stdout based on UNSLOTH_DISABLE_LOGGER environment variable
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
* Update loader.py
* Update llama.py
* Update llama.py
* Revert "Update llama.py"
This reverts commit 67bb995878.
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Auto change is_bfloat16_supported
* Update llama.py
* Force data-type
* Update llama.py
* All attention refactor fix (#1491)
* change initilization of n_heads, n_kv_heads, hidden_size in llama.py
* do the same for cohere, mistral, gemma2, granite
* do the same for flexattention,cohere, mistral, granite
* Update llama.py
* Update llama.py
* Update granite to work with latest post_patch methods (#1502)
* Update granite to work with latest post_patch methods
* Pass position_embeddings for granite even if transformers<4.47
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Minor fixes for granite models (#1503)
* Update granite.py
Grab residual multiplier directly from layer
* Update llama.py
Version should read >= 4.47.1 as that is the version requiring the changes
* Update granite.py
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* support modelscope models and datasets (#1481)
* support modelscope
* change modelscope args
* remove useless import
* remove useless import
* fix
* wip
* fix
* remove useless code
* add readme
* add some comments
* change print to raise error
* update comment
* Update loader.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Merge branch 'main' into nightly
* Phi 4
* Update llama.py
* Torch.Cuda Is Available Condition and Warning (#1545)
* check for torch.cuda and triton if available
on my machine(mac m3) the cuda were not available
* Update pyproject.toml
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update mistral.py
* Update mistral.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix
* Bug fixes
* Update mapper.py
* Add dropout to granite to match HF's implementation (#1557)
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
* Update llama.py
* Update llama.py
* Bug fixes
* fix: flash_attn_detection_error (#1556)
* fix: flash_attn_detection_error
* Update _utils.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update mapper.py
---------
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
Co-authored-by: Itsuro Tajima <tajima@georepublic.de>
Co-authored-by: Muhammad Osama <muhammadosama1994@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Z <coffeevampirebusiness@gmail.com>
Co-authored-by: tastelikefeet <58414341+tastelikefeet@users.noreply.github.com>
Co-authored-by: AminWhat <88392440+aminwhat@users.noreply.github.com>
Co-authored-by: Zhe Zhang <2631992879@qq.com>
|
2025-01-31 03:34:36 -08:00 |
|
Daniel Han
|
b082759291
|
Merge branch 'main' into nightly
|
2025-01-31 03:33:30 -08:00 |
|
Daniel Han
|
6e4ab3efee
|
Update _utils.py
|
2025-01-31 03:33:24 -08:00 |
|
Daniel Han
|
054297b2c8
|
Merge branch 'main' into nightly
|
2025-01-31 03:02:42 -08:00 |
|
Daniel Han
|
830479ea48
|
Update mapper.py
|
2025-01-31 03:02:37 -08:00 |
|
Michael Han
|
7c0f204ff5
|
Merge pull request #1595 from unslothai/shimmyshimmer-patch-3
Update README.md
|
2025-01-30 21:05:57 -08:00 |
|
Michael Han
|
9ce5dbe14f
|
Update README.md
|
2025-01-30 21:05:45 -08:00 |
|
Michael Han
|
b339b6a9cd
|
Merge pull request #1580 from unslothai/shimmyshimmer-patch-2
Update README.md
|
2025-01-26 14:12:10 -08:00 |
|
Michael Han
|
c2f90d3dac
|
Update README.md
Updating super old benchmarks
|
2025-01-26 14:11:58 -08:00 |
|
Daniel Han
|
52928b3f9a
|
Fix triton.ops
|
2025-01-22 17:49:20 -08:00 |
|
Daniel Han
|
545e420ce6
|
move TritonOps
|
2025-01-22 16:56:01 -08:00 |
|
Daniel Han
|
efd5382708
|
triton.ops error
|
2025-01-22 16:53:35 -08:00 |
|
Daniel Han
|
78b756fd6e
|
Update __init__.py
|
2025-01-22 16:46:54 -08:00 |
|
Daniel Han
|
8f95022daa
|
Merge branch 'main' into nightly
|
2025-01-22 16:46:04 -08:00 |
|
Daniel Han
|
c7fe83ad4e
|
Update __init__.py
|
2025-01-22 16:45:41 -08:00 |
|
Daniel Han
|
6f6a986215
|
Fix triton.ops missing Triton 3.2
|
2025-01-22 16:44:48 -08:00 |
|
Michael Han
|
485da1f135
|
Merge pull request #1569 from unslothai/shimmyshimmer-patch-1
Update README.md
|
2025-01-20 22:13:30 -08:00 |
|
Michael Han
|
92de7eb40c
|
Update README.md
|
2025-01-20 22:13:07 -08:00 |
|
Daniel Han
|
3effbaf319
|
Update mapper.py
|
2025-01-20 08:10:20 -08:00 |
|
Daniel Han
|
65863f979e
|
Fix Mistral, Qwen (#1565)
* use exact model name
* Update save.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* print
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update vision.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* accurate_accumulation
* Update loader.py
* Update loader.py
* Update _utils.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update pyproject.toml
* Update __init__.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Fix Triton heuristics
https://github.com/triton-lang/triton/issues/5224
* Update __init__.py
* Update __init__.py
* Update __init__.py
* Update __init__.py
* Xformers
* Update loader.py
* Update loader.py
* Rewind
* Update _utils.py
* Update _utils.py
* requires grad
* Update loader.py
* Update _utils.py
* Update loader.py
* changing model to base_model if peft model is already used
* Improve debugging experience (#1512)
* Create CONTRIBUTING.md (#1472)
Creating contributing guidelines
* Update CONTRIBUTING.md
improved sentence
* Improve logging control in `unsloth_compile_transformers` by conditionally redirecting stdout based on UNSLOTH_DISABLE_LOGGER environment variable
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
* Update loader.py
* Update llama.py
* Update llama.py
* Revert "Update llama.py"
This reverts commit 67bb995878.
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Auto change is_bfloat16_supported
* Update llama.py
* Force data-type
* Update llama.py
* All attention refactor fix (#1491)
* change initilization of n_heads, n_kv_heads, hidden_size in llama.py
* do the same for cohere, mistral, gemma2, granite
* do the same for flexattention,cohere, mistral, granite
* Update llama.py
* Update llama.py
* Update granite to work with latest post_patch methods (#1502)
* Update granite to work with latest post_patch methods
* Pass position_embeddings for granite even if transformers<4.47
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Minor fixes for granite models (#1503)
* Update granite.py
Grab residual multiplier directly from layer
* Update llama.py
Version should read >= 4.47.1 as that is the version requiring the changes
* Update granite.py
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* support modelscope models and datasets (#1481)
* support modelscope
* change modelscope args
* remove useless import
* remove useless import
* fix
* wip
* fix
* remove useless code
* add readme
* add some comments
* change print to raise error
* update comment
* Update loader.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Merge branch 'main' into nightly
* Phi 4
* Update llama.py
* Torch.Cuda Is Available Condition and Warning (#1545)
* check for torch.cuda and triton if available
on my machine(mac m3) the cuda were not available
* Update pyproject.toml
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update mistral.py
* Update mistral.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix
* Bug fixes
* Update mapper.py
* Add dropout to granite to match HF's implementation (#1557)
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
* Update llama.py
* Update llama.py
* Bug fixes
* fix: flash_attn_detection_error (#1556)
* fix: flash_attn_detection_error
* Update _utils.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
---------
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
Co-authored-by: Itsuro Tajima <tajima@georepublic.de>
Co-authored-by: Muhammad Osama <muhammadosama1994@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Z <coffeevampirebusiness@gmail.com>
Co-authored-by: tastelikefeet <58414341+tastelikefeet@users.noreply.github.com>
Co-authored-by: AminWhat <88392440+aminwhat@users.noreply.github.com>
Co-authored-by: Zhe Zhang <2631992879@qq.com>
|
2025-01-20 01:27:24 -08:00 |
|
Zhe Zhang
|
082b8d1e9c
|
fix: flash_attn_detection_error (#1556)
* fix: flash_attn_detection_error
* Update _utils.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
|
2025-01-20 01:25:31 -08:00 |
|