Daniel Han
|
5b7b456514
|
Update mapper.py
|
2025-02-03 19:43:52 -08:00 |
|
Daniel Han
|
82e011e8d4
|
Update utils.py
|
2025-02-03 15:43:40 -08:00 |
|
Daniel Han
|
dc7f0fca4f
|
Update utils.py
|
2025-02-02 17:12:21 -08:00 |
|
Daniel Han
|
a274e75db7
|
Update utils.py
|
2025-02-02 17:07:31 -08:00 |
|
Daniel Han
|
9296a6a93d
|
Update utils.py
|
2025-02-02 17:04:37 -08:00 |
|
Daniel Han
|
126d804d2a
|
Update utils.py
|
2025-02-02 17:00:24 -08:00 |
|
Daniel Han
|
ed31cf80c6
|
Update utils.py
|
2025-02-02 16:31:28 -08:00 |
|
Daniel Han
|
6e5a6af0d3
|
Update utils.py
|
2025-02-02 16:29:26 -08:00 |
|
Daniel Han
|
31449956a3
|
Update utils.py
|
2025-02-02 16:26:55 -08:00 |
|
Daniel Han
|
e961d68733
|
Update utils.py
|
2025-02-02 16:24:10 -08:00 |
|
Daniel Han
|
35609081cd
|
Update utils.py
|
2025-02-02 16:23:31 -08:00 |
|
Daniel Han
|
56b6c37ec0
|
Update utils.py
|
2025-02-02 16:18:56 -08:00 |
|
Daniel Han
|
1f42dc194a
|
Update utils.py
|
2025-02-02 15:23:05 -08:00 |
|
Daniel Han
|
8d457854ac
|
Update utils.py
|
2025-02-02 15:17:50 -08:00 |
|
Daniel Han
|
61eb34b6c2
|
Update llama.py
|
2025-02-02 14:54:58 -08:00 |
|
Daniel Han
|
e91706febf
|
Update llama.py
|
2025-02-02 14:51:14 -08:00 |
|
Daniel Han
|
24b84d89ec
|
Update utils.py
|
2025-02-02 13:52:15 -08:00 |
|
Daniel Han
|
ffe31d5cea
|
Update llama.py
|
2025-02-02 13:49:25 -08:00 |
|
Daniel Han
|
50d5250a57
|
Update llama.py
|
2025-02-02 13:47:14 -08:00 |
|
Daniel Han
|
9314e46e07
|
Faster inference?
|
2025-02-02 13:45:25 -08:00 |
|
Daniel Han
|
14d6199e63
|
Update llama.py
|
2025-02-02 04:00:47 -08:00 |
|
Daniel Han
|
f6bffaee84
|
Update llama.py
|
2025-02-02 03:57:24 -08:00 |
|
Daniel Han
|
f5d65f6570
|
Update llama.py
|
2025-02-02 03:56:25 -08:00 |
|
Daniel Han
|
865b7d685f
|
Update llama.py
|
2025-02-02 03:56:13 -08:00 |
|
Daniel Han
|
6af2af1b48
|
Update llama.py
|
2025-02-02 03:49:18 -08:00 |
|
Daniel Han
|
c77471114b
|
Update llama.py
|
2025-02-02 02:23:53 -08:00 |
|
Daniel Han
|
52aeca630e
|
Update llama.py
|
2025-02-02 02:18:33 -08:00 |
|
Daniel Han
|
69c2cd23c0
|
Update llama.py
|
2025-02-02 02:15:54 -08:00 |
|
Daniel Han
|
2b5250f601
|
Update llama.py
|
2025-02-02 02:14:13 -08:00 |
|
Daniel Han
|
17c486acf8
|
Update llama.py
|
2025-02-02 02:11:33 -08:00 |
|
Daniel Han
|
ceea79e3a2
|
Update llama.py
|
2025-02-02 02:10:17 -08:00 |
|
Daniel Han
|
c571e2395e
|
Update llama.py
|
2025-02-02 02:06:13 -08:00 |
|
Daniel Han
|
4936049259
|
Torch 2.6 support
|
2025-02-02 00:43:26 -08:00 |
|
Daniel Han
|
70fa248fe7
|
Merge branch 'main' into nightly
|
2025-02-01 23:46:58 -08:00 |
|
Daniel Han
|
e91ae59e84
|
Update _utils.py
|
2025-02-01 23:46:40 -08:00 |
|
Daniel Han
|
890c9cf818
|
dim fix
|
2025-02-01 19:27:33 -08:00 |
|
Daniel Han
|
a75869f545
|
Update gemma.py
|
2025-02-01 19:15:55 -08:00 |
|
Daniel Han
|
ff7cb20f93
|
Update gemma.py
|
2025-02-01 19:11:20 -08:00 |
|
Daniel Han
|
c360fcd526
|
Update gemma.py
|
2025-02-01 19:02:36 -08:00 |
|
Daniel Han
|
147623d270
|
Update gemma.py
|
2025-02-01 17:54:00 -08:00 |
|
Daniel Han
|
e2b23f17b1
|
Mistral 24B, Qwen 2.5 VL support (#1598)
* use exact model name
* Update save.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* print
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update vision.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* accurate_accumulation
* Update loader.py
* Update loader.py
* Update _utils.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update pyproject.toml
* Update __init__.py
* Update pyproject.toml
* Update __init__.py
* Update __init__.py
* Fix Triton heuristics
https://github.com/triton-lang/triton/issues/5224
* Update __init__.py
* Update __init__.py
* Update __init__.py
* Update __init__.py
* Xformers
* Update loader.py
* Update loader.py
* Rewind
* Update _utils.py
* Update _utils.py
* requires grad
* Update loader.py
* Update _utils.py
* Update loader.py
* changing model to base_model if peft model is already used
* Improve debugging experience (#1512)
* Create CONTRIBUTING.md (#1472)
Creating contributing guidelines
* Update CONTRIBUTING.md
improved sentence
* Improve logging control in `unsloth_compile_transformers` by conditionally redirecting stdout based on UNSLOTH_DISABLE_LOGGER environment variable
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
* Update loader.py
* Update llama.py
* Update llama.py
* Revert "Update llama.py"
This reverts commit a8edd0931a.
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Auto change is_bfloat16_supported
* Update llama.py
* Force data-type
* Update llama.py
* All attention refactor fix (#1491)
* change initilization of n_heads, n_kv_heads, hidden_size in llama.py
* do the same for cohere, mistral, gemma2, granite
* do the same for flexattention,cohere, mistral, granite
* Update llama.py
* Update llama.py
* Update granite to work with latest post_patch methods (#1502)
* Update granite to work with latest post_patch methods
* Pass position_embeddings for granite even if transformers<4.47
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Minor fixes for granite models (#1503)
* Update granite.py
Grab residual multiplier directly from layer
* Update llama.py
Version should read >= 4.47.1 as that is the version requiring the changes
* Update granite.py
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* support modelscope models and datasets (#1481)
* support modelscope
* change modelscope args
* remove useless import
* remove useless import
* fix
* wip
* fix
* remove useless code
* add readme
* add some comments
* change print to raise error
* update comment
* Update loader.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Merge branch 'main' into nightly
* Phi 4
* Update llama.py
* Torch.Cuda Is Available Condition and Warning (#1545)
* check for torch.cuda and triton if available
on my machine(mac m3) the cuda were not available
* Update pyproject.toml
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update mistral.py
* Update mistral.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix
* Bug fixes
* Update mapper.py
* Add dropout to granite to match HF's implementation (#1557)
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
* Update llama.py
* Update llama.py
* Bug fixes
* fix: flash_attn_detection_error (#1556)
* fix: flash_attn_detection_error
* Update _utils.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update mapper.py
---------
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
Co-authored-by: Itsuro Tajima <tajima@georepublic.de>
Co-authored-by: Muhammad Osama <muhammadosama1994@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Z <coffeevampirebusiness@gmail.com>
Co-authored-by: tastelikefeet <58414341+tastelikefeet@users.noreply.github.com>
Co-authored-by: AminWhat <88392440+aminwhat@users.noreply.github.com>
Co-authored-by: Zhe Zhang <2631992879@qq.com>
|
2025-01-31 03:34:36 -08:00 |
|
Daniel Han
|
0240dc2c5e
|
Merge branch 'main' into nightly
|
2025-01-31 03:33:30 -08:00 |
|
Daniel Han
|
4f57c09ee4
|
Update _utils.py
|
2025-01-31 03:33:24 -08:00 |
|
Daniel Han
|
7267b22c4e
|
Merge branch 'main' into nightly
|
2025-01-31 03:02:42 -08:00 |
|
Daniel Han
|
b5763a886d
|
Update mapper.py
|
2025-01-31 03:02:37 -08:00 |
|
Michael Han
|
edec640658
|
Merge pull request #1595 from unslothai/shimmyshimmer-patch-3
Update README.md
|
2025-01-30 21:05:57 -08:00 |
|
Michael Han
|
789af5b7f9
|
Update README.md
|
2025-01-30 21:05:45 -08:00 |
|
Michael Han
|
69d879970a
|
Merge pull request #1580 from unslothai/shimmyshimmer-patch-2
Update README.md
|
2025-01-26 14:12:10 -08:00 |
|
Michael Han
|
748d1f1fd0
|
Update README.md
Updating super old benchmarks
|
2025-01-26 14:11:58 -08:00 |
|
Daniel Han
|
d847f90a29
|
Fix triton.ops
|
2025-01-22 17:49:20 -08:00 |
|