Kareem
d7a2057ca6
All attention refactor fix ( #1491 )
...
* change initilization of n_heads, n_kv_heads, hidden_size in llama.py
* do the same for cohere, mistral, gemma2, granite
* do the same for flexattention,cohere, mistral, granite
2025-01-07 02:41:15 -08:00
Daniel Han
ad31cb699f
Update llama.py
2025-01-07 01:56:32 -08:00
Daniel Han
ce84095458
Force data-type
2025-01-07 01:51:49 -08:00
Daniel Han
a1b897ec3a
Update llama.py
2025-01-07 01:43:20 -08:00
Daniel Han
2b3391f478
Auto change is_bfloat16_supported
2025-01-07 01:40:04 -08:00
Daniel Han
2608fe4aa6
Update llama.py
2025-01-07 01:10:41 -08:00
Daniel Han
500479640f
Update llama.py
2025-01-07 01:05:04 -08:00
Daniel Han
06d40574dc
Update llama.py
2025-01-07 01:02:35 -08:00
Daniel Han
fa02ce1401
Update llama.py
2025-01-07 01:02:24 -08:00
Daniel Han
ec033328d5
Update llama.py
2025-01-07 00:50:56 -08:00
Daniel Han
61ecb22c9a
Update llama.py
2025-01-07 00:45:22 -08:00
Daniel Han
3369f0039b
Update llama.py
2025-01-07 00:41:26 -08:00
Daniel Han
0dd136ddfe
Update llama.py
2025-01-07 00:41:16 -08:00
Daniel Han
dbef42d726
Update llama.py
2025-01-07 00:38:04 -08:00
Daniel Han
ca8e92cd89
Update llama.py
2025-01-07 00:34:46 -08:00
Daniel Han
cef7e5881f
Update llama.py
2025-01-07 00:34:09 -08:00
Daniel Han
1e8cf025c1
Update llama.py
2025-01-07 00:30:32 -08:00
Daniel Han
777f209f2d
Merge branch 'pr/1509' into nightly
2025-01-06 22:08:07 -08:00
Daniel Han
52d2895dc2
Update llama.py
2025-01-06 22:06:00 -08:00
Daniel Han
2b5d4701fd
Revert "Update llama.py"
...
This reverts commit b7ddf962d2
2025-01-06 22:05:44 -08:00
Daniel Han
b7ddf962d2
Update llama.py
2025-01-06 22:05:14 -08:00
Daniel Han
a229db5a85
Update llama.py
2025-01-06 18:56:26 -08:00
Daniel Han
f40558f530
Update loader.py
2025-01-06 18:13:48 -08:00
Edd
039a507a23
Improve debugging experience ( #1512 )
...
* Create CONTRIBUTING.md (#1472 )
Creating contributing guidelines
* Update CONTRIBUTING.md
improved sentence
* Improve logging control in `unsloth_compile_transformers` by conditionally redirecting stdout based on UNSLOTH_DISABLE_LOGGER environment variable
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
2025-01-06 18:04:27 -08:00
Daniel Han
7134fee570
Merge branch 'main' into nightly
2025-01-06 18:03:53 -08:00
Muhammad Osama
86ab9f1931
changing model to base_model if peft model is already used
2025-01-05 18:18:42 -06:00
Michael Han
7accbe8991
Merge pull request #1507 from NinoRisteski/patch-1
...
Update CONTRIBUTING.md
2025-01-05 01:56:40 -08:00
Nino Risteski
3a0eb2bbf4
Update CONTRIBUTING.md
...
improved sentence
2025-01-05 09:24:10 +01:00
Michael Han
f48455529f
Create CONTRIBUTING.md ( #1472 )
...
Creating contributing guidelines
2025-01-04 22:09:25 -08:00
Daniel Han
3f251f5012
Merge branch 'pr/1339' into nightly
2025-01-04 22:08:00 -08:00
Daniel Han
99898da0d3
Update loader.py
2025-01-04 22:03:11 -08:00
Daniel Han
3e096ac6ba
Update _utils.py
2025-01-04 00:42:39 -08:00
Daniel Han
bb9ab04dd8
Update loader.py
2025-01-02 22:44:17 -08:00
Daniel Han
9a66c6f157
requires grad
2025-01-02 18:25:25 -08:00
Daniel Han
937952292e
Update _utils.py
2025-01-01 22:34:40 -08:00
Daniel Han
c90b3bfecf
Update _utils.py
2025-01-01 22:32:58 -08:00
Daniel Han
c25f20ce70
Rewind
2025-01-01 16:34:18 -08:00
Daniel Han
67604993b0
Update loader.py
2025-01-01 16:27:08 -08:00
Daniel Han
b4549cd93e
Update loader.py
2025-01-01 02:06:41 -08:00
Daniel Han
512773e691
Xformers
2024-12-31 22:42:28 -08:00
Daniel Han
f0216092b9
Update __init__.py
2024-12-31 12:35:56 -08:00
Daniel Han
abebd113be
Update __init__.py
2024-12-31 12:31:30 -08:00
Daniel Han
4e0986fbe4
Update __init__.py
2024-12-31 00:38:18 -08:00
Daniel Han
743106eaf6
Update __init__.py
2024-12-30 14:13:49 -08:00
Daniel Han
bfce3d402c
Fix Triton heuristics
...
https://github.com/triton-lang/triton/issues/5224
2024-12-30 13:52:42 -08:00
Daniel Han
7d7a1b0ef4
Update __init__.py
2024-12-29 19:36:11 -08:00
Daniel Han
c3d4e188a5
Update __init__.py
2024-12-29 19:35:05 -08:00
Daniel Han
a0d39ffbca
Update pyproject.toml
2024-12-29 19:34:30 -08:00
Daniel Han
3e1dbaba63
Update __init__.py
2024-12-29 19:29:19 -08:00
Daniel Han
dc9efb4a77
Merge branch 'main' into nightly
2024-12-29 03:58:02 -08:00
