Z
7bacfbbaae
Minor fixes for granite models ( #1503 )
...
* Update granite.py
Grab residual multiplier directly from layer
* Update llama.py
Version should read >= 4.47.1 as that is the version requiring the changes
* Update granite.py
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-01-07 03:58:40 -08:00
Datta Nimmaturi
cad56301ec
Update granite to work with latest post_patch methods ( #1502 )
...
* Update granite to work with latest post_patch methods
* Pass position_embeddings for granite even if transformers<4.47
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-01-07 03:49:11 -08:00
Daniel Han
639ac6f987
Update llama.py
2025-01-07 03:39:08 -08:00
Daniel Han
67a8162a4c
Update llama.py
2025-01-07 03:33:46 -08:00
Kareem
fccdf38c45
All attention refactor fix ( #1491 )
...
* change initilization of n_heads, n_kv_heads, hidden_size in llama.py
* do the same for cohere, mistral, gemma2, granite
* do the same for flexattention,cohere, mistral, granite
2025-01-07 02:41:15 -08:00
Daniel Han
a243ddb4f0
Update llama.py
2025-01-07 01:56:32 -08:00
Daniel Han
2ab9a55aff
Force data-type
2025-01-07 01:51:49 -08:00
Daniel Han
fc80163b37
Update llama.py
2025-01-07 01:43:20 -08:00
Daniel Han
5b2569e8fb
Auto change is_bfloat16_supported
2025-01-07 01:40:04 -08:00
Daniel Han
9514818c4b
Update llama.py
2025-01-07 01:10:41 -08:00
Daniel Han
5684cbe502
Update llama.py
2025-01-07 01:05:04 -08:00
Daniel Han
cc69d74d94
Update llama.py
2025-01-07 01:02:35 -08:00
Daniel Han
deb98e9b6b
Update llama.py
2025-01-07 01:02:24 -08:00
Daniel Han
67e3251577
Update llama.py
2025-01-07 00:50:56 -08:00
Daniel Han
2181a64ba9
Update llama.py
2025-01-07 00:45:22 -08:00
Daniel Han
ae3f2e05bb
Update llama.py
2025-01-07 00:41:26 -08:00
Daniel Han
c65fb54914
Update llama.py
2025-01-07 00:41:16 -08:00
Daniel Han
904ec69799
Update llama.py
2025-01-07 00:38:04 -08:00
Daniel Han
7719207b6a
Update llama.py
2025-01-07 00:34:46 -08:00
Daniel Han
fcda5ce87f
Update llama.py
2025-01-07 00:34:09 -08:00
Daniel Han
2d66722781
Update llama.py
2025-01-07 00:30:32 -08:00
Daniel Han
780046ff56
Merge branch 'pr/1509' into nightly
2025-01-06 22:08:07 -08:00
Daniel Han
706b4ed717
Update llama.py
2025-01-06 22:06:00 -08:00
Daniel Han
770cbd98d1
Revert "Update llama.py"
...
This reverts commit 67bb995878
2025-01-06 22:05:44 -08:00
Daniel Han
67bb995878
Update llama.py
2025-01-06 22:05:14 -08:00
Daniel Han
c320d26fba
Update llama.py
2025-01-06 18:56:26 -08:00
Daniel Han
56b33343a6
Update loader.py
2025-01-06 18:13:48 -08:00
Edd
4ef3fd4b10
Improve debugging experience ( #1512 )
...
* Create CONTRIBUTING.md (#1472 )
Creating contributing guidelines
* Update CONTRIBUTING.md
improved sentence
* Improve logging control in `unsloth_compile_transformers` by conditionally redirecting stdout based on UNSLOTH_DISABLE_LOGGER environment variable
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
2025-01-06 18:04:27 -08:00
Daniel Han
2ec8f9f171
Merge branch 'main' into nightly
2025-01-06 18:03:53 -08:00
Muhammad Osama
e04235d13a
changing model to base_model if peft model is already used
2025-01-05 18:18:42 -06:00
Michael Han
c69f8e7176
Merge pull request #1507 from NinoRisteski/patch-1
...
Update CONTRIBUTING.md
2025-01-05 01:56:40 -08:00
Nino Risteski
135acd2c80
Update CONTRIBUTING.md
...
improved sentence
2025-01-05 09:24:10 +01:00
Michael Han
373e5067b4
Create CONTRIBUTING.md ( #1472 )
...
Creating contributing guidelines
2025-01-04 22:09:25 -08:00
Daniel Han
bf45d56b6f
Merge branch 'pr/1339' into nightly
2025-01-04 22:08:00 -08:00
Daniel Han
42928890b3
Update loader.py
2025-01-04 22:03:11 -08:00
Daniel Han
cc7f1b99a3
Update _utils.py
2025-01-04 00:42:39 -08:00
Daniel Han
fc3a2dfc8e
Update loader.py
2025-01-02 22:44:17 -08:00
Daniel Han
762185dd7b
requires grad
2025-01-02 18:25:25 -08:00
Daniel Han
bd506f2c44
Update _utils.py
2025-01-01 22:34:40 -08:00
Daniel Han
51257d37a8
Update _utils.py
2025-01-01 22:32:58 -08:00
Daniel Han
d426961266
Rewind
2025-01-01 16:34:18 -08:00
Daniel Han
1a0ee1bf31
Update loader.py
2025-01-01 16:27:08 -08:00
Daniel Han
862ab9290c
Update loader.py
2025-01-01 02:06:41 -08:00
Daniel Han
800868243e
Xformers
2024-12-31 22:42:28 -08:00
Daniel Han
f5b6fd1aa5
Update __init__.py
2024-12-31 12:35:56 -08:00
Daniel Han
a0967e8ae7
Update __init__.py
2024-12-31 12:31:30 -08:00
Daniel Han
843cf8463f
Update __init__.py
2024-12-31 00:38:18 -08:00
Daniel Han
fc7190c9d6
Update __init__.py
2024-12-30 14:13:49 -08:00
Daniel Han
4d0bb213f0
Fix Triton heuristics
...
https://github.com/triton-lang/triton/issues/5224
2024-12-30 13:52:42 -08:00
Daniel Han
abad689731
Update __init__.py
2024-12-29 19:36:11 -08:00
