Daniel Han
84fa1af77e
Update llama.py
2025-01-07 03:39:08 -08:00
Daniel Han
b7d47c1d8a
Update llama.py
2025-01-07 03:33:46 -08:00
Kareem
0e2110f7b8
All attention refactor fix ( #1491 )
...
* change initilization of n_heads, n_kv_heads, hidden_size in llama.py
* do the same for cohere, mistral, gemma2, granite
* do the same for flexattention,cohere, mistral, granite
2025-01-07 02:41:15 -08:00
Daniel Han
a4aba47ebb
Update llama.py
2025-01-07 01:56:32 -08:00
Daniel Han
0672e71b17
Force data-type
2025-01-07 01:51:49 -08:00
Daniel Han
6320381fb6
Update llama.py
2025-01-07 01:43:20 -08:00
Daniel Han
ab2b72c5f0
Auto change is_bfloat16_supported
2025-01-07 01:40:04 -08:00
Daniel Han
9e00262be6
Update llama.py
2025-01-07 01:10:41 -08:00
Daniel Han
4df3af2f57
Update llama.py
2025-01-07 01:05:04 -08:00
Daniel Han
358316522f
Update llama.py
2025-01-07 01:02:35 -08:00
Daniel Han
97c3e282fb
Update llama.py
2025-01-07 01:02:24 -08:00
Daniel Han
020c793a1e
Update llama.py
2025-01-07 00:50:56 -08:00
Daniel Han
656099cfc3
Update llama.py
2025-01-07 00:45:22 -08:00
Daniel Han
837d620dbd
Update llama.py
2025-01-07 00:41:26 -08:00
Daniel Han
c95380cc9c
Update llama.py
2025-01-07 00:41:16 -08:00
Daniel Han
689ca57214
Update llama.py
2025-01-07 00:38:04 -08:00
Daniel Han
dc33cc94a7
Update llama.py
2025-01-07 00:34:46 -08:00
Daniel Han
f791766ab9
Update llama.py
2025-01-07 00:34:09 -08:00
Daniel Han
a7740ba8e9
Update llama.py
2025-01-07 00:30:32 -08:00
Daniel Han
883c25d34c
Merge branch 'pr/1509' into nightly
2025-01-06 22:08:07 -08:00
Daniel Han
c4720f1baf
Update llama.py
2025-01-06 22:06:00 -08:00
Daniel Han
294cd8ea32
Revert "Update llama.py"
...
This reverts commit a8edd0931a
2025-01-06 22:05:44 -08:00
Daniel Han
a8edd0931a
Update llama.py
2025-01-06 22:05:14 -08:00
Daniel Han
0f6b518ee1
Update llama.py
2025-01-06 18:56:26 -08:00
Daniel Han
adb2dcfd2b
Update loader.py
2025-01-06 18:13:48 -08:00
Edd
9940583287
Improve debugging experience ( #1512 )
...
* Create CONTRIBUTING.md (#1472 )
Creating contributing guidelines
* Update CONTRIBUTING.md
improved sentence
* Improve logging control in `unsloth_compile_transformers` by conditionally redirecting stdout based on UNSLOTH_DISABLE_LOGGER environment variable
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
2025-01-06 18:04:27 -08:00
Daniel Han
8cf3e6fa2b
Merge branch 'main' into nightly
2025-01-06 18:03:53 -08:00
Muhammad Osama
6b9e11bdf3
changing model to base_model if peft model is already used
2025-01-05 18:18:42 -06:00
Michael Han
48627f876c
Merge pull request #1507 from NinoRisteski/patch-1
...
Update CONTRIBUTING.md
2025-01-05 01:56:40 -08:00
Nino Risteski
8063abc004
Update CONTRIBUTING.md
...
improved sentence
2025-01-05 09:24:10 +01:00
Michael Han
fb49390494
Create CONTRIBUTING.md ( #1472 )
...
Creating contributing guidelines
2025-01-04 22:09:25 -08:00
Daniel Han
d08c8afd6c
Merge branch 'pr/1339' into nightly
2025-01-04 22:08:00 -08:00
Daniel Han
3e1c5ec3a0
Update loader.py
2025-01-04 22:03:11 -08:00
Daniel Han
c697d6d01a
Update _utils.py
2025-01-04 00:42:39 -08:00
Daniel Han
5cf47b3e63
Update loader.py
2025-01-02 22:44:17 -08:00
Daniel Han
75ffad921f
requires grad
2025-01-02 18:25:25 -08:00
Daniel Han
69017405db
Update _utils.py
2025-01-01 22:34:40 -08:00
Daniel Han
163ef43181
Update _utils.py
2025-01-01 22:32:58 -08:00
Daniel Han
f7a322e5d5
Rewind
2025-01-01 16:34:18 -08:00
Daniel Han
16b42fd5e2
Update loader.py
2025-01-01 16:27:08 -08:00
Daniel Han
b3dec6af35
Update loader.py
2025-01-01 02:06:41 -08:00
Daniel Han
f2ff798c4e
Xformers
2024-12-31 22:42:28 -08:00
Daniel Han
48c743d508
Update __init__.py
2024-12-31 12:35:56 -08:00
Daniel Han
6e05c84a26
Update __init__.py
2024-12-31 12:31:30 -08:00
Daniel Han
c83f5422a1
Update __init__.py
2024-12-31 00:38:18 -08:00
Daniel Han
fddf14ebc8
Update __init__.py
2024-12-30 14:13:49 -08:00
Daniel Han
5c439a0bd6
Fix Triton heuristics
...
https://github.com/triton-lang/triton/issues/5224
2024-12-30 13:52:42 -08:00
Daniel Han
9611ee433e
Update __init__.py
2024-12-29 19:36:11 -08:00
Daniel Han
7c74db901b
Update __init__.py
2024-12-29 19:35:05 -08:00
Daniel Han
10a7d4fc93
Update pyproject.toml
2024-12-29 19:34:30 -08:00
