Daniel Han-Chen
|
ee6f5096ed
|
attention mask
|
2024-01-28 13:53:06 +11:00 |
|
Daniel Han-Chen
|
f1b0fd0848
|
Update mistral.py
|
2024-01-28 13:37:38 +11:00 |
|
Daniel Han-Chen
|
7663a32753
|
Update save.py
|
2024-01-28 04:29:52 +11:00 |
|
Daniel Han-Chen
|
a158003625
|
Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly
|
2024-01-28 04:29:35 +11:00 |
|
Daniel Han-Chen
|
36829b7ec4
|
Update save.py
|
2024-01-28 04:27:10 +11:00 |
|
Daniel Han-Chen
|
917ce15861
|
Merge branch 'main' into nightly
|
2024-01-28 04:20:15 +11:00 |
|
Daniel Han
|
cd32ba76b7
|
Fix bugs + more accurate Swiglu (#137)
* faster saving & inference
* Update llama.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* fast inference
* Update llama.py
* Update save.py
* Update llama.py
* Mistral correct RoPE scaling
* Max sequence lengths
* Apache 2
* fast_linear_forward
* Update utils.py
* Update utils.py
* No print
* Update utils.py
* Update utils.py
* inference
* Update llama.py
* Fast inference RoPE
* Update llama.py
* Update llama.py
* RoPE
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* LoRA
* Fast LoRA saving
* Update llama.py
* hidden_states
* q_len == 1
* q_len issue
* Update mistral.py
* Update mistral.py
* incorrect inference
* Update to transformers 4.37
* Graceful FA2 error + torch 2.1.1
* Update mapper.py
* Update pyproject.toml
* Fix saving and bnb-4bit
* Update fast_lora.py
* Update fast_lora.py
* remove patching
* Update llama.py
* Update llama.py
* Update swiglu.py
* Repatch
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update save.py
* Update fast_lora.py
* Update utils.py
* Update llama.py
* Update fast_lora.py
* Update swiglu.py
* Update save.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Revert "Update llama.py"
This reverts commit a208ec46e0.
* Update llama.py
* Works?
* Update pyproject.toml
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Swiglu
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* attention_mask
* Update llama.py
* Update llama.py
* labels
* Update mistral.py
* Update llama.py
* attention mask
|
2024-01-28 04:20:06 +11:00 |
|
Daniel Han-Chen
|
166f8c812e
|
attention mask
|
2024-01-28 04:18:19 +11:00 |
|
Daniel Han-Chen
|
6c7f0dbcb4
|
Update llama.py
|
2024-01-28 04:08:19 +11:00 |
|
Daniel Han-Chen
|
c836ed7f3d
|
Update mistral.py
|
2024-01-28 04:08:03 +11:00 |
|
Daniel Han-Chen
|
12d57e5308
|
labels
|
2024-01-28 03:59:23 +11:00 |
|
Daniel Han-Chen
|
4c5ebcc960
|
Update llama.py
|
2024-01-28 03:56:54 +11:00 |
|
Daniel Han-Chen
|
6a027a8292
|
Update llama.py
|
2024-01-28 03:55:23 +11:00 |
|
Daniel Han-Chen
|
9f9739cbac
|
attention_mask
|
2024-01-28 03:49:54 +11:00 |
|
Daniel Han-Chen
|
2bd77e7277
|
Update fast_lora.py
|
2024-01-28 02:34:03 +11:00 |
|
Daniel Han-Chen
|
a1e5aca7cc
|
Update fast_lora.py
|
2024-01-28 01:27:46 +11:00 |
|
Daniel Han-Chen
|
a2f705d65b
|
Update fast_lora.py
|
2024-01-28 01:17:27 +11:00 |
|
Daniel Han-Chen
|
d01ba458df
|
Update fast_lora.py
|
2024-01-28 00:45:55 +11:00 |
|
Daniel Han-Chen
|
6fa0635971
|
Update fast_lora.py
|
2024-01-27 23:20:41 +11:00 |
|
Daniel Han-Chen
|
e094af81a1
|
Update fast_lora.py
|
2024-01-27 20:39:19 +11:00 |
|
Daniel Han-Chen
|
c74e1af85c
|
Update fast_lora.py
|
2024-01-27 20:37:43 +11:00 |
|
Daniel Han-Chen
|
363ffba1c2
|
Update fast_lora.py
|
2024-01-27 20:17:08 +11:00 |
|
Daniel Han-Chen
|
510c85f412
|
Update swiglu.py
|
2024-01-27 20:04:55 +11:00 |
|
Daniel Han-Chen
|
35daafdd6e
|
Update fast_lora.py
|
2024-01-27 19:53:57 +11:00 |
|
Daniel Han-Chen
|
6201f7681f
|
Update fast_lora.py
|
2024-01-27 19:38:28 +11:00 |
|
Daniel Han-Chen
|
86a1c9788b
|
Update fast_lora.py
|
2024-01-27 19:29:53 +11:00 |
|
Daniel Han-Chen
|
8e0e4ccdc6
|
Update fast_lora.py
|
2024-01-27 19:18:59 +11:00 |
|
Daniel Han-Chen
|
2e4c59deaf
|
Update swiglu.py
|
2024-01-27 19:05:02 +11:00 |
|
Daniel Han-Chen
|
85e87d9ba2
|
Swiglu
|
2024-01-27 19:03:04 +11:00 |
|
Daniel Han-Chen
|
83b6937285
|
Update fast_lora.py
|
2024-01-27 18:21:29 +11:00 |
|
Daniel Han-Chen
|
3d3e7f5b42
|
Update fast_lora.py
|
2024-01-27 18:15:34 +11:00 |
|
Daniel Han-Chen
|
d3f3b6fc49
|
Update fast_lora.py
|
2024-01-27 18:00:41 +11:00 |
|
Daniel Han-Chen
|
e77d7c069f
|
Update fast_lora.py
|
2024-01-27 18:00:22 +11:00 |
|
Daniel Han-Chen
|
f7d11d10f8
|
Update fast_lora.py
|
2024-01-27 17:47:54 +11:00 |
|
Daniel Han-Chen
|
8ed03f5f45
|
Update pyproject.toml
|
2024-01-27 17:38:30 +11:00 |
|
Daniel Han-Chen
|
af65cb0d3d
|
Works?
|
2024-01-27 04:50:47 +11:00 |
|
Daniel Han
|
89daa0efcc
|
Inference bug fix (#134)
* faster saving & inference
* Update llama.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* fast inference
* Update llama.py
* Update save.py
* Update llama.py
* Mistral correct RoPE scaling
* Max sequence lengths
* Apache 2
* fast_linear_forward
* Update utils.py
* Update utils.py
* No print
* Update utils.py
* Update utils.py
* inference
* Update llama.py
* Fast inference RoPE
* Update llama.py
* Update llama.py
* RoPE
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* LoRA
* Fast LoRA saving
* Update llama.py
* hidden_states
* q_len == 1
* q_len issue
* Update mistral.py
* Update mistral.py
* incorrect inference
* Update to transformers 4.37
* Graceful FA2 error + torch 2.1.1
* Update mapper.py
* Update pyproject.toml
* Fix saving and bnb-4bit
* Update fast_lora.py
* Update fast_lora.py
* remove patching
* Update llama.py
* Update llama.py
* Update swiglu.py
* Repatch
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update save.py
* Update fast_lora.py
* Update utils.py
* Update llama.py
* Update fast_lora.py
* Update swiglu.py
* Update save.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Revert "Update llama.py"
This reverts commit a208ec46e0.
* Update llama.py
|
2024-01-27 04:50:22 +11:00 |
|
Daniel Han-Chen
|
fb5333726a
|
Update llama.py
|
2024-01-27 04:49:36 +11:00 |
|
Daniel Han-Chen
|
a59ec7903c
|
Merge branch 'main' into nightly
|
2024-01-27 04:48:40 +11:00 |
|
Daniel Han-Chen
|
704e36a64e
|
Revert "Update llama.py"
This reverts commit a208ec46e0.
|
2024-01-27 04:48:34 +11:00 |
|
Daniel Han-Chen
|
a208ec46e0
|
Update llama.py
|
2024-01-27 04:48:03 +11:00 |
|
Daniel Han
|
87a7ef1049
|
More bug fixes (#133)
* faster saving & inference
* Update llama.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* fast inference
* Update llama.py
* Update save.py
* Update llama.py
* Mistral correct RoPE scaling
* Max sequence lengths
* Apache 2
* fast_linear_forward
* Update utils.py
* Update utils.py
* No print
* Update utils.py
* Update utils.py
* inference
* Update llama.py
* Fast inference RoPE
* Update llama.py
* Update llama.py
* RoPE
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* LoRA
* Fast LoRA saving
* Update llama.py
* hidden_states
* q_len == 1
* q_len issue
* Update mistral.py
* Update mistral.py
* incorrect inference
* Update to transformers 4.37
* Graceful FA2 error + torch 2.1.1
* Update mapper.py
* Update pyproject.toml
* Fix saving and bnb-4bit
* Update fast_lora.py
* Update fast_lora.py
* remove patching
* Update llama.py
* Update llama.py
* Update swiglu.py
* Repatch
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update save.py
* Update fast_lora.py
* Update utils.py
* Update llama.py
* Update fast_lora.py
* Update swiglu.py
* Update save.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
|
2024-01-27 04:47:54 +11:00 |
|
Daniel Han-Chen
|
bd2ff90817
|
Update llama.py
|
2024-01-27 04:47:42 +11:00 |
|
Daniel Han-Chen
|
a3d892a15b
|
Update llama.py
|
2024-01-27 04:47:01 +11:00 |
|
Daniel Han-Chen
|
b89599a3f7
|
Update llama.py
|
2024-01-27 04:46:47 +11:00 |
|
Daniel Han-Chen
|
baeea64917
|
Update save.py
|
2024-01-27 04:20:58 +11:00 |
|
Daniel Han-Chen
|
ecdbb28dcb
|
Update save.py
|
2024-01-27 04:19:59 +11:00 |
|
Daniel Han-Chen
|
393341f211
|
Update swiglu.py
|
2024-01-27 04:18:25 +11:00 |
|
Daniel Han-Chen
|
47babc780a
|
Update fast_lora.py
|
2024-01-27 04:16:38 +11:00 |
|
Daniel Han-Chen
|
9edc309f59
|
Update llama.py
|
2024-01-27 04:15:37 +11:00 |
|