Daniel Han-Chen
|
b8f665bf22
|
fast lm_head
|
2024-01-30 17:26:45 +11:00 |
|
Daniel Han-Chen
|
ed5a653ecf
|
Update mistral.py
|
2024-01-30 04:16:39 +11:00 |
|
Daniel Han-Chen
|
e0bad0eec5
|
Fix inference
|
2024-01-30 04:10:14 +11:00 |
|
Daniel Han-Chen
|
71725aeea5
|
Update __init__.py
|
2024-01-30 03:23:42 +11:00 |
|
Daniel Han-Chen
|
3ddda6f492
|
Update mistral.py
|
2024-01-30 03:08:46 +11:00 |
|
Daniel Han-Chen
|
6f74c98fbc
|
Update utils.py
|
2024-01-29 23:19:43 +11:00 |
|
Daniel Han-Chen
|
a7bfeec919
|
Update utils.py
|
2024-01-29 23:14:51 +11:00 |
|
Daniel Han-Chen
|
7c87d60bc1
|
Update utils.py
|
2024-01-29 23:07:40 +11:00 |
|
Daniel Han-Chen
|
bb364204cc
|
Update llama.py
|
2024-01-29 20:09:59 +11:00 |
|
Daniel Han-Chen
|
4700d51916
|
Fast inference repatch
|
2024-01-29 19:55:40 +11:00 |
|
Daniel Han-Chen
|
58cabcbc06
|
Merge branch 'main' into nightly
|
2024-01-29 17:59:34 +11:00 |
|
Daniel Han-Chen
|
01b8162244
|
Merge branch 'main' into nightly
|
2024-01-29 17:49:57 +11:00 |
|
Daniel Han
|
0562464280
|
Fix inference attention mask (#142)
* faster saving & inference
* Update llama.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* fast inference
* Update llama.py
* Update save.py
* Update llama.py
* Mistral correct RoPE scaling
* Max sequence lengths
* Apache 2
* fast_linear_forward
* Update utils.py
* Update utils.py
* No print
* Update utils.py
* Update utils.py
* inference
* Update llama.py
* Fast inference RoPE
* Update llama.py
* Update llama.py
* RoPE
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* LoRA
* Fast LoRA saving
* Update llama.py
* hidden_states
* q_len == 1
* q_len issue
* Update mistral.py
* Update mistral.py
* incorrect inference
* Update to transformers 4.37
* Graceful FA2 error + torch 2.1.1
* Update mapper.py
* Update pyproject.toml
* Fix saving and bnb-4bit
* Update fast_lora.py
* Update fast_lora.py
* remove patching
* Update llama.py
* Update llama.py
* Update swiglu.py
* Repatch
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update save.py
* Update fast_lora.py
* Update utils.py
* Update llama.py
* Update fast_lora.py
* Update swiglu.py
* Update save.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Revert "Update llama.py"
This reverts commit a208ec46e0.
* Update llama.py
* Works?
* Update pyproject.toml
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Swiglu
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* attention_mask
* Update llama.py
* Update llama.py
* labels
* Update mistral.py
* Update llama.py
* attention mask
* Update save.py
* Update save.py
* Update mistral.py
* attention mask
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update dpo.py
* Patch saving
* Update save.py
* Update save.py
* patch_saving_functions
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* print
* Mistral patch
* Update mistral.py
* Update save.py
* saving
* Update llama.py
* Update llama.py
|
2024-01-29 17:49:54 +11:00 |
|
Daniel Han-Chen
|
5cfea20129
|
Update llama.py
|
2024-01-29 17:35:19 +11:00 |
|
Daniel Han-Chen
|
25a88ea003
|
Update llama.py
|
2024-01-29 16:52:04 +11:00 |
|
Daniel Han
|
206a9b65f0
|
Nightly (#140)
* faster saving & inference
* Update llama.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* fast inference
* Update llama.py
* Update save.py
* Update llama.py
* Mistral correct RoPE scaling
* Max sequence lengths
* Apache 2
* fast_linear_forward
* Update utils.py
* Update utils.py
* No print
* Update utils.py
* Update utils.py
* inference
* Update llama.py
* Fast inference RoPE
* Update llama.py
* Update llama.py
* RoPE
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* LoRA
* Fast LoRA saving
* Update llama.py
* hidden_states
* q_len == 1
* q_len issue
* Update mistral.py
* Update mistral.py
* incorrect inference
* Update to transformers 4.37
* Graceful FA2 error + torch 2.1.1
* Update mapper.py
* Update pyproject.toml
* Fix saving and bnb-4bit
* Update fast_lora.py
* Update fast_lora.py
* remove patching
* Update llama.py
* Update llama.py
* Update swiglu.py
* Repatch
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update save.py
* Update fast_lora.py
* Update utils.py
* Update llama.py
* Update fast_lora.py
* Update swiglu.py
* Update save.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Revert "Update llama.py"
This reverts commit a208ec46e0.
* Update llama.py
* Works?
* Update pyproject.toml
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Swiglu
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* attention_mask
* Update llama.py
* Update llama.py
* labels
* Update mistral.py
* Update llama.py
* attention mask
* Update save.py
* Update save.py
* Update mistral.py
* attention mask
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update dpo.py
* Patch saving
* Update save.py
* Update save.py
* patch_saving_functions
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* print
* Mistral patch
* Update mistral.py
* Update save.py
* saving
|
2024-01-29 03:45:07 +11:00 |
|
Daniel Han-Chen
|
03ca52dc94
|
saving
|
2024-01-29 03:43:39 +11:00 |
|
Daniel Han-Chen
|
01e5c305f9
|
Merge branch 'main' into nightly
|
2024-01-29 03:43:19 +11:00 |
|
Daniel Han-Chen
|
e10e48893b
|
Update save.py
|
2024-01-29 03:43:17 +11:00 |
|
Daniel Han-Chen
|
5bd916b91b
|
Update mistral.py
|
2024-01-29 03:43:05 +11:00 |
|
Daniel Han-Chen
|
11ba2c520b
|
Mistral patch
|
2024-01-29 03:34:27 +11:00 |
|
Daniel Han
|
8faf469f02
|
Fix saving issues (#139)
* faster saving & inference
* Update llama.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* fast inference
* Update llama.py
* Update save.py
* Update llama.py
* Mistral correct RoPE scaling
* Max sequence lengths
* Apache 2
* fast_linear_forward
* Update utils.py
* Update utils.py
* No print
* Update utils.py
* Update utils.py
* inference
* Update llama.py
* Fast inference RoPE
* Update llama.py
* Update llama.py
* RoPE
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* LoRA
* Fast LoRA saving
* Update llama.py
* hidden_states
* q_len == 1
* q_len issue
* Update mistral.py
* Update mistral.py
* incorrect inference
* Update to transformers 4.37
* Graceful FA2 error + torch 2.1.1
* Update mapper.py
* Update pyproject.toml
* Fix saving and bnb-4bit
* Update fast_lora.py
* Update fast_lora.py
* remove patching
* Update llama.py
* Update llama.py
* Update swiglu.py
* Repatch
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update save.py
* Update fast_lora.py
* Update utils.py
* Update llama.py
* Update fast_lora.py
* Update swiglu.py
* Update save.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Revert "Update llama.py"
This reverts commit a208ec46e0.
* Update llama.py
* Works?
* Update pyproject.toml
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Swiglu
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* attention_mask
* Update llama.py
* Update llama.py
* labels
* Update mistral.py
* Update llama.py
* attention mask
* Update save.py
* Update save.py
* Update mistral.py
* attention mask
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update dpo.py
* Patch saving
* Update save.py
* Update save.py
* patch_saving_functions
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* print
|
2024-01-29 02:52:39 +11:00 |
|
Daniel Han-Chen
|
498dfb8acc
|
print
|
2024-01-29 02:42:08 +11:00 |
|
Daniel Han-Chen
|
a3d2b9b778
|
Update save.py
|
2024-01-29 02:15:52 +11:00 |
|
Daniel Han-Chen
|
9e00cc287a
|
Update save.py
|
2024-01-29 00:59:29 +11:00 |
|
Daniel Han-Chen
|
460de24ea2
|
Update save.py
|
2024-01-29 00:57:11 +11:00 |
|
Daniel Han-Chen
|
b060d7b621
|
Update save.py
|
2024-01-29 00:56:44 +11:00 |
|
Daniel Han-Chen
|
74b69775c2
|
Update save.py
|
2024-01-29 00:51:57 +11:00 |
|
Daniel Han-Chen
|
fef0589d6e
|
Update save.py
|
2024-01-29 00:51:45 +11:00 |
|
Daniel Han-Chen
|
9dec4b3f08
|
Update save.py
|
2024-01-29 00:49:31 +11:00 |
|
Daniel Han-Chen
|
ee0bf6fe66
|
Update save.py
|
2024-01-28 20:07:17 +11:00 |
|
Daniel Han-Chen
|
c69c166b82
|
patch_saving_functions
|
2024-01-28 18:12:11 +11:00 |
|
Daniel Han-Chen
|
ac02ba6c38
|
Update save.py
|
2024-01-28 18:08:52 +11:00 |
|
Daniel Han-Chen
|
20e524a596
|
Update save.py
|
2024-01-28 18:04:35 +11:00 |
|
Daniel Han-Chen
|
788e695180
|
Patch saving
|
2024-01-28 17:48:34 +11:00 |
|
Daniel Han-Chen
|
31222ced74
|
Merge branch 'main' into nightly
|
2024-01-28 17:48:28 +11:00 |
|
Daniel Han-Chen
|
893aab0e57
|
Update dpo.py
|
2024-01-28 17:20:49 +11:00 |
|
Daniel Han-Chen
|
d5c852e711
|
Update llama.py
|
2024-01-28 16:47:33 +11:00 |
|
Daniel Han-Chen
|
ddb48efd33
|
Update llama.py
|
2024-01-28 16:43:10 +11:00 |
|
Daniel Han-Chen
|
5fe166d32e
|
Update llama.py
|
2024-01-28 16:40:59 +11:00 |
|
Daniel Han-Chen
|
2d64e0a904
|
Update mistral.py
|
2024-01-28 16:37:21 +11:00 |
|
Daniel Han-Chen
|
2f73cb4049
|
Update llama.py
|
2024-01-28 16:31:01 +11:00 |
|
Daniel Han-Chen
|
6aa46ffff6
|
Update llama.py
|
2024-01-28 15:13:54 +11:00 |
|
Daniel Han-Chen
|
ee6f5096ed
|
attention mask
|
2024-01-28 13:53:06 +11:00 |
|
Daniel Han-Chen
|
f1b0fd0848
|
Update mistral.py
|
2024-01-28 13:37:38 +11:00 |
|
Daniel Han
|
1ecc0185a5
|
1 more bug (#138)
* faster saving & inference
* Update llama.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* fast inference
* Update llama.py
* Update save.py
* Update llama.py
* Mistral correct RoPE scaling
* Max sequence lengths
* Apache 2
* fast_linear_forward
* Update utils.py
* Update utils.py
* No print
* Update utils.py
* Update utils.py
* inference
* Update llama.py
* Fast inference RoPE
* Update llama.py
* Update llama.py
* RoPE
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* LoRA
* Fast LoRA saving
* Update llama.py
* hidden_states
* q_len == 1
* q_len issue
* Update mistral.py
* Update mistral.py
* incorrect inference
* Update to transformers 4.37
* Graceful FA2 error + torch 2.1.1
* Update mapper.py
* Update pyproject.toml
* Fix saving and bnb-4bit
* Update fast_lora.py
* Update fast_lora.py
* remove patching
* Update llama.py
* Update llama.py
* Update swiglu.py
* Repatch
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update llama.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update save.py
* Update fast_lora.py
* Update utils.py
* Update llama.py
* Update fast_lora.py
* Update swiglu.py
* Update save.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Revert "Update llama.py"
This reverts commit a208ec46e0.
* Update llama.py
* Works?
* Update pyproject.toml
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Swiglu
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update swiglu.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* Update fast_lora.py
* attention_mask
* Update llama.py
* Update llama.py
* labels
* Update mistral.py
* Update llama.py
* attention mask
* Update save.py
* Update save.py
|
2024-01-28 04:30:29 +11:00 |
|
Daniel Han-Chen
|
7663a32753
|
Update save.py
|
2024-01-28 04:29:52 +11:00 |
|
Daniel Han-Chen
|
a158003625
|
Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly
|
2024-01-28 04:29:35 +11:00 |
|
Daniel Han-Chen
|
36829b7ec4
|
Update save.py
|
2024-01-28 04:27:10 +11:00 |
|
Daniel Han-Chen
|
917ce15861
|
Merge branch 'main' into nightly
|
2024-01-28 04:20:15 +11:00 |
|