Daniel Han-Chen
|
5a5d34b8ae
|
Update mapper.py
|
2024-01-25 03:47:23 +11:00 |
|
Daniel Han-Chen
|
bbf5ef65af
|
Graceful FA2 error + torch 2.1.1
|
2024-01-25 03:46:23 +11:00 |
|
Daniel Han-Chen
|
5ea888c578
|
Update to transformers 4.37
|
2024-01-25 02:29:37 +11:00 |
|
Daniel Han-Chen
|
d2f1521a49
|
incorrect inference
|
2024-01-23 23:23:05 +11:00 |
|
Daniel Han-Chen
|
f186fe9bc9
|
Update mistral.py
|
2024-01-23 19:44:45 +11:00 |
|
Daniel Han-Chen
|
e184b06c4b
|
Update mistral.py
|
2024-01-23 19:28:17 +11:00 |
|
Daniel Han-Chen
|
b314500993
|
q_len issue
|
2024-01-23 19:23:58 +11:00 |
|
Daniel Han-Chen
|
d6e85d7731
|
q_len == 1
|
2024-01-23 19:17:42 +11:00 |
|
Daniel Han-Chen
|
5d9e68181e
|
hidden_states
|
2024-01-23 19:11:17 +11:00 |
|
Daniel Han-Chen
|
f311a8efcc
|
Update llama.py
|
2024-01-23 18:04:20 +11:00 |
|
Daniel Han-Chen
|
eeee6333ec
|
Merge branch 'main' into nightly
|
2024-01-23 18:04:10 +11:00 |
|
Daniel Han
|
a833f40346
|
2-4x faster native HF inference (#119)
* faster saving & inference
* Update llama.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* fast inference
* Update llama.py
* Update save.py
* Update llama.py
* Mistral correct RoPE scaling
* Max sequence lengths
* Apache 2
* fast_linear_forward
* Update utils.py
* Update utils.py
* No print
* Update utils.py
* Update utils.py
* inference
* Update llama.py
* Fast inference RoPE
* Update llama.py
* Update llama.py
* RoPE
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* LoRA
* Fast LoRA saving
|
2024-01-23 03:55:24 +11:00 |
|
Daniel Han-Chen
|
20d8f223d7
|
Fast LoRA saving
|
2024-01-23 03:47:28 +11:00 |
|
Daniel Han-Chen
|
1bb1c3c2b9
|
LoRA
|
2024-01-23 03:36:50 +11:00 |
|
Daniel Han-Chen
|
24c7a67556
|
Update llama.py
|
2024-01-23 02:44:52 +11:00 |
|
Daniel Han-Chen
|
d87ef86991
|
Update llama.py
|
2024-01-23 02:22:37 +11:00 |
|
Daniel Han-Chen
|
a77c448939
|
Update llama.py
|
2024-01-23 02:18:37 +11:00 |
|
Daniel Han-Chen
|
5260ec2a0a
|
Update llama.py
|
2024-01-23 02:13:01 +11:00 |
|
Daniel Han-Chen
|
716e03fe1b
|
Update llama.py
|
2024-01-23 02:09:35 +11:00 |
|
Daniel Han-Chen
|
00f50876f7
|
Update llama.py
|
2024-01-23 02:03:25 +11:00 |
|
Daniel Han-Chen
|
e5b5333137
|
Update llama.py
|
2024-01-23 02:00:10 +11:00 |
|
Daniel Han-Chen
|
9a5062e6c4
|
Update llama.py
|
2024-01-23 01:44:10 +11:00 |
|
Daniel Han-Chen
|
1289ae825b
|
RoPE
|
2024-01-23 01:41:20 +11:00 |
|
Daniel Han-Chen
|
7e4140ebfc
|
Update llama.py
|
2024-01-23 01:37:36 +11:00 |
|
Daniel Han-Chen
|
1ba28d8e26
|
Update llama.py
|
2024-01-23 01:33:51 +11:00 |
|
Daniel Han-Chen
|
3e1b244d5e
|
Fast inference RoPE
|
2024-01-23 01:29:03 +11:00 |
|
Daniel Han-Chen
|
8647f0e86e
|
Update llama.py
|
2024-01-23 01:06:34 +11:00 |
|
Daniel Han-Chen
|
085a8e944a
|
inference
|
2024-01-23 00:32:57 +11:00 |
|
Daniel Han-Chen
|
f41a437540
|
Update utils.py
|
2024-01-22 22:34:33 +11:00 |
|
Daniel Han-Chen
|
31f0c9c08d
|
Update utils.py
|
2024-01-22 22:31:38 +11:00 |
|
Daniel Han-Chen
|
4220f6a6dc
|
No print
|
2024-01-22 22:26:55 +11:00 |
|
Daniel Han-Chen
|
e1cbc9e423
|
Update utils.py
|
2024-01-22 22:21:29 +11:00 |
|
Daniel Han-Chen
|
050c61bc0b
|
Update utils.py
|
2024-01-22 20:04:27 +11:00 |
|
Daniel Han-Chen
|
7c3b647ba7
|
fast_linear_forward
|
2024-01-22 20:01:59 +11:00 |
|
Daniel Han-Chen
|
8c613e851f
|
Apache 2
|
2024-01-22 19:36:17 +11:00 |
|
Daniel Han-Chen
|
a18f982e67
|
Max sequence lengths
|
2024-01-22 19:31:34 +11:00 |
|
Daniel Han-Chen
|
e38485feaa
|
Mistral correct RoPE scaling
|
2024-01-22 18:18:23 +11:00 |
|
Daniel Han-Chen
|
278de9f375
|
Update llama.py
|
2024-01-22 04:33:44 +11:00 |
|
Daniel Han-Chen
|
0666589ace
|
Update save.py
|
2024-01-22 04:28:24 +11:00 |
|
Daniel Han-Chen
|
e34393f975
|
Update llama.py
|
2024-01-22 04:25:37 +11:00 |
|
Daniel Han-Chen
|
2a3d4f3a8d
|
fast inference
|
2024-01-22 04:18:42 +11:00 |
|
Daniel Han-Chen
|
a5ab4dc21a
|
Merge branch 'main' into nightly
|
2024-01-22 01:58:00 +11:00 |
|
Daniel Han
|
b370c9c8aa
|
Hotfix (#118)
* faster saving & inference
* Update llama.py
* Update save.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
|
2024-01-21 22:20:22 +11:00 |
|
Daniel Han-Chen
|
8828eceb5b
|
Update llama.py
|
2024-01-21 22:18:53 +11:00 |
|
Daniel Han-Chen
|
fcde58859b
|
Update llama.py
|
2024-01-21 20:06:14 +11:00 |
|
Daniel Han-Chen
|
2f80890578
|
Update llama.py
|
2024-01-21 19:21:56 +11:00 |
|
Daniel Han-Chen
|
7be801ff8d
|
Update llama.py
|
2024-01-21 19:10:48 +11:00 |
|
Daniel Han-Chen
|
92512e670e
|
Update llama.py
|
2024-01-21 19:01:45 +11:00 |
|
Daniel Han-Chen
|
5c927e4930
|
Update mistral.py
|
2024-01-21 19:01:28 +11:00 |
|
Daniel Han-Chen
|
fe2bc30987
|
Update llama.py
|
2024-01-21 18:52:25 +11:00 |
|