Commit graph

389 commits

Author SHA1 Message Date
Daniel Han-Chen
82eea75cde torch compile 2024-02-02 20:29:35 +11:00
Daniel Han-Chen
e748078095 Update llama.py 2024-02-02 20:24:44 +11:00
Daniel Han-Chen
9146fa443d Update llama.py 2024-02-02 20:24:28 +11:00
Daniel Han-Chen
a5a123db08 Update llama.py 2024-02-02 20:20:14 +11:00
Daniel Han-Chen
82ead808d5 Update llama.py 2024-02-02 20:19:15 +11:00
Daniel Han-Chen
1497521e5c Update mistral.py 2024-02-02 20:06:52 +11:00
Daniel Han-Chen
c3c454a729 Update llama.py 2024-02-02 20:06:31 +11:00
Daniel Han-Chen
f299c9cde1 Update llama.py 2024-02-02 19:44:52 +11:00
Daniel Han-Chen
0e1d67d4e1 fast inference 2024-02-02 19:07:41 +11:00
Daniel Han-Chen
168ded977e Update llama.py 2024-02-02 18:28:05 +11:00
Daniel Han-Chen
bf441055ca faster inference 2024-02-02 18:14:31 +11:00
Daniel Han-Chen
7c2b04254c Update llama.py 2024-02-02 16:59:02 +11:00
Daniel Han-Chen
ca99d7c194 Update mistral.py 2024-02-02 16:46:30 +11:00
Daniel Han-Chen
40e8848c4e Update llama.py 2024-02-02 15:56:56 +11:00
Daniel Han-Chen
6cc9835021 Update llama.py 2024-02-02 13:52:12 +11:00
Daniel Han-Chen
7ad1a1fa62 Update llama.py 2024-02-02 04:18:34 +11:00
Daniel Han-Chen
0b661a23b9 Update llama.py 2024-02-02 03:55:36 +11:00
Daniel Han-Chen
da64d3403c Update llama.py 2024-02-01 23:54:01 +11:00
Daniel Han-Chen
abc47836dc Update llama.py 2024-02-01 23:41:32 +11:00
Daniel Han-Chen
f231c4f395 Update llama.py 2024-02-01 23:41:23 +11:00
Daniel Han-Chen
5f3c51b394 Update llama.py 2024-02-01 23:41:11 +11:00
Daniel Han-Chen
e0ea238256 Update llama.py 2024-02-01 23:40:36 +11:00
Daniel Han-Chen
73f63d6884 Update llama.py 2024-02-01 23:38:07 +11:00
Daniel Han-Chen
e4b5e38800 inference 2024-02-01 23:17:53 +11:00
Daniel Han-Chen
334c5ed1f0 Update llama.py 2024-02-01 22:48:54 +11:00
Daniel Han-Chen
cd39f6108f lm_head 2024-02-01 22:34:33 +11:00
Daniel Han-Chen
24c4c37b7c revert 2024-02-01 22:21:35 +11:00
Daniel Han-Chen
e791db9b06 Update llama.py 2024-02-01 20:12:59 +11:00
Daniel Han-Chen
1793a16c8f faster inference 2024-02-01 20:03:54 +11:00
Daniel Han-Chen
19fb50e244 Update utils.py 2024-02-01 19:56:54 +11:00
Daniel Han-Chen
b83cea7cb4 Update llama.py 2024-02-01 19:56:06 +11:00
Daniel Han-Chen
8920cafbe7 inference 2024-02-01 19:46:38 +11:00
Daniel Han-Chen
38b59825b1 Update llama.py 2024-02-01 19:36:36 +11:00
Daniel Han-Chen
e8ec80a4c2 Update llama.py 2024-02-01 19:19:44 +11:00
Daniel Han-Chen
a2cb7a113b Update llama.py 2024-02-01 19:07:30 +11:00
Daniel Han-Chen
a5ee70b63f Update llama.py 2024-02-01 18:34:43 +11:00
Daniel Han-Chen
e2f0dd8683 Update llama.py 2024-02-01 18:16:46 +11:00
Daniel Han-Chen
3f0ddf0c7c Update llama.py 2024-02-01 18:16:15 +11:00
Daniel Han-Chen
e90b3bf192 Update llama.py 2024-02-01 17:59:21 +11:00
Daniel Han-Chen
57044509ad Update llama.py 2024-02-01 17:44:22 +11:00
Daniel Han-Chen
cf4b58eeb6 inference 2024-02-01 17:20:02 +11:00
Daniel Han-Chen
648c79ec1b faster inference 2024-02-01 03:47:51 +11:00
Daniel Han-Chen
20f19391e6 Update mistral.py 2024-02-01 03:05:02 +11:00
Daniel Han-Chen
e2f72fe52f Revert 2024-02-01 03:04:46 +11:00
Daniel Han-Chen
329f80ac4c Update llama.py 2024-02-01 02:47:57 +11:00
Daniel Han-Chen
713a95ca0e Inference 2024-02-01 02:46:26 +11:00
Daniel Han-Chen
acbdef7ff5 padding 2024-01-31 20:16:08 +11:00
Daniel Han-Chen
0dc26ed98a Update llama.py 2024-01-31 20:06:28 +11:00
Daniel Han-Chen
9f31254539 Fix SDPA 2024-01-31 20:02:21 +11:00
Daniel Han-Chen
7227de48cf Update llama.py 2024-01-31 19:48:33 +11:00