Commit graph

48 commits

Author SHA1 Message Date
Daniel Han
d3887c7fd9
Update README.md (#81) 2024-01-10 23:10:48 +11:00
shimmy
01d7f58e11
Update logos (#79)
* HF Perf Button

* Update README.md

Adding new buttons cleanup

* Update README.md

* Delete images/Discord.png

* Delete images/try live demo green.png

* new transparent logos

* Revamping page

* Revamp mainpage

* Update README.md

* Update README.md
2024-01-10 23:02:20 +11:00
Daniel Han
d17202869d
Fix tokenizer, bias, dropout supported for LoRA (#69)
* Fix tokenizer, dropout, bias for LoRA

* Update loader.py
2024-01-06 19:13:39 +11:00
Daniel Han
3fc1305d75
Update README.md (#65) 2024-01-06 04:14:38 +11:00
Daniel Han
f1a4849bb7
Update README.md (#64) 2024-01-06 04:13:15 +11:00
Daniel Han
b7cc0f119f
Update README.md (#63) 2024-01-05 17:48:21 +11:00
Daniel Han
40f384c723
Fix tokenizer + docs (#62)
* Patch tokenizer

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Cleanup

* Add comments to functions

* Update rope_embedding.py

* Update rope_embedding.py

* Update llama.py

* New logos!

* Update README.md
2024-01-05 04:08:53 +11:00
Daniel Han-Chen
a3e4f47ebf Add tokenizer checking + TinyLlama 2024-01-02 03:20:11 +11:00
Daniel Han-Chen
033a897af3 Update README.md 2023-12-31 19:26:34 +11:00
Daniel Han-Chen
c6a0e07029 Update DPO readme 2023-12-31 19:24:30 +11:00
Daniel Han-Chen
0a3477993a DPO 2023-12-31 17:57:45 +11:00
Daniel Han-Chen
74826077da Fix Kaggle issues 2023-12-31 01:20:04 +11:00
Daniel Han
0369e7aa7a
Nightly (#56)
* Pytorch 2.1.1 install path, 4bit loading

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Spelling errors

* Update __init__.py
2023-12-28 04:19:12 +11:00
Daniel Han-Chen
a3ed0dc4f4 Fix inference 2023-12-27 03:51:31 +11:00
Daniel Han-Chen
627acc4bb3 Fix Pytorch 2.1.1 2023-12-25 23:28:05 +11:00
Daniel Han
de855c2afa
Small fixes (#48)
* Fix generation for GQA

* Update _utils.py

* flash attn

* Update _utils.py

* Update llama.py

* Update mistral.py

* platform

* Update _utils.py

* Update llama.py

* Logo changed

* Update README.md

* Update README.md
2023-12-23 04:22:48 +11:00
Daniel Han-Chen
b0f5ef5526 Torch version, docs, readme, general loader 2023-12-18 04:23:16 +11:00
Daniel Han-Chen
f380cc1170 Fix Mistral
BlockDiagonalCausalMask fix courtesy of https://github.com/Rypo
2023-12-16 13:14:33 +11:00
Daniel Han-Chen
c931ec40c6 Fix packaging, readme 2023-12-15 12:57:08 +11:00
Daniel Han
27bbd6b2cd Update README.md 2023-12-14 15:10:17 +11:00
Daniel Han
50f55b2a38 Update README.md 2023-12-14 12:33:51 +11:00
Daniel Han
4b97a810b5
Pre-release 2023 December version (Mistral, Prelim DPO, WSL, bug fixes) (#16)
* Immediate bug fixes

* Update README.md

* Update README.md

* Update llama.py

* Update llama.py

* Rope Scaling and max_seq_len will change

* Update llama.py

* new images

* Update README.md

* Images

* Update README.md

* Update pyproject.toml

* GQA

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py
2023-12-06 02:59:22 +11:00
Daniel Han-Chen
3aa16bb452 Sticker 2023-12-02 03:08:16 +11:00
Daniel Han
8dae2ee050
Update README.md 2023-12-01 21:54:31 +11:00
Daniel Han
0718910789
Update README.md 2023-12-01 19:54:04 +11:00
Daniel Han
c2197c2210
Update README.md 2023-12-01 17:50:40 +11:00
Daniel Han
28cc035fba
Update README.md 2023-12-01 16:07:53 +11:00
Daniel Han
0edd953258
Update README.md 2023-12-01 16:07:38 +11:00
Daniel Han
afa8ee77ac
Update README.md 2023-12-01 14:42:52 +11:00
Daniel Han
4e519995d0
Update README.md 2023-12-01 14:42:42 +11:00
Daniel Han
d9743a3089
Update README.md 2023-12-01 14:38:03 +11:00
Daniel Han
b69c8989f3
Update README.md 2023-12-01 14:35:51 +11:00
Daniel Han
17172ab180
Update README.md 2023-12-01 14:11:49 +11:00
Daniel Han
b2df01eb08
Update README.md 2023-12-01 13:57:28 +11:00
Daniel Han
fc58d3f5bd
Update README.md 2023-12-01 13:52:05 +11:00
Daniel Han
c5ec42291b
Update README.md 2023-12-01 13:50:13 +11:00
Daniel Han
f383e5dbd7
Update README.md 2023-12-01 13:49:53 +11:00
Daniel Han
ee641a0754
Update README.md 2023-12-01 13:43:26 +11:00
Daniel Han
ef43dc3f4e
Update README.md 2023-12-01 13:40:52 +11:00
Daniel Han
0d1a04511e
Update README.md 2023-12-01 13:40:39 +11:00
Daniel Han
ff86769c3e
Update README.md 2023-12-01 13:37:27 +11:00
Daniel Han
81089a0d25
Update README.md 2023-12-01 03:29:31 +11:00
Daniel Han
cfa9ba41c1
Update README.md 2023-12-01 02:34:41 +11:00
Daniel Han
07125849c1
Update README.md 2023-12-01 01:38:47 +11:00
Daniel Han
bd424ee105
Update README.md 2023-12-01 01:32:45 +11:00
Daniel Han
548c5187cd
Update README.md 2023-11-30 04:18:16 +11:00
Daniel Han-Chen
d45e40ad71 First upload of Unsloth code 2023-11-30 03:51:54 +11:00
Daniel Han
44419b9741
Initial commit 2023-11-30 03:50:09 +11:00