Commit graph

27 commits

Author SHA1 Message Date
Daniel Han-Chen
4112eb4a3d Update pyproject.toml 2024-01-19 03:41:00 +11:00
Daniel Han-Chen
59d7475336 Update pyproject.toml 2024-01-19 03:35:17 +11:00
Daniel Han
c1ac4d2707
Fix some bugs (#83)
* Fix tokenizer, dropout, bias for LoRA

* Update loader.py

* Fix LoRA downcasting

* Update _utils.py

* Saving to GGUF

* fix

* colab_quantize_to_gguf

* move save modules

* save module

* Update __init__.py

* Update save.py

* Temp downgrade due to TRL issue

* Fix up bugs
2024-01-11 04:08:03 +11:00
Daniel Han
1e3f77208b
GGUF conv + TRL downgrade (#76)
* Fix tokenizer, dropout, bias for LoRA

* Update loader.py

* Fix LoRA downcasting

* Update _utils.py

* Saving to GGUF

* fix

* colab_quantize_to_gguf

* move save modules

* save module

* Update __init__.py

* Update save.py

* Temp downgrade due to TRL issue
2024-01-09 20:20:53 +11:00
Daniel Han
0369e7aa7a
Nightly (#56)
* Pytorch 2.1.1 install path, 4bit loading

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Spelling errors

* Update __init__.py
2023-12-28 04:19:12 +11:00
Daniel Han-Chen
627acc4bb3 Fix Pytorch 2.1.1 2023-12-25 23:28:05 +11:00
Daniel Han-Chen
399f8ed56f Update Colab to CUDA 12.1 2023-12-15 16:35:24 +11:00
Daniel Han-Chen
c931ec40c6 Fix packaging, readme 2023-12-15 12:57:08 +11:00
Daniel Han-Chen
08787b7021 Mistral, GQA support 2023-12-11 23:58:36 +11:00
Daniel Han
4b97a810b5
Pre-release 2023 December version (Mistral, Prelim DPO, WSL, bug fixes) (#16)
* Immediate bug fixes

* Update README.md

* Update README.md

* Update llama.py

* Update llama.py

* Rope Scaling and max_seq_len will change

* Update llama.py

* new images

* Update README.md

* Images

* Update README.md

* Update pyproject.toml

* GQA

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py
2023-12-06 02:59:22 +11:00
Daniel Han-Chen
cdcd2a7953 images and exclusion 2023-12-01 01:22:09 +11:00
Daniel Han-Chen
e1d02652d4 Update pyproject.toml 2023-11-30 20:45:04 +11:00
Daniel Han-Chen
0349faa87a Update pyproject.toml 2023-11-30 20:24:40 +11:00
Daniel Han-Chen
6c075d171e Update pyproject.toml 2023-11-30 20:23:48 +11:00
Daniel Han-Chen
21e83552e1 Update pyproject.toml 2023-11-30 20:20:45 +11:00
Daniel Han-Chen
68af199a96 Update pyproject.toml 2023-11-30 17:11:30 +11:00
Daniel Han-Chen
8e3f94fe1b Update pyproject.toml 2023-11-30 17:10:10 +11:00
Daniel Han-Chen
dbfb5e70d3 Update pyproject.toml 2023-11-30 17:08:40 +11:00
Daniel Han-Chen
67f711d289 Update pyproject.toml 2023-11-30 17:06:51 +11:00
Daniel Han-Chen
fff760cdc4 requirements 2023-11-30 17:05:49 +11:00
Daniel Han-Chen
94843dd2a9 requirements 2023-11-30 17:04:20 +11:00
Daniel Han-Chen
54d6cbd228 dependencies 2023-11-30 16:59:31 +11:00
Daniel Han-Chen
bac8c4fef6 Update pyproject.toml 2023-11-30 16:55:38 +11:00
Daniel Han-Chen
1a505d31b0 Update pyproject.toml 2023-11-30 16:54:10 +11:00
Daniel Han-Chen
47b0964b0c Update pyproject.toml 2023-11-30 16:52:05 +11:00
Daniel Han-Chen
0b14f48b88 Update pyproject.toml 2023-11-30 16:51:13 +11:00
Daniel Han-Chen
d45e40ad71 First upload of Unsloth code 2023-11-30 03:51:54 +11:00