ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,000 commits 391 branches 58 tags 304 MiB
Commit graph

61 commits

Author SHA1 Message Date
Daniel Han-Chen
9c35a2c4b0 Update pyproject.toml 2024-03-17 22:08:33 +11:00
Daniel Han-Chen
718a6a1c84 Update pyproject.toml 2024-03-15 19:50:03 +11:00
Daniel Han-Chen
385c6d44a8 Update pyproject.toml 2024-03-15 19:49:09 +11:00
Daniel Han-Chen
9c9ede4680 Update pyproject.toml 2024-03-15 19:48:39 +11:00
Daniel Han-Chen
5c4241a240 Update pyproject.toml 2024-03-14 20:27:20 +11:00
Daniel Han-Chen
6841a303d9 Update pyproject.toml 2024-03-14 20:20:16 +11:00
Daniel Han-Chen
341b5f46e6 Update pyproject.toml 2024-03-14 20:12:54 +11:00
Daniel Han-Chen
6809846464 Update pyproject.toml 2024-03-14 20:12:02 +11:00
Daniel Han-Chen
77edfb10b7 Update pyproject.toml 2024-03-14 20:11:24 +11:00
Daniel Han-Chen
0ed19ec170 Update pyproject.toml 2024-03-14 20:10:10 +11:00
Daniel Han-Chen
1f4c625f2a Update pyproject.toml 2024-03-14 20:06:05 +11:00
Daniel Han-Chen
8fa0aab61c Update pyproject.toml 2024-03-14 20:04:01 +11:00
Daniel Han-Chen
eb61377632 Fix Colab 2024-03-14 19:02:29 +11:00
Daniel Han-Chen
b7c3190e97 Update pyproject.toml 2024-03-12 00:46:57 +11:00
Daniel Han-Chen
4d77c32425 Update pyproject.toml 2024-03-11 23:28:03 +11:00
Daniel Han-Chen
98573e8618 kaggle new 2024-03-11 23:21:27 +11:00
Daniel Han-Chen
4a794dd880 Update pyproject.toml 2024-03-11 20:28:09 +11:00
Daniel Han-Chen
5a693a107d Layernorms 2024-03-05 23:58:00 +11:00
Daniel Han-Chen
e0a2463738 Update pyproject.toml 2024-03-05 20:07:44 +11:00
Daniel Han-Chen
e032445694 Update pyproject.toml 2024-03-02 02:39:11 +11:00
Daniel Han-Chen
c970a2b3be Small fixes 2024-03-02 02:38:40 +11:00
Daniel Han-Chen
db87262625 Update pyproject.toml 2024-03-01 04:16:25 +11:00
Daniel Han-Chen
9a1b28d691 Update pyproject.toml 2024-02-23 01:55:25 +11:00
Daniel Han-Chen
0ffd7b46f3 linking 2024-02-19 19:39:47 +11:00
Daniel Han-Chen
22378e95cc Update pyproject.toml 2024-02-18 23:12:37 +11:00
Daniel Han-Chen
b660132380 Saving, LlamaRotaryEmbedding issues 2024-02-14 23:11:06 +11:00
Daniel Han-Chen
7da7afcc78 __version__ 2024-02-07 03:20:55 +11:00
Daniel Han-Chen
9e2b00e167 __version__ 2024-02-07 03:19:33 +11:00
Daniel Han-Chen
9c3849fc1d Update pyproject.toml 2024-02-07 03:18:02 +11:00
Daniel Han-Chen
03ed3a83d5 Torch 2.2.0 2024-02-05 17:38:01 +11:00
Daniel Han-Chen
8ed03f5f45 Update pyproject.toml 2024-01-27 17:38:30 +11:00
Daniel Han-Chen
0474451a6a Update pyproject.toml 2024-01-25 03:55:26 +11:00
Daniel Han-Chen
bbf5ef65af Graceful FA2 error + torch 2.1.1 2024-01-25 03:46:23 +11:00
Daniel Han-Chen
5ea888c578 Update to transformers 4.37 2024-01-25 02:29:37 +11:00
Daniel Han-Chen
4112eb4a3d Update pyproject.toml 2024-01-19 03:41:00 +11:00
Daniel Han-Chen
59d7475336 Update pyproject.toml 2024-01-19 03:35:17 +11:00
Daniel Han
c1ac4d2707
 		Fix some bugs (#83) 
* Fix tokenizer, dropout, bias for LoRA

* Update loader.py

* Fix LoRA downcasting

* Update _utils.py

* Saving to GGUF

* fix

* colab_quantize_to_gguf

* move save modules

* save module

* Update __init__.py

* Update save.py

* Temp downgrade due to TRL issue

* Fix up bugs
 2024-01-11 04:08:03 +11:00
Daniel Han
1e3f77208b
 		GGUF conv + TRL downgrade (#76) 
* Fix tokenizer, dropout, bias for LoRA

* Update loader.py

* Fix LoRA downcasting

* Update _utils.py

* Saving to GGUF

* fix

* colab_quantize_to_gguf

* move save modules

* save module

* Update __init__.py

* Update save.py

* Temp downgrade due to TRL issue
 2024-01-09 20:20:53 +11:00
Daniel Han
0369e7aa7a
 		Nightly (#56) 
* Pytorch 2.1.1 install path, 4bit loading

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Spelling errors

* Update __init__.py
 2023-12-28 04:19:12 +11:00
Daniel Han-Chen
627acc4bb3 Fix Pytorch 2.1.1 2023-12-25 23:28:05 +11:00
Daniel Han-Chen
399f8ed56f Update Colab to CUDA 12.1 2023-12-15 16:35:24 +11:00
Daniel Han-Chen
c931ec40c6 Fix packaging, readme 2023-12-15 12:57:08 +11:00
Daniel Han-Chen
08787b7021 Mistral, GQA support 2023-12-11 23:58:36 +11:00
Daniel Han
4b97a810b5
 		Pre-release 2023 December version (Mistral, Prelim DPO, WSL, bug fixes) (#16) 
* Immediate bug fixes

* Update README.md

* Update README.md

* Update llama.py

* Update llama.py

* Rope Scaling and max_seq_len will change

* Update llama.py

* new images

* Update README.md

* Images

* Update README.md

* Update pyproject.toml

* GQA

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py
 2023-12-06 02:59:22 +11:00
Daniel Han-Chen
cdcd2a7953 images and exclusion 2023-12-01 01:22:09 +11:00
Daniel Han-Chen
e1d02652d4 Update pyproject.toml 2023-11-30 20:45:04 +11:00
Daniel Han-Chen
0349faa87a Update pyproject.toml 2023-11-30 20:24:40 +11:00
Daniel Han-Chen
6c075d171e Update pyproject.toml 2023-11-30 20:23:48 +11:00
Daniel Han-Chen
21e83552e1 Update pyproject.toml 2023-11-30 20:20:45 +11:00
Daniel Han-Chen
68af199a96 Update pyproject.toml 2023-11-30 17:11:30 +11:00