Daniel Han
32a1be7ec5
Update __init__.py
2024-11-03 00:22:38 -07:00
Daniel Han
9803b49150
Update __init__.py
2024-11-02 23:14:41 -07:00
Daniel Han
271fee53d8
CE Loss patching
2024-11-02 19:20:48 -07:00
Daniel Han
e097ba3e7b
Utils
2024-11-02 19:08:57 -07:00
Daniel Han
4cb664e854
Tied weights
2024-10-31 16:25:26 -07:00
Daniel Han
8aae7c5f0b
Revert "Tied weights"
...
This reverts commit 42bb212916
2024-10-31 12:38:20 -07:00
Daniel Han
42bb212916
Tied weights
2024-10-31 12:36:21 -07:00
Daniel Han
bc6244c994
Update cross_entropy_loss.py
2024-10-31 02:00:04 -07:00
Daniel Han
edc7a78441
Update cross_entropy_loss.py
2024-10-31 01:56:03 -07:00
Daniel Han
723d2af546
Update cross_entropy_loss.py
2024-10-31 01:23:41 -07:00
Daniel Han
1f07600747
Update cross_entropy_loss.py
2024-10-30 17:35:20 -07:00
Daniel Han
04f08cbbad
Update cross_entropy_loss.py
2024-10-30 17:26:34 -07:00
Daniel Han
02fd0035e6
Update cross_entropy_loss.py
2024-10-30 17:19:30 -07:00
Daniel Han
76e5ebc7ab
Update cross_entropy_loss.py
2024-10-30 16:55:24 -07:00
Daniel Han
423856a68d
Update cross_entropy_loss.py
2024-10-30 16:53:04 -07:00
Daniel Han
5799884754
Update cross_entropy_loss.py
2024-10-30 16:50:56 -07:00
Daniel Han
9bf61e65d9
Update cross_entropy_loss.py
2024-10-30 16:46:33 -07:00
Daniel Han
51b4d25534
Update cross_entropy_loss.py
2024-10-30 16:37:37 -07:00
Daniel Han
8549887cd4
Update cross_entropy_loss.py
2024-10-30 15:46:09 -07:00
Daniel Han
b6192e52fc
Update cross_entropy_loss.py
2024-10-30 15:33:37 -07:00
Daniel Han
b6471d38ed
Update cross_entropy_loss.py
2024-10-30 14:57:14 -07:00
Daniel Han
303d32cfb5
Update _utils.py
2024-10-30 14:01:49 -07:00
Daniel Han
b5b781c43b
Update _utils.py
2024-10-30 14:00:03 -07:00
Daniel Han
e97a0f4c46
Update _utils.py
2024-10-30 13:54:11 -07:00
Daniel Han
85a2b43455
Update _utils.py
2024-10-30 13:51:10 -07:00
Daniel Han
d69641ed76
Update __init__.py
2024-10-30 13:47:21 -07:00
Daniel Han
c64be6ced6
Update __init__.py
2024-10-30 13:44:05 -07:00
Daniel Han
980f17c90a
Update _utils.py
2024-10-30 13:35:01 -07:00
Daniel Han
b536c93f30
Update pyproject.toml
2024-10-30 13:16:00 -07:00
Daniel Han
e517fd384d
Bug fixes
2024-10-30 13:11:43 -07:00
Daniel Han
36d07f101b
Feat/all tmp ( #1219 )
...
* Update save.py
Check whether path is in /tmp dir for Kaggle environment
* Update save.py
Move temporary_location to /tmp in Kaggle
* Enhance Kaggle environment support in save and tokenizer utilities
---------
Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
2024-10-30 00:43:03 -07:00
Daniel Han
b95c275a7c
Update cross_entropy_loss.py
2024-10-28 15:01:04 -07:00
Daniel Han
d4506e01d5
Update cross_entropy_loss.py
2024-10-28 14:47:11 -07:00
Daniel Han
ede5d5893a
Update cross_entropy_loss.py
2024-10-28 14:30:06 -07:00
Daniel Han
a859b5d796
Update _utils.py
2024-10-28 10:41:31 -07:00
Daniel Han
e8855dfd4f
Update _utils.py
2024-10-28 01:12:33 -07:00
Daniel Han
2748eecc9d
More patching
2024-10-28 01:10:23 -07:00
Daniel Han
67c258b4fc
Revert "ignored labels"
...
This reverts commit 110ee41971
2024-10-27 22:18:05 -07:00
Daniel Han
110ee41971
ignored labels
2024-10-27 22:10:59 -07:00
Daniel Han
54bf89c11f
Typo
2024-10-27 19:09:27 -07:00
Daniel Han
f14d37a778
Update llama.py
2024-10-27 19:08:14 -07:00
Daniel Han
1254304ea9
Fix pad token
2024-10-27 19:06:57 -07:00
Daniel Han
0a445a417a
Update _utils.py
2024-10-27 17:34:33 -07:00
Daniel Han
94d03dba99
Unk token issues
2024-10-27 17:32:26 -07:00
Daniel Han
cdd128f2eb
Merge branch 'main' into nightly
2024-10-27 16:24:20 -07:00
Daniel Han
a9afc2f291
Merge branch 'main' of https://github.com/unslothai/unsloth
2024-10-27 15:09:42 -07:00
Daniel Han
6de3d3b858
Update _utils.py
2024-10-27 15:09:35 -07:00
Edd
1d1d36de46
Fix/casting continue pretraining ( #1200 )
...
* Bring back float32 if float16 instead of bfloat16
* Refactor mixed precision handling for lm_head and embed_tokens to ensure correct dtype usage
* Fix dtype retrieval for embed_tokens and lm_head in mixed precision training
* Fix dtype retrieval for embed_tokens and lm_head to use weight dtype in mixed precision training
* Fix dtype handling for embed_tokens and lm_head to ensure correct float32 usage in mixed precision training
* Fix dtype assignment for lm_head modules to ensure correct weight dtype usage in mixed precision training
2024-10-27 15:06:45 -07:00
Daniel Han
8faac33203
Update pyproject.toml
2024-10-26 18:05:55 -07:00
Daniel Han
9f8b4589c0
Torch 2.5
2024-10-26 18:03:15 -07:00
