Daniel Han
4ff247ab18
Fix DPO, ORPO
2024-10-24 00:17:26 -07:00
Daniel Han
e561366365
Update cross_entropy_loss.py
2024-10-23 22:18:24 -07:00
Daniel Han
b821f20b36
n_items
2024-10-23 22:13:45 -07:00
Daniel Han
28e6eeabd8
Update _utils.py
2024-10-23 03:14:48 -07:00
Daniel Han
06f5d75b81
Update tokenizer_utils.py
2024-10-23 03:04:22 -07:00
Daniel Han
28958397ee
Disable Flex Attention
2024-10-23 02:58:40 -07:00
Ikko Eltociear Ashimine
30bf33957d
chore: update chat_templates.py ( #1166 )
...
orginal -> original
2024-10-23 00:59:02 -07:00
timothelaborie
aabb5ff54b
Installation guide ( #1165 )
2024-10-23 00:55:26 -07:00
Daniel Han
b3e00335c1
Update tokenizer_utils.py
2024-10-22 01:28:38 -07:00
Daniel Han
c0f0fc987d
Update tokenizer_utils.py
2024-10-22 01:22:13 -07:00
Daniel Han
101389d728
Update tokenizer_utils.py
2024-10-22 01:09:20 -07:00
Daniel Han
aa2b20763e
Update tokenizer_utils.py
2024-10-22 01:05:41 -07:00
Daniel Han
4f7c527ae0
Update tokenizer_utils.py
2024-10-22 00:57:36 -07:00
Daniel Han
ef842120d2
Update tokenizer_utils.py
2024-10-22 00:55:47 -07:00
Daniel Han
106f213f40
Patch processing_class
2024-10-22 00:53:38 -07:00
Daniel Han
f4ae585405
Update mistral.py
2024-10-22 00:29:30 -07:00
Daniel Han
f0aca9073e
Fix TRL
2024-10-21 01:02:53 -07:00
Daniel Han
1f52468fa3
Update save.py
2024-10-20 01:52:21 -07:00
Daniel Han
9327d90002
Update _utils.py
2024-10-18 23:10:30 -07:00
Daniel Han
d7850d8b2e
Fix get_token
2024-10-18 23:08:30 -07:00
vo1d-ai
12bdd86636
fix: compute_loss bug ( #1151 )
...
Currently, Unsloth doesn't pass additional parameters to Trainer.compute_loss such as return_outputs. This leads to errors when calling trainer.evaluate(). This change fixes the bug by properly passing parameters to Trainer.compute_loss.
2024-10-18 20:46:07 -07:00
Daniel Han
3085f4c3da
Update _utils.py
2024-10-17 20:50:05 -07:00
Daniel Han
b3e85e915e
Update README.md
2024-10-17 20:46:11 -07:00
Daniel Han
eb533dbf14
Update README.md
2024-10-17 20:45:40 -07:00
Daniel Han
e210840ba9
Gradient Accumulation Fix ( #1146 )
...
* Unsloth Zoo
* Update trainer.py
* Update trainer.py
* Update cross_entropy_loss.py
* n_items
* Update llama.py
* kwargs
* Remove extraneous f prefixes (#1133 )
Co-authored-by: Emil Sadek <esadek@users.noreply.github.com>
* Update __init__.py
* kwargs
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Fix GA
* Update _utils.py
* Update llama.py
* Update tokenizer_utils.py
* Warn on old versions
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
---------
Co-authored-by: Emil Sadek <esadek@hotmail.com>
Co-authored-by: Emil Sadek <esadek@users.noreply.github.com>
2024-10-17 20:43:07 -07:00
Daniel Han
a395211e02
Update mapper.py
2024-10-16 21:48:05 -07:00
Daniel Han
38663b01f5
Gradient Accumulation Fix ( #1134 )
...
* Unsloth Zoo
* Update trainer.py
* Update trainer.py
* Update cross_entropy_loss.py
* n_items
* Update llama.py
* kwargs
* Remove extraneous f prefixes (#1133 )
Co-authored-by: Emil Sadek <esadek@users.noreply.github.com>
* Update __init__.py
---------
Co-authored-by: Emil Sadek <esadek@hotmail.com>
Co-authored-by: Emil Sadek <esadek@users.noreply.github.com>
2024-10-14 19:17:35 -07:00
Daniel Han
a2f4c9793e
Update save.py
2024-10-11 00:00:06 -07:00
Daniel Han
f397ad146b
Update save.py
2024-10-10 23:22:17 -07:00
Giulia Baldini
13d434c208
Only remove folder in sentenpiece check if it was created ( #1121 )
2024-10-10 23:21:27 -07:00
Giulia Baldini
6d4fa754d9
Handle absolute paths using pathlib ( #1120 )
2024-10-10 23:20:34 -07:00
Daniel Han
79a2112ca4
Reload
2024-10-05 17:21:48 -07:00
Daniel Han
ae9e264e33
Merge branch 'nightly'
2024-10-01 00:45:16 -07:00
Daniel Han
39bff2f034
Update README.md
2024-10-01 00:40:17 -07:00
Daniel Han
2cab804e55
Update tokenizer_utils.py
2024-10-01 00:35:54 -07:00
Daniel Han
75d1006ad8
Update tokenizer_utils.py
2024-10-01 00:20:01 -07:00
Daniel Han
2efb9e151b
Update tokenizer_utils.py
2024-10-01 00:14:52 -07:00
Daniel Han
0376b81364
Update chat_templates.py
2024-09-30 23:08:46 -07:00
Daniel Han
597e1894f6
Fix merges ( #1079 )
...
* Layernorm
* Update layernorm.py
* Update layernorm.py
* Update layernorm.py
* Update layernorm.py
* Update layernorm.py
* Update layernorm.py
* Patch layernorm
* Update layernorm.py
* RMS Layernorm
* Update rms_layernorm.py
* Causal LM
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update layernorm.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* Llama 3.2
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update llama.py
* Update vision.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update loader.py
* Update loader.py
* Update loader.py
* Dependencies
* Update pyproject.toml
* Update _utils.py
2024-09-30 03:03:01 -07:00
Daniel Han
5e02fb73d1
Update _utils.py
2024-09-30 02:51:32 -07:00
Daniel Han
a9533a0eb6
Update pyproject.toml
2024-09-30 02:48:31 -07:00
Daniel Han
96e90c5578
Dependencies
2024-09-30 02:09:15 -07:00
Daniel Han
e7b0c9e500
Update loader.py
2024-09-29 23:22:05 -07:00
Daniel Han
d96afb3b38
Update loader.py
2024-09-29 23:15:22 -07:00
Daniel Han
c8cd804b70
Update loader.py
2024-09-29 23:13:44 -07:00
Daniel Han
4cee337111
Merge branch 'main' into nightly
2024-09-29 23:13:16 -07:00
Daniel Han
a0acecb50f
Update loader.py
2024-09-29 01:42:58 -07:00
Daniel Han
c3f4e9a87d
Update pyproject.toml
2024-09-27 01:36:45 -07:00
Daniel Han
3dff3b3868
Update tokenizer_utils.py
2024-09-26 01:23:40 -07:00
Daniel Han
7c8f227681
Update README.md
2024-09-26 00:12:42 -07:00
