Commit graph

538 commits

Author SHA1 Message Date
Daniel Han
eb533dbf14 Update README.md 2024-10-17 20:45:40 -07:00
Daniel Han
e210840ba9
Gradient Accumulation Fix (#1146)
* Unsloth Zoo

* Update trainer.py

* Update trainer.py

* Update cross_entropy_loss.py

* n_items

* Update llama.py

* kwargs

* Remove extraneous f prefixes (#1133)

Co-authored-by: Emil Sadek <esadek@users.noreply.github.com>

* Update __init__.py

* kwargs

* Update trainer.py

* Update trainer.py

* Update trainer.py

* Fix GA

* Update _utils.py

* Update llama.py

* Update tokenizer_utils.py

* Warn on old versions

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

---------

Co-authored-by: Emil Sadek <esadek@hotmail.com>
Co-authored-by: Emil Sadek <esadek@users.noreply.github.com>
2024-10-17 20:43:07 -07:00
Daniel Han
a395211e02 Update mapper.py 2024-10-16 21:48:05 -07:00
Daniel Han
38663b01f5
Gradient Accumulation Fix (#1134)
* Unsloth Zoo

* Update trainer.py

* Update trainer.py

* Update cross_entropy_loss.py

* n_items

* Update llama.py

* kwargs

* Remove extraneous f prefixes (#1133)

Co-authored-by: Emil Sadek <esadek@users.noreply.github.com>

* Update __init__.py

---------

Co-authored-by: Emil Sadek <esadek@hotmail.com>
Co-authored-by: Emil Sadek <esadek@users.noreply.github.com>
2024-10-14 19:17:35 -07:00
Daniel Han
a2f4c9793e Update save.py 2024-10-11 00:00:06 -07:00
Daniel Han
f397ad146b Update save.py 2024-10-10 23:22:17 -07:00
Giulia Baldini
13d434c208
Only remove folder in sentenpiece check if it was created (#1121) 2024-10-10 23:21:27 -07:00
Giulia Baldini
6d4fa754d9
Handle absolute paths using pathlib (#1120) 2024-10-10 23:20:34 -07:00
Daniel Han
79a2112ca4 Reload 2024-10-05 17:21:48 -07:00
Daniel Han
ae9e264e33 Merge branch 'nightly' 2024-10-01 00:45:16 -07:00
Daniel Han
39bff2f034 Update README.md 2024-10-01 00:40:17 -07:00
Daniel Han
2cab804e55 Update tokenizer_utils.py 2024-10-01 00:35:54 -07:00
Daniel Han
75d1006ad8 Update tokenizer_utils.py 2024-10-01 00:20:01 -07:00
Daniel Han
2efb9e151b Update tokenizer_utils.py 2024-10-01 00:14:52 -07:00
Daniel Han
0376b81364 Update chat_templates.py 2024-09-30 23:08:46 -07:00
Daniel Han
597e1894f6
Fix merges (#1079)
* Layernorm

* Update layernorm.py

* Update layernorm.py

* Update layernorm.py

* Update layernorm.py

* Update layernorm.py

* Update layernorm.py

* Patch layernorm

* Update layernorm.py

* RMS Layernorm

* Update rms_layernorm.py

* Causal LM

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update layernorm.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update _utils.py

* Update _utils.py

* Llama 3.2

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update llama.py

* Update vision.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update loader.py

* Update loader.py

* Update loader.py

* Dependencies

* Update pyproject.toml

* Update _utils.py
2024-09-30 03:03:01 -07:00
Daniel Han
5e02fb73d1 Update _utils.py 2024-09-30 02:51:32 -07:00
Daniel Han
a9533a0eb6 Update pyproject.toml 2024-09-30 02:48:31 -07:00
Daniel Han
96e90c5578 Dependencies 2024-09-30 02:09:15 -07:00
Daniel Han
e7b0c9e500 Update loader.py 2024-09-29 23:22:05 -07:00
Daniel Han
d96afb3b38 Update loader.py 2024-09-29 23:15:22 -07:00
Daniel Han
c8cd804b70 Update loader.py 2024-09-29 23:13:44 -07:00
Daniel Han
4cee337111 Merge branch 'main' into nightly 2024-09-29 23:13:16 -07:00
Daniel Han
a0acecb50f Update loader.py 2024-09-29 01:42:58 -07:00
Daniel Han
c3f4e9a87d Update pyproject.toml 2024-09-27 01:36:45 -07:00
Daniel Han
3dff3b3868 Update tokenizer_utils.py 2024-09-26 01:23:40 -07:00
Daniel Han
7c8f227681 Update README.md 2024-09-26 00:12:42 -07:00
Daniel Han
2462e5c51b Update README.md 2024-09-26 00:05:38 -07:00
Daniel Han
b0f3dc087a Update README.md 2024-09-26 00:02:15 -07:00
Daniel Han
2c5a3995c8 Update pyproject.toml 2024-09-25 23:47:15 -07:00
Daniel Han
a1ca724f5d Update pyproject.toml 2024-09-25 23:13:49 -07:00
Daniel Han
1c3124fc10 Remove version checks 2024-09-25 23:00:09 -07:00
Daniel Han
f00eaf1b09 Update _utils.py 2024-09-25 22:56:41 -07:00
Daniel Han
330a7f4682 Update llama.py 2024-09-25 22:12:21 -07:00
Daniel Han
a957a7583e Update llama.py 2024-09-25 19:38:01 -07:00
Daniel Han
7086c20ca5 Update llama.py 2024-09-25 19:15:40 -07:00
Daniel Han
c4efa61880 Update llama.py 2024-09-25 18:24:30 -07:00
Daniel Han
bd85f8f074 Update llama.py 2024-09-25 18:10:46 -07:00
Daniel Han
dc5afb068f Update llama.py 2024-09-25 18:07:21 -07:00
Daniel Han
38581963ed Update llama.py 2024-09-25 17:55:42 -07:00
Daniel Han
7fac7e288d Update llama.py 2024-09-25 17:51:36 -07:00
Daniel Han
990ef6e2b7 Update llama.py 2024-09-25 17:46:29 -07:00
Daniel Han
3a10b06bd6 Update vision.py 2024-09-25 17:44:13 -07:00
Daniel Han
f9181beefb Update llama.py 2024-09-25 14:32:29 -07:00
Daniel Han
cbe9278191 Update _utils.py 2024-09-25 14:12:16 -07:00
Daniel Han
01c4942817 Update _utils.py 2024-09-25 13:28:05 -07:00
Daniel Han
1de64fcad2 Update _utils.py 2024-09-25 13:19:01 -07:00
Daniel Han
164599212a Merge branch 'main' into nightly 2024-09-25 13:18:42 -07:00
Daniel Han
539adef0f8 Update llama.py 2024-09-25 12:42:24 -07:00
Daniel Han
b4e4c874b4 Fix version 2024-09-25 12:35:38 -07:00