Commit graph

4,672 commits

Author SHA1 Message Date
Daniel Han
6e7e6a52ef Update _utils.py 2024-11-25 22:20:16 -08:00
Daniel Han
5d08a89f36 Update _utils.py 2024-11-25 22:18:33 -08:00
Daniel Han
41008f7ece Update _utils.py 2024-11-25 22:17:20 -08:00
Daniel Han
307fd67a83 error 2024-11-25 22:12:22 -08:00
Daniel Han
0487293f4c Update _utils.py 2024-11-25 22:03:08 -08:00
Daniel Han
7188082852 Update _utils.py 2024-11-25 21:59:40 -08:00
Daniel Han
4475041c36 Update _utils.py 2024-11-25 21:57:56 -08:00
Daniel Han
7c298a79ed Update llama.py 2024-11-25 21:52:42 -08:00
Daniel Han
b8631b7bd8 Update llama.py 2024-11-25 21:46:36 -08:00
Daniel Han
549c5be61c Update llama.py 2024-11-25 21:39:19 -08:00
Daniel Han
41878b581f logits 2024-11-25 21:31:43 -08:00
Daniel Han
360a4c8702 kwargs 2024-11-25 18:48:41 -08:00
Daniel Han
7e7656c5a1 Update loader.py 2024-11-22 16:04:53 -08:00
Daniel Han
3bae0beca6 Merge branch 'main' into nightly 2024-11-22 15:03:28 -08:00
Daniel Han
4fe74c93ee Update pyproject.toml 2024-11-21 17:46:22 -08:00
Daniel Han
aebf67a61e Delete docs github button.png 2024-11-21 11:25:12 -08:00
Daniel Han
6d34ab821b Vision (#1318)
* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Update README.md

* Update README.md

* Update README.md

* Update README.md

---------

Co-authored-by: Michael <107991372+shimmyshimmer@users.noreply.github.com>
2024-11-21 11:24:12 -08:00
Daniel Han
7296f5eed7 Update _utils.py 2024-11-21 06:45:40 -08:00
Daniel Han
967f9fb23d Update vision.py 2024-11-21 06:07:06 -08:00
Daniel Han
ddf118a8fc Vision support (#1315)
* Fix pad token

* Update llama.py

* Typo

* ignored labels

* Revert "ignored labels"

This reverts commit 4b25138ac7.

* More patching

* Update _utils.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Feat/all tmp (#1219)

* Update save.py

Check whether path is in /tmp dir for Kaggle environment

* Update save.py

Move temporary_location to /tmp in Kaggle

* Enhance Kaggle environment support in save and tokenizer utilities

---------

Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>

* Bug fixes

* Update pyproject.toml

* Update _utils.py

* Update __init__.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Tied weights

* Revert "Tied weights"

This reverts commit 820cd4efef.

* Tied weights

* Utils

* CE Loss patching

* Update __init__.py

* Update __init__.py

* Patching

* Update cross_entropy_loss.py

* CE Loss

* Update _utils.py

* Update _utils.py

* CE Loss

* Update _utils.py

* Update _utils.py

* Layernorm

* Update _utils.py

* Update _utils.py

* Post patch

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* typing

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* int64

* Update _utils.py

* Update cross_entropy_loss.py

* constexpr

* constexpr

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* CE

* Update cross_entropy_loss.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update utils.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* typing

* Update rope_embedding.py

* types

* Disable compiling

* Update _utils.py

* Update _utils.py

* Forward hook

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update pyproject.toml

* Update _utils.py

* Update llama.py

* CE Loss

* Update cross_entropy_loss.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254)

* Fix: cast logits to float32 in cross_entropy_forward to prevent errors

* Update cross_entropy_loss.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Throw error when inferencing longer than max_popsition_embeddings (#1236)

* Throw error when inferencing longer than max_popsition_embeddings without rope scaling

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* CLI now handles user input strings for dtype correctly (#1235)

Co-authored-by: root <root@ieeres.chu.cam.ac.uk>

* Update flex_attention.py

* Update _utils.py

* Update _utils.py

* Update flex_attention.py

* Update flex_attention.py

* Update loader.py

* Update loader.py

* Update flex_attention.py

* Update flex_attention.py

* Update flex_attention.py

* Update flex_attention.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update _utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* triton_cast

* Update utils.py

* Qwen 2.5 Coder

* Fix/export mistral (#1281)

* Enhance install_python_non_blocking to handle protobuf installation and process management

* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"

This reverts commit a3b796a05841fb8d93c652c845591e12cf81ea93.

* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266

* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266"

This reverts commit f00fbf5eac7ad4f5d48c70b98d770255d1a9ef58.

* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266

* Update __init__.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* DOC Update - Update README.md with os.environ in example (#1269)

* Update README.md with os.environ in example

Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup. 
As currently the  unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials

* Update README.md

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* fix/get_chat_template (#1246)

* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to

* Remove type hinting

* Update chat_templates.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* fix/sft-trainer (#1276)

* Add patch for SFTTrainer to maintain backward compatibility with TRL changes

* Update trainer.py

* Update trainer.py

* Refactor trainer patch to maintain backward compatibility with TRL changes

* Update trainer.py

* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update __init__.py

* Update trainer.py

* Update trainer.py

* Update trainer.py

* Update tokenizer_utils.py

* Update llama.py

* Fix #853

* fix/sfttrainer-compatibility (#1293)

* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance

* Update trainer.py

* Update trainer.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update rms_layernorm.py

* Update rms_layernorm.py

* Gemma

* Update rms_layernorm.py

* Update gemma2.py

* Cut Cross Entropy

* Update llama.py

* Cut Cross Entropy

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update mapper.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* patch_fast_lora

* vision

* Update fast_lora.py

* Update _utils.py

* Update _utils.py

* Vision

* Update trainer.py

* Update save.py

* FastBaseVisionModel

* Update loader_utils.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update _utils.py

* tokenizer_name

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update _utils.py

---------

Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
2024-11-21 05:01:44 -08:00
Daniel Han
a02a11a10c Update _utils.py 2024-11-21 04:13:54 -08:00
Daniel Han
6c050b805a Update vision.py 2024-11-21 04:10:43 -08:00
Daniel Han
044d1962c9 Update vision.py 2024-11-21 04:10:24 -08:00
Daniel Han
bef3496dbd Update vision.py 2024-11-21 04:05:05 -08:00
Daniel Han
e22a03948a Update vision.py 2024-11-21 04:01:17 -08:00
Daniel Han
02ed7bfd7f Update vision.py 2024-11-21 03:58:18 -08:00
Daniel Han
8d7b0d9298 Update vision.py 2024-11-21 03:54:09 -08:00
Daniel Han
4c3473082d Update save.py 2024-11-21 03:47:57 -08:00
Daniel Han
331c7d62e4 Update save.py 2024-11-21 03:18:31 -08:00
Daniel Han
38767cd63f Update vision.py 2024-11-21 03:05:13 -08:00
Daniel Han
ef64ffc879 Update loader.py 2024-11-21 02:29:24 -08:00
Daniel Han
104594648d tokenizer_name 2024-11-21 02:28:00 -08:00
Daniel Han
8f2db72aec Update _utils.py 2024-11-21 02:27:07 -08:00
Daniel Han
dd78e6ed9a Update vision.py 2024-11-21 02:23:35 -08:00
Daniel Han
99cdccd91a Update loader.py 2024-11-21 02:23:11 -08:00
Daniel Han
0570871947 Update vision.py 2024-11-21 02:20:47 -08:00
Daniel Han
52e089e17a Update loader.py 2024-11-21 02:18:59 -08:00
Daniel Han
cf302f0d17 Update vision.py 2024-11-21 02:17:20 -08:00
Daniel Han
83c79ba1d9 Update loader_utils.py 2024-11-21 02:15:43 -08:00
Daniel Han
528b7f58af FastBaseVisionModel 2024-11-21 02:12:45 -08:00
Daniel Han
9b69eb9144 Update save.py 2024-11-21 01:51:46 -08:00
Daniel Han
2b47e95f53 Merge branch 'main' into nightly 2024-11-21 01:51:06 -08:00
Daniel Han
0cdda6b3a3 Update trainer.py 2024-11-21 01:49:46 -08:00
Daniel Han
925a63120e Vision 2024-11-21 01:48:20 -08:00
Daniel Han
67d40f3f6d Update _utils.py 2024-11-20 19:40:08 -08:00
Daniel Han
4be7341e49 Update _utils.py 2024-11-20 19:15:05 -08:00
Daniel Han
c67183f183 Update fast_lora.py 2024-11-20 17:07:53 -08:00
Daniel Han
d9f042d7e0 vision 2024-11-20 04:15:53 -08:00
Daniel Han
81cd49d2e7 patch_fast_lora 2024-11-20 03:36:41 -08:00
Michael
778359ee9e Add files via upload 2024-11-20 01:47:23 -08:00