Commit graph

895 commits

Author SHA1 Message Date
Daniel Han
43875ad4be Update loader.py 2024-11-26 03:07:50 -08:00
Daniel Han
212879720d Update loader.py 2024-11-26 02:58:16 -08:00
Daniel Han
b3f7d54686 recheck 2024-11-26 02:52:19 -08:00
Daniel Han
7a22da6348 prints 2024-11-26 00:47:27 -08:00
Daniel Han
442472f8f1 Update loader.py 2024-11-26 00:35:05 -08:00
Daniel Han
2a9fd4c4c2 Update loader.py 2024-11-26 00:34:51 -08:00
Daniel Han
99c738055a Old torch versions 2024-11-26 00:26:37 -08:00
Daniel Han
77fc0c96c3 Update loader.py 2024-11-26 00:18:00 -08:00
Daniel Han
34ea5bc89f Update vision.py 2024-11-26 00:16:33 -08:00
Daniel Han
41f3d0845e Update llama.py 2024-11-26 00:08:15 -08:00
Daniel Han
3db56503ff Update loader.py 2024-11-26 00:01:13 -08:00
Daniel Han
54566530cf Update _utils.py 2024-11-25 23:39:26 -08:00
Daniel Han
1a9d39a778 Update _utils.py 2024-11-25 23:35:36 -08:00
Daniel Han
6e22722076 Update _utils.py 2024-11-25 23:33:19 -08:00
Daniel Han
fde2079deb Update _utils.py 2024-11-25 23:03:35 -08:00
Daniel Han
b3339806c6 Update _utils.py 2024-11-25 22:56:24 -08:00
Daniel Han
1657a364ab Update _utils.py 2024-11-25 22:52:57 -08:00
Daniel Han
9362b96845 Update _utils.py 2024-11-25 22:37:02 -08:00
Daniel Han
65c777521c Update _utils.py 2024-11-25 22:35:55 -08:00
Daniel Han
0b431c3317 Update _utils.py 2024-11-25 22:33:18 -08:00
Daniel Han
05b97adf33 Update _utils.py 2024-11-25 22:32:27 -08:00
Daniel Han
c0ea606f96 Update _utils.py 2024-11-25 22:31:09 -08:00
Daniel Han
2b76bb638b Update _utils.py 2024-11-25 22:27:49 -08:00
Daniel Han
92e4d089bf Update _utils.py 2024-11-25 22:20:16 -08:00
Daniel Han
27f740375f Update _utils.py 2024-11-25 22:18:33 -08:00
Daniel Han
b4ef870280 Update _utils.py 2024-11-25 22:17:20 -08:00
Daniel Han
11e8e19071 error 2024-11-25 22:12:22 -08:00
Daniel Han
ef368f7858 Update _utils.py 2024-11-25 22:03:08 -08:00
Daniel Han
a62651ce69 Update _utils.py 2024-11-25 21:59:40 -08:00
Daniel Han
0e1b154d02 Update _utils.py 2024-11-25 21:57:56 -08:00
Daniel Han
c4ab3788f6 Update llama.py 2024-11-25 21:52:42 -08:00
Daniel Han
09c6b2de4b Update llama.py 2024-11-25 21:46:36 -08:00
Daniel Han
59c6673ad5 Update llama.py 2024-11-25 21:39:19 -08:00
Daniel Han
7d2f29f466 logits 2024-11-25 21:31:43 -08:00
Daniel Han
7150c51db7 kwargs 2024-11-25 18:48:41 -08:00
Daniel Han
c770d8644b Update loader.py 2024-11-22 16:04:53 -08:00
Daniel Han
d90a094a79 Merge branch 'main' into nightly 2024-11-22 15:03:28 -08:00
Daniel Han
35b7638d22 Update pyproject.toml 2024-11-21 17:46:22 -08:00
Daniel Han
0f38bbce84 Delete docs github button.png 2024-11-21 11:25:12 -08:00
Daniel Han
1a669e57c4 Vision (#1318)
* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Update README.md

* Update README.md

* Update README.md

* Update README.md

---------

Co-authored-by: Michael <107991372+shimmyshimmer@users.noreply.github.com>
2024-11-21 11:24:12 -08:00
Daniel Han
387dd13e31 Update _utils.py November-2024 2024-11-21 06:45:40 -08:00
Daniel Han
40dcb698d6 Update vision.py 2024-11-21 06:07:06 -08:00
Daniel Han
0512d65240 Vision support (#1315)
* Fix pad token

* Update llama.py

* Typo

* ignored labels

* Revert "ignored labels"

This reverts commit 110ee41971.

* More patching

* Update _utils.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Feat/all tmp (#1219)

* Update save.py

Check whether path is in /tmp dir for Kaggle environment

* Update save.py

Move temporary_location to /tmp in Kaggle

* Enhance Kaggle environment support in save and tokenizer utilities

---------

Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>

* Bug fixes

* Update pyproject.toml

* Update _utils.py

* Update __init__.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Tied weights

* Revert "Tied weights"

This reverts commit 42bb212916.

* Tied weights

* Utils

* CE Loss patching

* Update __init__.py

* Update __init__.py

* Patching

* Update cross_entropy_loss.py

* CE Loss

* Update _utils.py

* Update _utils.py

* CE Loss

* Update _utils.py

* Update _utils.py

* Layernorm

* Update _utils.py

* Update _utils.py

* Post patch

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* typing

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* int64

* Update _utils.py

* Update cross_entropy_loss.py

* constexpr

* constexpr

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* CE

* Update cross_entropy_loss.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update utils.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* typing

* Update rope_embedding.py

* types

* Disable compiling

* Update _utils.py

* Update _utils.py

* Forward hook

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update pyproject.toml

* Update _utils.py

* Update llama.py

* CE Loss

* Update cross_entropy_loss.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254)

* Fix: cast logits to float32 in cross_entropy_forward to prevent errors

* Update cross_entropy_loss.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Throw error when inferencing longer than max_popsition_embeddings (#1236)

* Throw error when inferencing longer than max_popsition_embeddings without rope scaling

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* CLI now handles user input strings for dtype correctly (#1235)

Co-authored-by: root <root@ieeres.chu.cam.ac.uk>

* Update flex_attention.py

* Update _utils.py

* Update _utils.py

* Update flex_attention.py

* Update flex_attention.py

* Update loader.py

* Update loader.py

* Update flex_attention.py

* Update flex_attention.py

* Update flex_attention.py

* Update flex_attention.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update _utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* triton_cast

* Update utils.py

* Qwen 2.5 Coder

* Fix/export mistral (#1281)

* Enhance install_python_non_blocking to handle protobuf installation and process management

* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"

This reverts commit a3b796a05841fb8d93c652c845591e12cf81ea93.

* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266

* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266"

This reverts commit f00fbf5eac7ad4f5d48c70b98d770255d1a9ef58.

* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266

* Update __init__.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* DOC Update - Update README.md with os.environ in example (#1269)

* Update README.md with os.environ in example

Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup. 
As currently the  unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials

* Update README.md

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* fix/get_chat_template (#1246)

* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to

* Remove type hinting

* Update chat_templates.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* fix/sft-trainer (#1276)

* Add patch for SFTTrainer to maintain backward compatibility with TRL changes

* Update trainer.py

* Update trainer.py

* Refactor trainer patch to maintain backward compatibility with TRL changes

* Update trainer.py

* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update __init__.py

* Update trainer.py

* Update trainer.py

* Update trainer.py

* Update tokenizer_utils.py

* Update llama.py

* Fix #853

* fix/sfttrainer-compatibility (#1293)

* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance

* Update trainer.py

* Update trainer.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update rms_layernorm.py

* Update rms_layernorm.py

* Gemma

* Update rms_layernorm.py

* Update gemma2.py

* Cut Cross Entropy

* Update llama.py

* Cut Cross Entropy

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update mapper.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* patch_fast_lora

* vision

* Update fast_lora.py

* Update _utils.py

* Update _utils.py

* Vision

* Update trainer.py

* Update save.py

* FastBaseVisionModel

* Update loader_utils.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update _utils.py

* tokenizer_name

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update _utils.py

---------

Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
2024-11-21 05:01:44 -08:00
Daniel Han
a6dbb32281 Update _utils.py 2024-11-21 04:13:54 -08:00
Daniel Han
0019771472 Update vision.py 2024-11-21 04:10:43 -08:00
Daniel Han
63f41575f4 Update vision.py 2024-11-21 04:10:24 -08:00
Daniel Han
bd0c5bb1a1 Update vision.py 2024-11-21 04:05:05 -08:00
Daniel Han
2b8b2f159f Update vision.py 2024-11-21 04:01:17 -08:00
Daniel Han
3d22829736 Update vision.py 2024-11-21 03:58:18 -08:00
Daniel Han
c36cf21b16 Update vision.py 2024-11-21 03:54:09 -08:00