Commit graph

859 commits

Author SHA1 Message Date
Daniel Han
482b1fc07d Merge branch 'main' into nightly 2024-11-22 15:03:28 -08:00
Daniel Han
228b3cf46e Update pyproject.toml 2024-11-21 17:46:22 -08:00
Daniel Han
def921c6bc Delete docs github button.png 2024-11-21 11:25:12 -08:00
Daniel Han
d30c363d25
Vision (#1318)
* Add files via upload

* Add files via upload

* Add files via upload

* Add files via upload

* Update README.md

* Update README.md

* Update README.md

* Update README.md

---------

Co-authored-by: Michael <107991372+shimmyshimmer@users.noreply.github.com>
2024-11-21 11:24:12 -08:00
Daniel Han
c2b185e7db Update _utils.py 2024-11-21 06:45:40 -08:00
Daniel Han
69cbd13a41 Update vision.py 2024-11-21 06:07:06 -08:00
Daniel Han
8b57e17c8d
Vision support (#1315)
* Fix pad token

* Update llama.py

* Typo

* ignored labels

* Revert "ignored labels"

This reverts commit 9d07be077b.

* More patching

* Update _utils.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Feat/all tmp (#1219)

* Update save.py

Check whether path is in /tmp dir for Kaggle environment

* Update save.py

Move temporary_location to /tmp in Kaggle

* Enhance Kaggle environment support in save and tokenizer utilities

---------

Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>

* Bug fixes

* Update pyproject.toml

* Update _utils.py

* Update __init__.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Tied weights

* Revert "Tied weights"

This reverts commit 8090b7c01a.

* Tied weights

* Utils

* CE Loss patching

* Update __init__.py

* Update __init__.py

* Patching

* Update cross_entropy_loss.py

* CE Loss

* Update _utils.py

* Update _utils.py

* CE Loss

* Update _utils.py

* Update _utils.py

* Layernorm

* Update _utils.py

* Update _utils.py

* Post patch

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* typing

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* int64

* Update _utils.py

* Update cross_entropy_loss.py

* constexpr

* constexpr

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* CE

* Update cross_entropy_loss.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update utils.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* Update rms_layernorm.py

* typing

* Update rope_embedding.py

* types

* Disable compiling

* Update _utils.py

* Update _utils.py

* Forward hook

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update pyproject.toml

* Update _utils.py

* Update llama.py

* CE Loss

* Update cross_entropy_loss.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update cross_entropy_loss.py

* Update llama.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254)

* Fix: cast logits to float32 in cross_entropy_forward to prevent errors

* Update cross_entropy_loss.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Throw error when inferencing longer than max_popsition_embeddings (#1236)

* Throw error when inferencing longer than max_popsition_embeddings without rope scaling

* Update llama.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* CLI now handles user input strings for dtype correctly (#1235)

Co-authored-by: root <root@ieeres.chu.cam.ac.uk>

* Update flex_attention.py

* Update _utils.py

* Update _utils.py

* Update flex_attention.py

* Update flex_attention.py

* Update loader.py

* Update loader.py

* Update flex_attention.py

* Update flex_attention.py

* Update flex_attention.py

* Update flex_attention.py

* Update _utils.py

* Update cross_entropy_loss.py

* Update _utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* Update tokenizer_utils.py

* triton_cast

* Update utils.py

* Qwen 2.5 Coder

* Fix/export mistral (#1281)

* Enhance install_python_non_blocking to handle protobuf installation and process management

* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"

This reverts commit f09974b151.

* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266

* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266"

This reverts commit 9fc130785d.

* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266

* Update __init__.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* DOC Update - Update README.md with os.environ in example (#1269)

* Update README.md with os.environ in example

Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup. 
As currently the  unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials

* Update README.md

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* fix/get_chat_template (#1246)

* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to

* Remove type hinting

* Update chat_templates.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* fix/sft-trainer (#1276)

* Add patch for SFTTrainer to maintain backward compatibility with TRL changes

* Update trainer.py

* Update trainer.py

* Refactor trainer patch to maintain backward compatibility with TRL changes

* Update trainer.py

* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update __init__.py

* Update trainer.py

* Update trainer.py

* Update trainer.py

* Update tokenizer_utils.py

* Update llama.py

* Fix #853

* fix/sfttrainer-compatibility (#1293)

* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance

* Update trainer.py

* Update trainer.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update rms_layernorm.py

* Update rms_layernorm.py

* Gemma

* Update rms_layernorm.py

* Update gemma2.py

* Cut Cross Entropy

* Update llama.py

* Cut Cross Entropy

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update mapper.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* patch_fast_lora

* vision

* Update fast_lora.py

* Update _utils.py

* Update _utils.py

* Vision

* Update trainer.py

* Update save.py

* FastBaseVisionModel

* Update loader_utils.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update _utils.py

* tokenizer_name

* Update loader.py

* Update vision.py

* Update save.py

* Update save.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update _utils.py

---------

Co-authored-by: dendarrion <37800703+dendarrion@users.noreply.github.com>
Co-authored-by: Erland366 <erland.pg366@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
2024-11-21 05:01:44 -08:00
Daniel Han
535e89958e Update _utils.py 2024-11-21 04:13:54 -08:00
Daniel Han
a98fc9c57c Update vision.py 2024-11-21 04:10:43 -08:00
Daniel Han
5886ecb246 Update vision.py 2024-11-21 04:10:24 -08:00
Daniel Han
1a548f32dd Update vision.py 2024-11-21 04:05:05 -08:00
Daniel Han
adaf6eef29 Update vision.py 2024-11-21 04:01:17 -08:00
Daniel Han
8ab5dcb99e Update vision.py 2024-11-21 03:58:18 -08:00
Daniel Han
677cf9f227 Update vision.py 2024-11-21 03:54:09 -08:00
Daniel Han
e0b14fab34 Update save.py 2024-11-21 03:47:57 -08:00
Daniel Han
fc7d7470da Update save.py 2024-11-21 03:18:31 -08:00
Daniel Han
5ab4b604be Update vision.py 2024-11-21 03:05:13 -08:00
Daniel Han
26f23379de Update loader.py 2024-11-21 02:29:24 -08:00
Daniel Han
1ad1b46eab tokenizer_name 2024-11-21 02:28:00 -08:00
Daniel Han
767a31fd9d Update _utils.py 2024-11-21 02:27:07 -08:00
Daniel Han
a45e564d61 Update vision.py 2024-11-21 02:23:35 -08:00
Daniel Han
1f32b23b67 Update loader.py 2024-11-21 02:23:11 -08:00
Daniel Han
0747078bf7 Update vision.py 2024-11-21 02:20:47 -08:00
Daniel Han
2420736e3c Update loader.py 2024-11-21 02:18:59 -08:00
Daniel Han
d160618c96 Update vision.py 2024-11-21 02:17:20 -08:00
Daniel Han
7f5a9a7c63 Update loader_utils.py 2024-11-21 02:15:43 -08:00
Daniel Han
a5d4084686 FastBaseVisionModel 2024-11-21 02:12:45 -08:00
Daniel Han
d5b84088ce Update save.py 2024-11-21 01:51:46 -08:00
Daniel Han
f077680e2d Merge branch 'main' into nightly 2024-11-21 01:51:06 -08:00
Daniel Han
8a44b6c3ce Update trainer.py 2024-11-21 01:49:46 -08:00
Daniel Han
d6ccbfb27e Vision 2024-11-21 01:48:20 -08:00
Daniel Han
1c94f04c9e Update _utils.py 2024-11-20 19:40:08 -08:00
Daniel Han
4ddd1bb6d3 Update _utils.py 2024-11-20 19:15:05 -08:00
Daniel Han
7d5c9eddee Update fast_lora.py 2024-11-20 17:07:53 -08:00
Daniel Han
cabf21f0dd vision 2024-11-20 04:15:53 -08:00
Daniel Han
bd1a17538d patch_fast_lora 2024-11-20 03:36:41 -08:00
Michael
5078a870c0
Add files via upload 2024-11-20 01:47:23 -08:00
Michael
0074b5c9ba
Add files via upload 2024-11-20 01:44:15 -08:00
Daniel Han
029f5d5c26 Update _utils.py 2024-11-19 16:56:53 -08:00
Daniel Han
81538c3046 Update _utils.py 2024-11-19 15:49:01 -08:00
Daniel Han
c7c984f725 Update _utils.py 2024-11-19 13:01:38 -08:00
Daniel Han
f92c16d9bc Update _utils.py 2024-11-19 03:54:35 -08:00
Daniel Han
a0e709b214 Update _utils.py 2024-11-19 03:53:17 -08:00
Daniel Han
4cd14bb9ee Update _utils.py 2024-11-19 03:50:20 -08:00
Daniel Han
caf4cd40ca Update _utils.py 2024-11-19 03:46:32 -08:00
Daniel Han
d00dc52902 Update _utils.py 2024-11-19 03:45:23 -08:00
Daniel Han
9f93c49ee7 Update _utils.py 2024-11-19 02:25:22 -08:00
Daniel Han
b9b7a5bf66 Update mapper.py 2024-11-18 12:18:34 -08:00
Daniel Han
b144ff47bf Update _utils.py 2024-11-17 22:01:20 -08:00
Daniel Han
4abf3deed4 Update _utils.py 2024-11-17 22:01:07 -08:00