Daniel Han
e6d50c8839
Update pyproject.toml
2024-12-23 22:49:16 -08:00
Daniel Han
5323157160
Update pyproject.toml
2024-12-23 22:47:20 -08:00
Daniel Han
fba4cf7fb4
Update pyproject.toml
2024-12-23 22:47:11 -08:00
Daniel Han
753b954702
dependencies
2024-12-23 22:27:35 -08:00
Daniel Han
c939334570
Update pyproject.toml
2024-12-23 21:53:43 -08:00
Daniel Han
01b256b4cf
Update pyproject.toml
2024-12-23 21:52:50 -08:00
Daniel Han
4cc97b23cc
Version
2024-12-23 21:43:32 -08:00
Daniel Han
2f969fa137
Update pyproject.toml
2024-12-23 21:16:30 -08:00
Daniel Han
25c5b0524d
Update pyproject.toml
2024-12-23 21:14:01 -08:00
Daniel Han
69dc1ad694
Version
2024-12-23 21:07:51 -08:00
Yonghye Kwon
cecbb08c03
Name Error Bug Fix - import from packaging.version import Version ( #1468 )
2024-12-22 23:22:36 -08:00
Daniel Han
e8ae4727d0
Update pyproject.toml
2024-12-21 01:24:09 -08:00
Daniel Han
14886235e3
Update _utils.py
2024-12-21 01:11:30 -08:00
Daniel Han
6181fb7126
Merge branch 'main' into nightly
2024-12-20 03:30:58 -08:00
Daniel Han
42b624bb77
Bug fix
2024-12-20 03:30:01 -08:00
Daniel Han
97ff8efaca
Merge branch 'main' into nightly
2024-12-20 03:26:58 -08:00
Daniel Han
87b1ce2824
Typo
2024-12-20 03:26:55 -08:00
Daniel Han
d5830e9c2f
Merge branch 'main' into nightly
2024-12-20 03:24:37 -08:00
Daniel Han
703e8b96f1
Typo
2024-12-20 03:24:17 -08:00
Daniel Han
6bf5d8d626
Bug fixes ( #1458 )
...
* Update _utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* typing
* Update rope_embedding.py
* types
* Disable compiling
* Update _utils.py
* Update _utils.py
* Forward hook
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update pyproject.toml
* Update _utils.py
* Update llama.py
* CE Loss
* Update cross_entropy_loss.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254 )
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors
* Update cross_entropy_loss.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Throw error when inferencing longer than max_popsition_embeddings (#1236 )
* Throw error when inferencing longer than max_popsition_embeddings without rope scaling
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* CLI now handles user input strings for dtype correctly (#1235 )
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
* Update flex_attention.py
* Update _utils.py
* Update _utils.py
* Update flex_attention.py
* Update flex_attention.py
* Update loader.py
* Update loader.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* triton_cast
* Update utils.py
* Qwen 2.5 Coder
* Fix/export mistral (#1281 )
* Enhance install_python_non_blocking to handle protobuf installation and process management
* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"
This reverts commit a3b796a05841fb8d93c652c845591e12cf81ea93.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266 "
This reverts commit f00fbf5eac7ad4f5d48c70b98d770255d1a9ef58.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* DOC Update - Update README.md with os.environ in example (#1269 )
* Update README.md with os.environ in example
Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup.
As currently the unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/get_chat_template (#1246 )
* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to
* Remove type hinting
* Update chat_templates.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/sft-trainer (#1276 )
* Add patch for SFTTrainer to maintain backward compatibility with TRL changes
* Update trainer.py
* Update trainer.py
* Refactor trainer patch to maintain backward compatibility with TRL changes
* Update trainer.py
* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update __init__.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update tokenizer_utils.py
* Update llama.py
* Fix #853
* fix/sfttrainer-compatibility (#1293 )
* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance
* Update trainer.py
* Update trainer.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update rms_layernorm.py
* Update rms_layernorm.py
* Gemma
* Update rms_layernorm.py
* Update gemma2.py
* Cut Cross Entropy
* Update llama.py
* Cut Cross Entropy
* Update llama.py
* Update llama.py
* Update llama.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* patch_fast_lora
* vision
* Update fast_lora.py
* Update _utils.py
* Update _utils.py
* Vision
* Update trainer.py
* Update save.py
* FastBaseVisionModel
* Update loader_utils.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update _utils.py
* tokenizer_name
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update _utils.py
* Update loader.py
* kwargs
* logits
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* error
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* Update llama.py
* Update vision.py
* Update loader.py
* Old torch versions
* Update loader.py
* Update loader.py
* prints
* recheck
* Update loader.py
* Update loader.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Feat/kto (#1316 )
* Add PatchKTOTrainer and update model imports
* Update dpo.py
* Update __init__.py
* Delete unsloth/models/kto.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Fix orpo/dpo trainer (#1286 )
* change the colab notebook for dpo zephyr and orpo
* use original tokenizer
* Update README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* skip modules
* Update vision.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Fix llama.cpp
* Update save.py
* Update save.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update _utils.py
* Update save.py
* Update save.py
* Update mapper.py
* modules
* Fix vision model tokenizer padding side. (#1384 )
* Dynamic quants (#1379 )
* typing
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* int64
* Update _utils.py
* Update cross_entropy_loss.py
* constexpr
* constexpr
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* CE
* Update cross_entropy_loss.py
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* typing
* Update rope_embedding.py
* types
* Disable compiling
* Update _utils.py
* Update _utils.py
* Forward hook
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update pyproject.toml
* Update _utils.py
* Update llama.py
* CE Loss
* Update cross_entropy_loss.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254 )
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors
* Update cross_entropy_loss.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Throw error when inferencing longer than max_popsition_embeddings (#1236 )
* Throw error when inferencing longer than max_popsition_embeddings without rope scaling
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* CLI now handles user input strings for dtype correctly (#1235 )
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
* Update flex_attention.py
* Update _utils.py
* Update _utils.py
* Update flex_attention.py
* Update flex_attention.py
* Update loader.py
* Update loader.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* triton_cast
* Update utils.py
* Qwen 2.5 Coder
* Fix/export mistral (#1281 )
* Enhance install_python_non_blocking to handle protobuf installation and process management
* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"
This reverts commit a3b796a05841fb8d93c652c845591e12cf81ea93.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266 "
This reverts commit f00fbf5eac7ad4f5d48c70b98d770255d1a9ef58.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* DOC Update - Update README.md with os.environ in example (#1269 )
* Update README.md with os.environ in example
Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup.
As currently the unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/get_chat_template (#1246 )
* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to
* Remove type hinting
* Update chat_templates.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/sft-trainer (#1276 )
* Add patch for SFTTrainer to maintain backward compatibility with TRL changes
* Update trainer.py
* Update trainer.py
* Refactor trainer patch to maintain backward compatibility with TRL changes
* Update trainer.py
* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update __init__.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update tokenizer_utils.py
* Update llama.py
* Fix #853
* fix/sfttrainer-compatibility (#1293 )
* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance
* Update trainer.py
* Update trainer.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update rms_layernorm.py
* Update rms_layernorm.py
* Gemma
* Update rms_layernorm.py
* Update gemma2.py
* Cut Cross Entropy
* Update llama.py
* Cut Cross Entropy
* Update llama.py
* Update llama.py
* Update llama.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* patch_fast_lora
* vision
* Update fast_lora.py
* Update _utils.py
* Update _utils.py
* Vision
* Update trainer.py
* Update save.py
* FastBaseVisionModel
* Update loader_utils.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update _utils.py
* tokenizer_name
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update _utils.py
* Update loader.py
* kwargs
* logits
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* error
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* Update llama.py
* Update vision.py
* Update loader.py
* Old torch versions
* Update loader.py
* Update loader.py
* prints
* recheck
* Update loader.py
* Update loader.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Feat/kto (#1316 )
* Add PatchKTOTrainer and update model imports
* Update dpo.py
* Update __init__.py
* Delete unsloth/models/kto.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Fix orpo/dpo trainer (#1286 )
* change the colab notebook for dpo zephyr and orpo
* use original tokenizer
* Update README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* skip modules
* Update vision.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Fix llama.cpp
* Update save.py
* Update save.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update _utils.py
* Update save.py
* Update save.py
* Update mapper.py
* modules
---------
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
* Update README.md
Unsloth Dynamic 4-bit Quantization Update
* Fix vision model tokenizer padding side.
* Update vision.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Add citation section to README.md (#1377 )
* Add citation section to README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Granite support (#1218 )
* [WIP] Support for Granite
* Fixup inference
* Cleanup flex attention
* remove sliding window
* Use torch.add for residual multiplier
* Llama 3.3
* Update llama.py
* Update llama.py
* fullgraph
* Fix loader.py to work on Windows (#1453 )
* Update README.md
Llama 3.3 + Reddit
* Update README.md
Apple ML Cross Entropy
* Update README.md
Removing double citation
* Fix loader.py to work on Windows
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Update save.py warning message (#1425 )
* Update README.md
Llama 3.3 + Reddit
* Update README.md
Apple ML Cross Entropy
* Update README.md
Removing double citation
* Update save.py warning message
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Change _fix_chat_template in case a template has both endif and endfor (#1388 )
* Update llama and derivatives to pass position embeddings explicitly for transformers v4.47+ (#1442 )
* Update save.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Temp fix
* Update _utils.py
---------
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
Co-authored-by: Zewen Shen <zewen.public@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Scott Phillips <polygonguru@gmail.com>
Co-authored-by: qingy1337 <qxli2@students.everettcc.edu>
Co-authored-by: Giulia Baldini <44327645+giuliabaldini@users.noreply.github.com>
2024-12-20 03:09:59 -08:00
Daniel Han
f5bcf31169
Update _utils.py
2024-12-20 03:08:59 -08:00
Daniel Han
58bcf66d27
Temp fix
2024-12-20 03:07:04 -08:00
Daniel Han
2afe47565a
Update llama.py
2024-12-20 03:03:26 -08:00
Daniel Han
69728ffd14
Update llama.py
2024-12-20 03:01:28 -08:00
Daniel Han
cf8ec670ed
Update llama.py
2024-12-20 02:59:27 -08:00
Daniel Han
05c99a207b
Update llama.py
2024-12-20 02:53:45 -08:00
Daniel Han
faa6825049
Update llama.py
2024-12-20 02:50:23 -08:00
Daniel Han
3d8fc11d96
Update llama.py
2024-12-20 02:47:32 -08:00
Daniel Han
7e5a6ffab1
Update mistral.py
2024-12-20 02:46:29 -08:00
Daniel Han
3019b5967b
Update llama.py
2024-12-20 02:45:43 -08:00
Daniel Han
57b8ddf21f
Update save.py
2024-12-20 02:40:42 -08:00
Datta Nimmaturi
8e5d68286e
Update llama and derivatives to pass position embeddings explicitly for transformers v4.47+ ( #1442 )
2024-12-20 02:35:42 -08:00
Giulia Baldini
f3e6a28c3f
Change _fix_chat_template in case a template has both endif and endfor ( #1388 )
2024-12-20 02:23:30 -08:00
qingy1337
47cee7fd7e
Update save.py warning message ( #1425 )
...
* Update README.md
Llama 3.3 + Reddit
* Update README.md
Apple ML Cross Entropy
* Update README.md
Removing double citation
* Update save.py warning message
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2024-12-20 02:22:27 -08:00
Scott Phillips
104eeac1db
Fix loader.py to work on Windows ( #1453 )
...
* Update README.md
Llama 3.3 + Reddit
* Update README.md
Apple ML Cross Entropy
* Update README.md
Removing double citation
* Fix loader.py to work on Windows
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2024-12-20 02:20:15 -08:00
Daniel Han
d9ed4bef09
fullgraph
2024-12-12 01:14:27 -08:00
Michael Han
6dd9d4e2b1
Merge pull request #1412 from unslothai/shimmyshimmer-patch-5
...
Update README.md
2024-12-10 14:43:50 -08:00
Michael Han
4aa34a0afa
Update README.md
...
Removing double citation
2024-12-10 14:43:27 -08:00
Michael Han
0b25173b10
Merge pull request #1411 from unslothai/shimmyshimmer-patch-4
...
Update README.md
2024-12-10 12:15:21 -08:00
Michael Han
18a830c971
Update README.md
...
Apple ML Cross Entropy
2024-12-10 12:15:03 -08:00
Daniel Han
b9fe2588e5
Update llama.py
2024-12-10 02:46:14 -08:00
Daniel Han
67d1e9eb50
Update llama.py
2024-12-09 14:19:56 -08:00
Michael Han
4eec751ba7
Merge pull request #1401 from unslothai/shimmyshimmer-patch-3
...
Update README.md
2024-12-07 14:25:05 -08:00
Michael Han
89e3ddcb55
Update README.md
...
Llama 3.3 + Reddit
2024-12-07 14:24:48 -08:00
Daniel Han
e79b11d31d
Merge branch 'main' into nightly
2024-12-07 00:15:56 -08:00
Daniel Han
39de04dbdd
Update _utils.py
2024-12-07 00:15:48 -08:00
Daniel Han
0e0d8fc322
Llama 3.3 ( #1393 )
...
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* int64
* Update _utils.py
* Update cross_entropy_loss.py
* constexpr
* constexpr
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* CE
* Update cross_entropy_loss.py
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* typing
* Update rope_embedding.py
* types
* Disable compiling
* Update _utils.py
* Update _utils.py
* Forward hook
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update pyproject.toml
* Update _utils.py
* Update llama.py
* CE Loss
* Update cross_entropy_loss.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254 )
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors
* Update cross_entropy_loss.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Throw error when inferencing longer than max_popsition_embeddings (#1236 )
* Throw error when inferencing longer than max_popsition_embeddings without rope scaling
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* CLI now handles user input strings for dtype correctly (#1235 )
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
* Update flex_attention.py
* Update _utils.py
* Update _utils.py
* Update flex_attention.py
* Update flex_attention.py
* Update loader.py
* Update loader.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* triton_cast
* Update utils.py
* Qwen 2.5 Coder
* Fix/export mistral (#1281 )
* Enhance install_python_non_blocking to handle protobuf installation and process management
* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"
This reverts commit a3b796a05841fb8d93c652c845591e12cf81ea93.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266 "
This reverts commit f00fbf5eac7ad4f5d48c70b98d770255d1a9ef58.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* DOC Update - Update README.md with os.environ in example (#1269 )
* Update README.md with os.environ in example
Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup.
As currently the unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/get_chat_template (#1246 )
* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to
* Remove type hinting
* Update chat_templates.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/sft-trainer (#1276 )
* Add patch for SFTTrainer to maintain backward compatibility with TRL changes
* Update trainer.py
* Update trainer.py
* Refactor trainer patch to maintain backward compatibility with TRL changes
* Update trainer.py
* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update __init__.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update tokenizer_utils.py
* Update llama.py
* Fix #853
* fix/sfttrainer-compatibility (#1293 )
* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance
* Update trainer.py
* Update trainer.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update rms_layernorm.py
* Update rms_layernorm.py
* Gemma
* Update rms_layernorm.py
* Update gemma2.py
* Cut Cross Entropy
* Update llama.py
* Cut Cross Entropy
* Update llama.py
* Update llama.py
* Update llama.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* patch_fast_lora
* vision
* Update fast_lora.py
* Update _utils.py
* Update _utils.py
* Vision
* Update trainer.py
* Update save.py
* FastBaseVisionModel
* Update loader_utils.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update _utils.py
* tokenizer_name
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update _utils.py
* Update loader.py
* kwargs
* logits
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* error
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* Update llama.py
* Update vision.py
* Update loader.py
* Old torch versions
* Update loader.py
* Update loader.py
* prints
* recheck
* Update loader.py
* Update loader.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Feat/kto (#1316 )
* Add PatchKTOTrainer and update model imports
* Update dpo.py
* Update __init__.py
* Delete unsloth/models/kto.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Fix orpo/dpo trainer (#1286 )
* change the colab notebook for dpo zephyr and orpo
* use original tokenizer
* Update README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* skip modules
* Update vision.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Fix llama.cpp
* Update save.py
* Update save.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update _utils.py
* Update save.py
* Update save.py
* Update mapper.py
* modules
* Fix vision model tokenizer padding side. (#1384 )
* Dynamic quants (#1379 )
* typing
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* int64
* Update _utils.py
* Update cross_entropy_loss.py
* constexpr
* constexpr
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* CE
* Update cross_entropy_loss.py
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* typing
* Update rope_embedding.py
* types
* Disable compiling
* Update _utils.py
* Update _utils.py
* Forward hook
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update pyproject.toml
* Update _utils.py
* Update llama.py
* CE Loss
* Update cross_entropy_loss.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254 )
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors
* Update cross_entropy_loss.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Throw error when inferencing longer than max_popsition_embeddings (#1236 )
* Throw error when inferencing longer than max_popsition_embeddings without rope scaling
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* CLI now handles user input strings for dtype correctly (#1235 )
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
* Update flex_attention.py
* Update _utils.py
* Update _utils.py
* Update flex_attention.py
* Update flex_attention.py
* Update loader.py
* Update loader.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* triton_cast
* Update utils.py
* Qwen 2.5 Coder
* Fix/export mistral (#1281 )
* Enhance install_python_non_blocking to handle protobuf installation and process management
* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"
This reverts commit a3b796a05841fb8d93c652c845591e12cf81ea93.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266 "
This reverts commit f00fbf5eac7ad4f5d48c70b98d770255d1a9ef58.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* DOC Update - Update README.md with os.environ in example (#1269 )
* Update README.md with os.environ in example
Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup.
As currently the unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/get_chat_template (#1246 )
* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to
* Remove type hinting
* Update chat_templates.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/sft-trainer (#1276 )
* Add patch for SFTTrainer to maintain backward compatibility with TRL changes
* Update trainer.py
* Update trainer.py
* Refactor trainer patch to maintain backward compatibility with TRL changes
* Update trainer.py
* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update __init__.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update tokenizer_utils.py
* Update llama.py
* Fix #853
* fix/sfttrainer-compatibility (#1293 )
* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance
* Update trainer.py
* Update trainer.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update rms_layernorm.py
* Update rms_layernorm.py
* Gemma
* Update rms_layernorm.py
* Update gemma2.py
* Cut Cross Entropy
* Update llama.py
* Cut Cross Entropy
* Update llama.py
* Update llama.py
* Update llama.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* patch_fast_lora
* vision
* Update fast_lora.py
* Update _utils.py
* Update _utils.py
* Vision
* Update trainer.py
* Update save.py
* FastBaseVisionModel
* Update loader_utils.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update _utils.py
* tokenizer_name
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update _utils.py
* Update loader.py
* kwargs
* logits
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* error
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* Update llama.py
* Update vision.py
* Update loader.py
* Old torch versions
* Update loader.py
* Update loader.py
* prints
* recheck
* Update loader.py
* Update loader.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Feat/kto (#1316 )
* Add PatchKTOTrainer and update model imports
* Update dpo.py
* Update __init__.py
* Delete unsloth/models/kto.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Fix orpo/dpo trainer (#1286 )
* change the colab notebook for dpo zephyr and orpo
* use original tokenizer
* Update README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* skip modules
* Update vision.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Fix llama.cpp
* Update save.py
* Update save.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update _utils.py
* Update save.py
* Update save.py
* Update mapper.py
* modules
---------
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
* Update README.md
Unsloth Dynamic 4-bit Quantization Update
* Fix vision model tokenizer padding side.
* Update vision.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Add citation section to README.md (#1377 )
* Add citation section to README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Granite support (#1218 )
* [WIP] Support for Granite
* Fixup inference
* Cleanup flex attention
* remove sliding window
* Use torch.add for residual multiplier
* Llama 3.3
---------
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
Co-authored-by: Zewen Shen <zewen.public@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
2024-12-06 13:05:15 -08:00
Daniel Han
11f901a19e
Llama 3.3
2024-12-06 12:25:08 -08:00
Datta Nimmaturi
0c6813df2f
Granite support ( #1218 )
...
* [WIP] Support for Granite
* Fixup inference
* Cleanup flex attention
* remove sliding window
* Use torch.add for residual multiplier
2024-12-05 00:01:53 -08:00
Edd
eaee5ddfa9
Add citation section to README.md ( #1377 )
...
* Add citation section to README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2024-12-04 23:59:13 -08:00
