Daniel Han
|
355139f018
|
Update _utils.py
|
2024-12-26 01:32:00 -08:00 |
|
Daniel Han
|
f0e33d22b6
|
Merge branch 'main' into nightly
|
2024-12-26 01:31:22 -08:00 |
|
Daniel Han
|
e0dd0bd34e
|
Update loader.py
|
2024-12-26 01:29:07 -08:00 |
|
Daniel Han
|
cb2dd07545
|
Update loader.py
|
2024-12-26 01:26:27 -08:00 |
|
Daniel Han
|
6dfcebb3ef
|
Update loader.py
|
2024-12-26 01:23:02 -08:00 |
|
Daniel Han
|
ece0c858db
|
Bug fix
|
2024-12-26 01:22:06 -08:00 |
|
Daniel Han
|
8cfee4501a
|
Update loader.py
|
2024-12-26 00:33:15 -08:00 |
|
Daniel Han
|
c43d969127
|
Update loader.py
|
2024-12-25 23:57:42 -08:00 |
|
Daniel Han
|
2616a9c80d
|
Update loader.py
|
2024-12-25 23:49:40 -08:00 |
|
Daniel Han
|
a4f7b8898f
|
Update loader.py
|
2024-12-25 23:01:54 -08:00 |
|
Daniel Han
|
cebdfcf930
|
Residual & LoRA
|
2024-12-25 23:01:34 -08:00 |
|
Daniel Han
|
a240783553
|
Bug Fixes (#1470)
* Update llama.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update pyproject.toml
* Update _utils.py
* Update llama.py
* CE Loss
* Update cross_entropy_loss.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254)
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors
* Update cross_entropy_loss.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Throw error when inferencing longer than max_popsition_embeddings (#1236)
* Throw error when inferencing longer than max_popsition_embeddings without rope scaling
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* CLI now handles user input strings for dtype correctly (#1235)
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
* Update flex_attention.py
* Update _utils.py
* Update _utils.py
* Update flex_attention.py
* Update flex_attention.py
* Update loader.py
* Update loader.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* triton_cast
* Update utils.py
* Qwen 2.5 Coder
* Fix/export mistral (#1281)
* Enhance install_python_non_blocking to handle protobuf installation and process management
* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"
This reverts commit f09974b151.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266"
This reverts commit 9fc130785d.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* DOC Update - Update README.md with os.environ in example (#1269)
* Update README.md with os.environ in example
Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup.
As currently the unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/get_chat_template (#1246)
* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to
* Remove type hinting
* Update chat_templates.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/sft-trainer (#1276)
* Add patch for SFTTrainer to maintain backward compatibility with TRL changes
* Update trainer.py
* Update trainer.py
* Refactor trainer patch to maintain backward compatibility with TRL changes
* Update trainer.py
* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update __init__.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update tokenizer_utils.py
* Update llama.py
* Fix #853
* fix/sfttrainer-compatibility (#1293)
* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance
* Update trainer.py
* Update trainer.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update rms_layernorm.py
* Update rms_layernorm.py
* Gemma
* Update rms_layernorm.py
* Update gemma2.py
* Cut Cross Entropy
* Update llama.py
* Cut Cross Entropy
* Update llama.py
* Update llama.py
* Update llama.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* patch_fast_lora
* vision
* Update fast_lora.py
* Update _utils.py
* Update _utils.py
* Vision
* Update trainer.py
* Update save.py
* FastBaseVisionModel
* Update loader_utils.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update _utils.py
* tokenizer_name
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update _utils.py
* Update loader.py
* kwargs
* logits
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* error
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* Update llama.py
* Update vision.py
* Update loader.py
* Old torch versions
* Update loader.py
* Update loader.py
* prints
* recheck
* Update loader.py
* Update loader.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Feat/kto (#1316)
* Add PatchKTOTrainer and update model imports
* Update dpo.py
* Update __init__.py
* Delete unsloth/models/kto.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Fix orpo/dpo trainer (#1286)
* change the colab notebook for dpo zephyr and orpo
* use original tokenizer
* Update README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* skip modules
* Update vision.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Fix llama.cpp
* Update save.py
* Update save.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update _utils.py
* Update save.py
* Update save.py
* Update mapper.py
* modules
* Fix vision model tokenizer padding side. (#1384)
* Dynamic quants (#1379)
* typing
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* int64
* Update _utils.py
* Update cross_entropy_loss.py
* constexpr
* constexpr
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* CE
* Update cross_entropy_loss.py
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* typing
* Update rope_embedding.py
* types
* Disable compiling
* Update _utils.py
* Update _utils.py
* Forward hook
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update pyproject.toml
* Update _utils.py
* Update llama.py
* CE Loss
* Update cross_entropy_loss.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254)
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors
* Update cross_entropy_loss.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Throw error when inferencing longer than max_popsition_embeddings (#1236)
* Throw error when inferencing longer than max_popsition_embeddings without rope scaling
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* CLI now handles user input strings for dtype correctly (#1235)
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
* Update flex_attention.py
* Update _utils.py
* Update _utils.py
* Update flex_attention.py
* Update flex_attention.py
* Update loader.py
* Update loader.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* triton_cast
* Update utils.py
* Qwen 2.5 Coder
* Fix/export mistral (#1281)
* Enhance install_python_non_blocking to handle protobuf installation and process management
* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"
This reverts commit f09974b151.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266"
This reverts commit 9fc130785d.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* DOC Update - Update README.md with os.environ in example (#1269)
* Update README.md with os.environ in example
Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup.
As currently the unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/get_chat_template (#1246)
* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to
* Remove type hinting
* Update chat_templates.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/sft-trainer (#1276)
* Add patch for SFTTrainer to maintain backward compatibility with TRL changes
* Update trainer.py
* Update trainer.py
* Refactor trainer patch to maintain backward compatibility with TRL changes
* Update trainer.py
* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update __init__.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update tokenizer_utils.py
* Update llama.py
* Fix #853
* fix/sfttrainer-compatibility (#1293)
* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance
* Update trainer.py
* Update trainer.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update rms_layernorm.py
* Update rms_layernorm.py
* Gemma
* Update rms_layernorm.py
* Update gemma2.py
* Cut Cross Entropy
* Update llama.py
* Cut Cross Entropy
* Update llama.py
* Update llama.py
* Update llama.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* patch_fast_lora
* vision
* Update fast_lora.py
* Update _utils.py
* Update _utils.py
* Vision
* Update trainer.py
* Update save.py
* FastBaseVisionModel
* Update loader_utils.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update _utils.py
* tokenizer_name
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update _utils.py
* Update loader.py
* kwargs
* logits
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* error
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* Update llama.py
* Update vision.py
* Update loader.py
* Old torch versions
* Update loader.py
* Update loader.py
* prints
* recheck
* Update loader.py
* Update loader.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Feat/kto (#1316)
* Add PatchKTOTrainer and update model imports
* Update dpo.py
* Update __init__.py
* Delete unsloth/models/kto.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Fix orpo/dpo trainer (#1286)
* change the colab notebook for dpo zephyr and orpo
* use original tokenizer
* Update README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* skip modules
* Update vision.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Fix llama.cpp
* Update save.py
* Update save.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update _utils.py
* Update save.py
* Update save.py
* Update mapper.py
* modules
---------
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
* Update README.md
Unsloth Dynamic 4-bit Quantization Update
* Fix vision model tokenizer padding side.
* Update vision.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Add citation section to README.md (#1377)
* Add citation section to README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Granite support (#1218)
* [WIP] Support for Granite
* Fixup inference
* Cleanup flex attention
* remove sliding window
* Use torch.add for residual multiplier
* Llama 3.3
* Update llama.py
* Update llama.py
* fullgraph
* Fix loader.py to work on Windows (#1453)
* Update README.md
Llama 3.3 + Reddit
* Update README.md
Apple ML Cross Entropy
* Update README.md
Removing double citation
* Fix loader.py to work on Windows
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Update save.py warning message (#1425)
* Update README.md
Llama 3.3 + Reddit
* Update README.md
Apple ML Cross Entropy
* Update README.md
Removing double citation
* Update save.py warning message
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Change _fix_chat_template in case a template has both endif and endfor (#1388)
* Update llama and derivatives to pass position embeddings explicitly for transformers v4.47+ (#1442)
* Update save.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Temp fix
* Update _utils.py
* Update _utils.py
* Update pyproject.toml
* Name Error Bug Fix - import from packaging.version import Version (#1468)
* Version
* Update pyproject.toml
* Update pyproject.toml
* Version
* Update pyproject.toml
* Update pyproject.toml
* dependencies
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update mistral.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update granite.py
* Update cohere.py
* Triton windows
* Update gemma2.py
* Update pyproject.toml
* Update _utils.py
* Update pyproject.toml
---------
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
Co-authored-by: Zewen Shen <zewen.public@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Scott Phillips <polygonguru@gmail.com>
Co-authored-by: qingy1337 <qxli2@students.everettcc.edu>
Co-authored-by: Giulia Baldini <44327645+giuliabaldini@users.noreply.github.com>
Co-authored-by: Yonghye Kwon <developer.0hye@gmail.com>
|
2024-12-24 03:37:03 -08:00 |
|
Daniel Han
|
3d76fdbd87
|
Update pyproject.toml
|
2024-12-24 03:35:04 -08:00 |
|
Daniel Han
|
1c7bc4ea0b
|
Update _utils.py
|
2024-12-24 03:34:54 -08:00 |
|
Daniel Han
|
8337b90e97
|
Update pyproject.toml
|
2024-12-24 01:55:04 -08:00 |
|
Daniel Han
|
d44bb3c2aa
|
Update gemma2.py
|
2024-12-24 00:18:47 -08:00 |
|
Daniel Han
|
95ff42da63
|
Triton windows
|
2024-12-24 00:17:33 -08:00 |
|
Daniel Han
|
2e08a4b023
|
Update cohere.py
|
2024-12-24 00:11:17 -08:00 |
|
Daniel Han
|
052621631a
|
Update granite.py
|
2024-12-24 00:09:23 -08:00 |
|
Daniel Han
|
cc98e0a50f
|
Update pyproject.toml
|
2024-12-24 00:08:49 -08:00 |
|
Daniel Han
|
326610b118
|
Update pyproject.toml
|
2024-12-24 00:08:03 -08:00 |
|
Daniel Han
|
e280cb766c
|
Update pyproject.toml
|
2024-12-24 00:07:37 -08:00 |
|
Daniel Han
|
00af89272c
|
Update mistral.py
|
2024-12-24 00:04:36 -08:00 |
|
Daniel Han
|
61917ccfcd
|
Update pyproject.toml
|
2024-12-24 00:02:30 -08:00 |
|
Daniel Han
|
e74fc34464
|
Update pyproject.toml
|
2024-12-23 22:49:16 -08:00 |
|
Daniel Han
|
e3af8f9c4d
|
Update pyproject.toml
|
2024-12-23 22:47:20 -08:00 |
|
Daniel Han
|
7bc9bd3a8b
|
Update pyproject.toml
|
2024-12-23 22:47:11 -08:00 |
|
Daniel Han
|
1f67a9498a
|
dependencies
|
2024-12-23 22:27:35 -08:00 |
|
Daniel Han
|
c373773823
|
Update pyproject.toml
|
2024-12-23 21:53:43 -08:00 |
|
Daniel Han
|
f9e59ff45d
|
Update pyproject.toml
|
2024-12-23 21:52:50 -08:00 |
|
Daniel Han
|
82570deaa7
|
Version
|
2024-12-23 21:43:32 -08:00 |
|
Daniel Han
|
68d055db95
|
Update pyproject.toml
|
2024-12-23 21:16:30 -08:00 |
|
Daniel Han
|
db0953d4ab
|
Update pyproject.toml
|
2024-12-23 21:14:01 -08:00 |
|
Daniel Han
|
2678ad22fd
|
Version
|
2024-12-23 21:07:51 -08:00 |
|
Yonghye Kwon
|
3e8f935177
|
Name Error Bug Fix - import from packaging.version import Version (#1468)
|
2024-12-22 23:22:36 -08:00 |
|
Daniel Han
|
b753a805ed
|
Update pyproject.toml
|
2024-12-21 01:24:09 -08:00 |
|
Daniel Han
|
73980fab8b
|
Update _utils.py
|
2024-12-21 01:11:30 -08:00 |
|
Daniel Han
|
6dcf3d91aa
|
Merge branch 'main' into nightly
|
2024-12-20 03:30:58 -08:00 |
|
Daniel Han
|
79db713073
|
Bug fix
|
2024-12-20 03:30:01 -08:00 |
|
Daniel Han
|
44185c473b
|
Merge branch 'main' into nightly
|
2024-12-20 03:26:58 -08:00 |
|
Daniel Han
|
ae3b6c7c91
|
Typo
|
2024-12-20 03:26:55 -08:00 |
|
Daniel Han
|
92e1d8187a
|
Merge branch 'main' into nightly
|
2024-12-20 03:24:37 -08:00 |
|
Daniel Han
|
1df4df41c2
|
Typo
|
2024-12-20 03:24:17 -08:00 |
|
Daniel Han
|
135c25aeb7
|
Bug fixes (#1458)
* Update _utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* typing
* Update rope_embedding.py
* types
* Disable compiling
* Update _utils.py
* Update _utils.py
* Forward hook
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update pyproject.toml
* Update _utils.py
* Update llama.py
* CE Loss
* Update cross_entropy_loss.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254)
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors
* Update cross_entropy_loss.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Throw error when inferencing longer than max_popsition_embeddings (#1236)
* Throw error when inferencing longer than max_popsition_embeddings without rope scaling
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* CLI now handles user input strings for dtype correctly (#1235)
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
* Update flex_attention.py
* Update _utils.py
* Update _utils.py
* Update flex_attention.py
* Update flex_attention.py
* Update loader.py
* Update loader.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* triton_cast
* Update utils.py
* Qwen 2.5 Coder
* Fix/export mistral (#1281)
* Enhance install_python_non_blocking to handle protobuf installation and process management
* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"
This reverts commit f09974b151.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266"
This reverts commit 9fc130785d.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* DOC Update - Update README.md with os.environ in example (#1269)
* Update README.md with os.environ in example
Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup.
As currently the unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/get_chat_template (#1246)
* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to
* Remove type hinting
* Update chat_templates.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/sft-trainer (#1276)
* Add patch for SFTTrainer to maintain backward compatibility with TRL changes
* Update trainer.py
* Update trainer.py
* Refactor trainer patch to maintain backward compatibility with TRL changes
* Update trainer.py
* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update __init__.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update tokenizer_utils.py
* Update llama.py
* Fix #853
* fix/sfttrainer-compatibility (#1293)
* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance
* Update trainer.py
* Update trainer.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update rms_layernorm.py
* Update rms_layernorm.py
* Gemma
* Update rms_layernorm.py
* Update gemma2.py
* Cut Cross Entropy
* Update llama.py
* Cut Cross Entropy
* Update llama.py
* Update llama.py
* Update llama.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* patch_fast_lora
* vision
* Update fast_lora.py
* Update _utils.py
* Update _utils.py
* Vision
* Update trainer.py
* Update save.py
* FastBaseVisionModel
* Update loader_utils.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update _utils.py
* tokenizer_name
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update _utils.py
* Update loader.py
* kwargs
* logits
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* error
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* Update llama.py
* Update vision.py
* Update loader.py
* Old torch versions
* Update loader.py
* Update loader.py
* prints
* recheck
* Update loader.py
* Update loader.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Feat/kto (#1316)
* Add PatchKTOTrainer and update model imports
* Update dpo.py
* Update __init__.py
* Delete unsloth/models/kto.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Fix orpo/dpo trainer (#1286)
* change the colab notebook for dpo zephyr and orpo
* use original tokenizer
* Update README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* skip modules
* Update vision.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Fix llama.cpp
* Update save.py
* Update save.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update _utils.py
* Update save.py
* Update save.py
* Update mapper.py
* modules
* Fix vision model tokenizer padding side. (#1384)
* Dynamic quants (#1379)
* typing
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* int64
* Update _utils.py
* Update cross_entropy_loss.py
* constexpr
* constexpr
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* CE
* Update cross_entropy_loss.py
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update utils.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* Update rms_layernorm.py
* typing
* Update rope_embedding.py
* types
* Disable compiling
* Update _utils.py
* Update _utils.py
* Forward hook
* Update _utils.py
* Update llama.py
* Update _utils.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update pyproject.toml
* Update _utils.py
* Update llama.py
* CE Loss
* Update cross_entropy_loss.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update cross_entropy_loss.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors (#1254)
* Fix: cast logits to float32 in cross_entropy_forward to prevent errors
* Update cross_entropy_loss.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Throw error when inferencing longer than max_popsition_embeddings (#1236)
* Throw error when inferencing longer than max_popsition_embeddings without rope scaling
* Update llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* CLI now handles user input strings for dtype correctly (#1235)
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
* Update flex_attention.py
* Update _utils.py
* Update _utils.py
* Update flex_attention.py
* Update flex_attention.py
* Update loader.py
* Update loader.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update flex_attention.py
* Update _utils.py
* Update cross_entropy_loss.py
* Update _utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* Update tokenizer_utils.py
* triton_cast
* Update utils.py
* Qwen 2.5 Coder
* Fix/export mistral (#1281)
* Enhance install_python_non_blocking to handle protobuf installation and process management
* Revert "Enhance install_python_non_blocking to handle protobuf installation and process management"
This reverts commit f09974b151.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Revert "Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266"
This reverts commit 9fc130785d.
* Set PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION to 'python' to address issue #1266
* Update __init__.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* DOC Update - Update README.md with os.environ in example (#1269)
* Update README.md with os.environ in example
Added OS Environ in example to avoid device conflicts , for a user at least in jupyter notebook this allows to select GPU in a multi GPU setup.
As currently the unsloth init checks all GPU's and takes the first in the order which can be a issue when some GPU's are in use and the list still shows them. So to manually avoid this, this os config is required.
Small change but a bit time saver for those who straight away copies the tutorials
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/get_chat_template (#1246)
* Refactor `get_chat_template` to now support system message instead. It supposed to fix ollama tokenizer chattemplate to
* Remove type hinting
* Update chat_templates.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* fix/sft-trainer (#1276)
* Add patch for SFTTrainer to maintain backward compatibility with TRL changes
* Update trainer.py
* Update trainer.py
* Refactor trainer patch to maintain backward compatibility with TRL changes
* Update trainer.py
* Refactor trainer.py to exclude non-convertible trainers from backward compatibility patch
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update __init__.py
* Update trainer.py
* Update trainer.py
* Update trainer.py
* Update tokenizer_utils.py
* Update llama.py
* Fix #853
* fix/sfttrainer-compatibility (#1293)
* Refactor trainer.py to import SFTConfig directly and update UnslothTrainingArguments class inheritance
* Update trainer.py
* Update trainer.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Update rms_layernorm.py
* Update rms_layernorm.py
* Gemma
* Update rms_layernorm.py
* Update gemma2.py
* Cut Cross Entropy
* Update llama.py
* Cut Cross Entropy
* Update llama.py
* Update llama.py
* Update llama.py
* Update __init__.py
* Update __init__.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* patch_fast_lora
* vision
* Update fast_lora.py
* Update _utils.py
* Update _utils.py
* Vision
* Update trainer.py
* Update save.py
* FastBaseVisionModel
* Update loader_utils.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update _utils.py
* tokenizer_name
* Update loader.py
* Update vision.py
* Update save.py
* Update save.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update _utils.py
* Update loader.py
* kwargs
* logits
* Update llama.py
* Update llama.py
* Update llama.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* error
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update _utils.py
* Update loader.py
* Update llama.py
* Update vision.py
* Update loader.py
* Old torch versions
* Update loader.py
* Update loader.py
* prints
* recheck
* Update loader.py
* Update loader.py
* Update _utils.py
* Update _utils.py
* Update mapper.py
* Feat/kto (#1316)
* Add PatchKTOTrainer and update model imports
* Update dpo.py
* Update __init__.py
* Delete unsloth/models/kto.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Fix orpo/dpo trainer (#1286)
* change the colab notebook for dpo zephyr and orpo
* use original tokenizer
* Update README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* skip modules
* Update vision.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Fix llama.cpp
* Update save.py
* Update save.py
* Update vision.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update save.py
* Update _utils.py
* Update save.py
* Update save.py
* Update mapper.py
* modules
---------
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
* Update README.md
Unsloth Dynamic 4-bit Quantization Update
* Fix vision model tokenizer padding side.
* Update vision.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Add citation section to README.md (#1377)
* Add citation section to README.md
* Update README.md
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
* Granite support (#1218)
* [WIP] Support for Granite
* Fixup inference
* Cleanup flex attention
* remove sliding window
* Use torch.add for residual multiplier
* Llama 3.3
* Update llama.py
* Update llama.py
* fullgraph
* Fix loader.py to work on Windows (#1453)
* Update README.md
Llama 3.3 + Reddit
* Update README.md
Apple ML Cross Entropy
* Update README.md
Removing double citation
* Fix loader.py to work on Windows
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Update save.py warning message (#1425)
* Update README.md
Llama 3.3 + Reddit
* Update README.md
Apple ML Cross Entropy
* Update README.md
Removing double citation
* Update save.py warning message
---------
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
* Change _fix_chat_template in case a template has both endif and endfor (#1388)
* Update llama and derivatives to pass position embeddings explicitly for transformers v4.47+ (#1442)
* Update save.py
* Update llama.py
* Update mistral.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Update llama.py
* Temp fix
* Update _utils.py
---------
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Datta Nimmaturi <datta.nimmaturi@nutanix.com>
Co-authored-by: Edwin Fennell <edwinfennell1@gmail.com>
Co-authored-by: root <root@ieeres.chu.cam.ac.uk>
Co-authored-by: Uday Girish Maradana <einsteingirish@gmail.com>
Co-authored-by: cell-dame <122996026+dame-cell@users.noreply.github.com>
Co-authored-by: Zewen Shen <zewen.public@gmail.com>
Co-authored-by: Michael Han <107991372+shimmyshimmer@users.noreply.github.com>
Co-authored-by: Scott Phillips <polygonguru@gmail.com>
Co-authored-by: qingy1337 <qxli2@students.everettcc.edu>
Co-authored-by: Giulia Baldini <44327645+giuliabaldini@users.noreply.github.com>
|
2024-12-20 03:09:59 -08:00 |
|
Daniel Han
|
f7ab1ca028
|
Update _utils.py
|
2024-12-20 03:08:59 -08:00 |
|
Daniel Han
|
c55191bc72
|
Temp fix
|
2024-12-20 03:07:04 -08:00 |
|
Daniel Han
|
ba4a6cc277
|
Update llama.py
|
2024-12-20 03:03:26 -08:00 |
|
Daniel Han
|
7425bbbd88
|
Update llama.py
|
2024-12-20 03:01:28 -08:00 |
|
Daniel Han
|
197c253416
|
Update llama.py
|
2024-12-20 02:59:27 -08:00 |
|
Daniel Han
|
dd2a1a13b1
|
Update llama.py
|
2024-12-20 02:53:45 -08:00 |
|