ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1,730 commits 391 branches 58 tags 304 MiB
Commit graph

1,730 commits

This branch
This branch
All branches
Author SHA1 Message Date
Daniel Han
6949a52dcc Update vision.py 2025-03-11 22:34:57 -07:00
Daniel Han
cf2dd1ff53 Update loader.py 2025-03-11 22:31:14 -07:00
Daniel Han
a22eec898d Update vision.py 2025-03-11 22:29:06 -07:00
Daniel Han
2637427be7 Update loader.py 2025-03-11 22:27:53 -07:00
Daniel Han
fa595d3b44 Update _utils.py 2025-03-11 22:22:36 -07:00
Daniel Han
48813c903e Update loader.py 2025-03-11 22:02:39 -07:00
Daniel Han
f6a745d73a Update loader.py 2025-03-11 20:45:53 -07:00
Daniel Han
fa7030b71e Update loader.py 2025-03-11 20:44:01 -07:00
Daniel Han
407f5d472b Update loader.py 2025-03-11 20:43:25 -07:00
Daniel Han
85bb3e619d Batch samples 2025-03-11 19:46:41 -07:00
Daniel Han
cabf4a7345 Update _utils.py 2025-03-11 15:25:21 -07:00
Daniel Han
3478774039 Update _utils.py 2025-03-11 15:22:16 -07:00
Daniel Han
6c3f84a24f Update _utils.py 2025-03-11 15:20:20 -07:00
Daniel Han
ed1d1a06b1 Update pyproject.toml 2025-03-11 14:59:29 -07:00
Daniel Han
0176f058b2 Update mapper.py 2025-03-11 05:37:29 -07:00
Daniel Han
2015e1e382 AutoModelForImageTextToText 2025-03-11 04:30:01 -07:00
Daniel Han
7a216103f9 Update pyproject.toml 2025-03-11 00:18:55 -07:00
Daniel Han
440b3c8723 Update rl.py 2025-03-10 05:00:45 -07:00
Daniel Han
057aad6b4d Update rl.py 2025-03-10 04:58:59 -07:00
Daniel Han
11868359e2 Update rl.py 2025-03-10 04:57:47 -07:00
Daniel Han
5d8b756ca7 max_seq_length 2025-03-10 04:39:25 -07:00
Daniel Han
5da887c366 Update _utils.py 2025-03-10 00:31:49 -07:00
Daniel Han
6181f908d7 Update loader.py 2025-03-09 23:33:21 -07:00
Daniel Han
75d4656d41 Update loader.py 2025-03-09 23:24:21 -07:00
Daniel Han
6627229ef6 Update loader.py 2025-03-09 23:22:13 -07:00
Daniel Han
eda8ddbc34 full finetuning 2025-03-09 23:18:52 -07:00
Daniel Han
d6fd96cc86 Update vision.py 2025-03-09 23:13:30 -07:00
Daniel Han
ef05c7607b Update vision.py 2025-03-09 23:11:28 -07:00
Daniel Han
1864b4b21e Update loader.py 2025-03-09 23:08:34 -07:00
Daniel Han
fdabdc6b58 Update loader.py 2025-03-09 23:06:06 -07:00
Daniel Han
8859123946 Update loader.py 2025-03-09 23:03:27 -07:00
Daniel Han
a4dddc96b7 UNSLOTH_ENABLE_FULL_FINETUNING 2025-03-09 22:57:24 -07:00
Daniel Han
46ef6c2cca Full finetuning and other fixes 2025-03-09 22:52:34 -07:00
Daniel Han
5f16b4602c Update loader.py 2025-03-08 18:48:54 -08:00
Kareem
4857e5851d More syntax warnings (#1944) 
* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-03-08 17:55:37 -08:00
Wilson Wu
544b76b7e1 Don't use revision when loading model_config and is_peft=True (#1949) 2025-03-08 17:51:53 -08:00
Kareem
7405dc19b1 move use_modelscope to _utils (#1938) 
* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>
 2025-03-08 17:51:07 -08:00
Daniel Han
57d7b18260 Merge branch 'main' into nightly 2025-03-08 17:50:50 -08:00
Daniel Han
49186bee79 Bug fixes (#1951) 
* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update _utils.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* GRPO optimized

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Selective Log softmax

* Fix GRPO bsz

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Fix TRL

* Metrics GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* No compile

* Update rl.py

* Remove docs

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* llama-quantize on WINDOWS WSL error fix - edit save.py (gguf saving breaks) (#1649)

* edit save.py to fix gguf saving breaks.

* add check for .exe or not exe file extension for linux and windows

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* unsloth_num_chunks

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py (#1754)

Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.

* Optional logits

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update pyproject.toml

* Update pyproject.toml

* Export Model to ollama.com  (#1648)

* Ollama Export Model to ollama.com

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Check for model_name

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* subprocess use instead of requests | added check for ollama server

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model | fix

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Push to Ollama

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Update cross_entropy_loss.py

* torch_cuda_device

* Update utils.py

* Update utils.py

* Update utils.py

* device

* device

* Update loader.py

* Update llama.py

* Update README.md

* Update llama.py

* Update llama.py

* Update _utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* __version__

* Update rl.py

* Bug fixes

* Bug fixes

* Update llama.py

* Update _utils.py

* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>
Co-authored-by: Gennadii Manzhos <105049664+everythingisc00l@users.noreply.github.com>
Co-authored-by: Seth Weidman <seth@sethweidman.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
Co-authored-by: Jyotin Goel <120490013+gjyotin305@users.noreply.github.com>
 2025-03-08 04:34:55 -08:00
Daniel Han
4de1261552 version 2025-03-08 04:29:19 -08:00
Daniel Han
ad3b2dd7a6 Update loader.py 2025-03-08 03:38:22 -08:00
Daniel Han
21b46a10ce Update loader.py 2025-03-08 03:36:45 -08:00
Daniel Han
a047145caf Update loader.py 2025-03-08 03:35:22 -08:00
Daniel Han
366947bb25 Update vision.py 2025-03-08 03:23:23 -08:00
Daniel Han
48d29224fc __doc__ 2025-03-08 03:20:03 -08:00
Daniel Han
f7bad2a50b FastModel 2025-03-08 03:02:45 -08:00
Daniel Han
b4590c9c56 Bug fixes 2025-03-07 01:43:39 -08:00
Daniel Han
74fd307c0a Merge branch 'main' into nightly 2025-03-06 14:47:39 -08:00
Daniel Han
81506a8f2f Merge branch 'main' of https://github.com/unslothai/unsloth 2025-03-06 14:44:16 -08:00
Daniel Han
b9080634b1 Big bug fixes 
Fixes:
1. #1932
2. #1931
3. #1928
4. #1925
5. #1921
6. #1918
7. #1923
8. #1922
9. #1921

Please do: `pip install --upgrade --force-reinstall --no-deps unsloth unsloth_zoo` for local machines. Colab / Kaggle please restart and delete / disconnect runtime and redo

Apologies on the issues!
 2025-03-06 14:43:48 -08:00