Commit graph

1,779 commits

Author SHA1 Message Date
Daniel Han
69f4581236 Update rl.py 2025-03-13 23:08:46 -07:00
Daniel Han
2def2a5e0e Update vision.py 2025-03-13 18:34:26 -07:00
Daniel Han
e388265a89 Update vision.py 2025-03-13 18:31:03 -07:00
Daniel Han
6e7d5be3ff Update vision.py 2025-03-13 18:26:30 -07:00
Daniel Han
f525442d63 constexpr 2025-03-13 18:23:29 -07:00
Daniel Han
9f6d280994 vLLM fixes 2025-03-13 17:57:46 -07:00
Daniel Han
171ad425ae Update rl.py 2025-03-13 16:02:56 -07:00
Daniel Han
ed80c07943 Update vision.py 2025-03-13 06:39:17 -07:00
Daniel Han
b284ed58a7 Update vision.py 2025-03-13 06:34:55 -07:00
Daniel Han
3b6c379f50 Update vision.py 2025-03-13 06:25:18 -07:00
Daniel Han
57576a5bd3 Update vision.py 2025-03-13 06:24:37 -07:00
Daniel Han
e0e31d9f96 Update vision.py 2025-03-13 06:15:42 -07:00
Daniel Han
d1f09cf63e Update rl.py 2025-03-13 06:12:36 -07:00
Daniel Han
c6eae35193 Update vision.py 2025-03-13 06:08:33 -07:00
Daniel Han
6dcd0bf7c6 Update vision.py 2025-03-13 06:06:24 -07:00
Daniel Han
7493af8cab Autocast 2025-03-13 06:02:33 -07:00
Daniel Han
067fb5ee09 forced precision 2025-03-13 05:46:02 -07:00
Daniel Han
20ae25a13d Update _utils.py 2025-03-13 05:38:21 -07:00
Daniel Han
833e295db6 Revert 2025-03-13 05:13:17 -07:00
Daniel Han
8b51a7d8fb Update vision.py 2025-03-13 01:30:06 -07:00
Daniel Han
7d0893bd89 Update vision.py 2025-03-13 01:27:50 -07:00
Daniel Han
dd17676c99 Update loader.py 2025-03-13 01:17:48 -07:00
Daniel Han
6e58d9764f Update vision.py 2025-03-13 01:15:25 -07:00
Daniel Han
c96eab5d8c Update vision.py 2025-03-12 22:23:29 -07:00
Daniel Han
caec8ffcf9 Update vision.py 2025-03-12 22:22:23 -07:00
Daniel Han
07f47a4d20 Update chat_templates.py 2025-03-12 21:52:38 -07:00
Daniel Han
b0d9ee0a8a Update chat_templates.py 2025-03-12 21:47:53 -07:00
Daniel Han
24cd9f719a Update rl.py 2025-03-12 21:47:01 -07:00
Daniel Han
97f40bdb0d Update llama.py 2025-03-12 21:42:27 -07:00
Daniel Han
9005a5700c Update llama.py 2025-03-12 21:40:20 -07:00
Daniel Han
6218eae6ad Update vision.py 2025-03-12 21:38:51 -07:00
Daniel Han
a3637fa0b2 Update vision.py 2025-03-12 21:35:29 -07:00
Daniel Han
ed588ee66e Update vision.py 2025-03-12 21:34:34 -07:00
Daniel Han
bc735a7522 Update vision.py 2025-03-12 21:33:22 -07:00
Daniel Han
8457c759cd Update vision.py 2025-03-12 21:31:37 -07:00
Daniel Han
57a5442f83 Bug fixes 2025-03-12 21:30:02 -07:00
Daniel Han
bb193e48e0 Gemma 3 chat template 2025-03-12 20:37:19 -07:00
Daniel Han
3326c4f6ad model names 2025-03-12 20:04:27 -07:00
Daniel Han
bb59cec9d7 Update loader.py 2025-03-12 19:25:41 -07:00
Daniel Han
b6187c6428 Temporary patches 2025-03-12 19:20:17 -07:00
Daniel Han
f386f0fe49 Update vision.py 2025-03-12 06:51:23 -07:00
Daniel Han
0df6ad49a8 Merge branch 'main' into nightly 2025-03-12 05:00:45 -07:00
Daniel Han
71039cb1ce Update _utils.py 2025-03-12 04:52:07 -07:00
Daniel Han
3edacc50bc Update _utils.py 2025-03-12 04:46:34 -07:00
Daniel Han
060f931edf Update mapper.py 2025-03-12 04:07:45 -07:00
Daniel Han
78374adccd
Gemma 3 (#1986)
* Update llama.py

* GRPO optimized

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Selective Log softmax

* Fix GRPO bsz

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Fix TRL

* Metrics GRPO

* Update rl_replacements.py

* Update rl_replacements.py

* No compile

* Update rl.py

* Remove docs

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* llama-quantize on WINDOWS WSL error fix - edit save.py (gguf saving breaks) (#1649)

* edit save.py to fix gguf saving breaks.

* add check for .exe or not exe file extension for linux and windows

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update llama.py

* Update llama.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* unsloth_num_chunks

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py (#1754)

Fix typo in comment: know -> now.

This was printed when running the Llama3.1_(8B)-GRPO.ipynb example notebook, so I'd expect others to run into it as well.

* Optional logits

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl_replacements.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update rl.py

* fix an import error (#1767)

* fix an import error

* Delete .gitignore

* Update loader.py

* Update save.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* SamplingParams

* Convert mask to float (#1762)

* [Windows Support] Add latest `xformers` wheels to pyproject.toml (#1753)

* Add latest xformers

* Add a couple of lines to docs

* vLLMSamplingParams

* Update __init__.py

* default num_chunks == -1

* Versioning

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update pyproject.toml

* Update pyproject.toml

* Export Model to ollama.com  (#1648)

* Ollama Export Model to ollama.com

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Check for model_name

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* subprocess use instead of requests | added check for ollama server

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* create_ollama_model | fix

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Push to Ollama

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>

* Update cross_entropy_loss.py

* torch_cuda_device

* Update utils.py

* Update utils.py

* Update utils.py

* device

* device

* Update loader.py

* Update llama.py

* Update README.md

* Update llama.py

* Update llama.py

* Update _utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update utils.py

* Update utils.py

* Update utils.py

* Update utils.py

* __version__

* Update rl.py

* Bug fixes

* Bug fixes

* Update llama.py

* Update _utils.py

* _wrap_fast_inference

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update _utils.py

* SFT dataset prepare

* Update pyproject.toml

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl_replacements.py

* Update rl.py

* Update llama.py

* Update llama.py

* Update utils.py

* bug fix

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update llama.py

* Update __init__.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Update rl.py

* Update rl.py

* Update rl.py

* Update _utils.py

* Update __init__.py

* Update _utils.py

* Version

* versioning

* Update _utils.py

* Update llama.py

* Update llama.py

* Bug fixes

* FastModel

* __doc__

* Update vision.py

* Update loader.py

* Update loader.py

* Update loader.py

* version

* move use_modelscope to _utils (#1938)

* move use_modelscope to _utils

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Don't use revision when loading model_config and is_peft=True (#1949)

* More syntax warnings (#1944)

* move use_modelscope to _utils

* fix

* Update _utils.py

* Update loader.py

---------

Co-authored-by: Daniel Han <danielhanchen@gmail.com>

* Update loader.py

* Full finetuning and other fixes

* UNSLOTH_ENABLE_FULL_FINETUNING

* Update loader.py

* Update loader.py

* Update loader.py

* Update vision.py

* Update vision.py

* full finetuning

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* max_seq_length

* Update rl.py

* Update rl.py

* Update rl.py

* Update pyproject.toml

* AutoModelForImageTextToText

* Update mapper.py

* Update pyproject.toml

* Update _utils.py

* Update _utils.py

* Update _utils.py

* Batch samples

* Update loader.py

* Update loader.py

* Update loader.py

* Update loader.py

* Update _utils.py

* Update loader.py

* Update vision.py

* Update loader.py

* Update vision.py

* Update vision.py

* Update vision.py

* Update mapper.py

---------

Signed-off-by: Jyotin Goel <b22ai063@iitj.ac.in>
Co-authored-by: Gennadii Manzhos <105049664+everythingisc00l@users.noreply.github.com>
Co-authored-by: Seth Weidman <seth@sethweidman.com>
Co-authored-by: Nino Risteski <95188570+NinoRisteski@users.noreply.github.com>
Co-authored-by: Edd <68678137+Erland366@users.noreply.github.com>
Co-authored-by: Ben <6579034+versipellis@users.noreply.github.com>
Co-authored-by: Jyotin Goel <120490013+gjyotin305@users.noreply.github.com>
Co-authored-by: Kareem <81531392+KareemMusleh@users.noreply.github.com>
Co-authored-by: Wilson Wu <140025193+wiwu2390@users.noreply.github.com>
2025-03-12 01:23:34 -07:00
Daniel Han
ceda772a3d Update mapper.py 2025-03-11 23:35:46 -07:00
Daniel Han
2fdeecd179 Update vision.py 2025-03-11 22:55:34 -07:00
Daniel Han
152b376eca Update vision.py 2025-03-11 22:36:51 -07:00
Daniel Han
528e8f07ba Update vision.py 2025-03-11 22:34:57 -07:00