Commit graph

3,050 commits

Author SHA1 Message Date
Noah Kirschmann
a80f1991c5 Update transformers version constraint in pyproject.toml (#3689)
* Update transformers version constraint in pyproject.toml

The latest transformers version just fixes the local training.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update transformers version constraint in pyproject.toml

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-12-08 03:27:18 -08:00
Daniel Han
034a35f6d4 Add **kwargs 2025-12-08 03:24:51 -08:00
Daniel Han
f4de7baea1 Update rl.py 2025-12-08 02:23:43 -08:00
Daniel Han
4408ddc081 Update vision.py 2025-12-07 23:09:13 -08:00
Daniel Han
d86ded6799 Update _utils.py 2025-12-07 16:52:59 -08:00
Daniel Han
cb4d8da5a2 Xformers fix 2025-12-07 16:40:51 -08:00
Michael Han
3d4f236155 Update README.md 2025-12-04 08:21:20 -08:00
Daniel Han
845e61d351 Update README.md 2025-12-02 04:08:54 -08:00
Daniel Han
14e8e3137d Update README.md 2025-12-02 03:52:50 -08:00
pre-commit-ci[bot]
13f6491fe6 [pre-commit.ci] pre-commit autoupdate (#3666)
updates:
- [github.com/astral-sh/ruff-pre-commit: v0.14.6 → v0.14.7](https://github.com/astral-sh/ruff-pre-commit/compare/v0.14.6...v0.14.7)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-12-01 17:45:13 -08:00
Daniel Han
4fd865cc99 Update _utils.py 2025-12-01 08:01:05 -08:00
Daniel Han
d655c7434a Update rl.py 2025-12-01 08:00:08 -08:00
Daniel Han
66649d18bd Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"
This reverts commit cad158a56c.
2025-12-01 07:24:58 -08:00
pre-commit-ci[bot]
cad158a56c [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2025-12-01 15:24:34 +00:00
Daniel Han
487a951914 Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"
This reverts commit 964c9fef95.
2025-12-01 07:24:21 -08:00
pre-commit-ci[bot]
964c9fef95 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2025-12-01 15:23:44 +00:00
Daniel Han
5f27bc4db5 Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"
This reverts commit d34e0454ac.
2025-12-01 07:23:31 -08:00
pre-commit-ci[bot]
d34e0454ac [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2025-12-01 15:20:22 +00:00
Daniel Han
d994280cdc Update unsloth/models/rl.py
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-01 07:20:00 -08:00
Daniel Han
ebec564689 Update unsloth/models/rl.py
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-01 07:19:50 -08:00
Daniel Han
b4f5a70878 Update qwen3_moe.py 2025-12-01 07:19:07 -08:00
Datta Nimmaturi
04cfc0d139 Vllm guided decoding (#3663)
* vllm sampling params fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* do not patch base_trainer

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* seperate vllm fixes

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fixup deletion

* Fix indentation

* revert to old style

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-12-01 07:11:28 -08:00
Daniel Han
3d62c38ada Verisoning 2025-12-01 07:09:17 -08:00
Daniel Han
3f4768ad1e Update rl.py 2025-12-01 06:23:23 -08:00
Daniel Han
ba2897a318 Revert "[FIX] Vllm guided decoding params (#3662)"
This reverts commit fb4f0fdf56.
2025-12-01 05:43:45 -08:00
Datta Nimmaturi
fb4f0fdf56 [FIX] Vllm guided decoding params (#3662)
* vllm sampling params fix

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* do not patch base_trainer

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* seperate vllm fixes

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Apply suggestion from @danielhanchen

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

This reverts commit 58b483dc0d1790f99580665801d3fa0d7267c533.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

This reverts commit b2497519659a9f301e7a633795d9efdafdc2b277.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks"

This reverts commit de3daaf429f81aceb6632932b0cb1af5149652a8.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-12-01 05:42:37 -08:00
Daniel Han
bf28d686a0 Merge branch 'main' into nightly 2025-12-01 04:21:27 -08:00
Santosh Bhavani
f7be4b1140 Fix: Pass gradient_checkpointing parameter to model.for_training() calls (#3659) 2025-12-01 04:18:41 -08:00
Daniel Han
f9fd3c43fa Update vision.py 2025-12-01 01:21:26 -08:00
Daniel Han
085a0a9c2d Typos 2025-12-01 00:01:07 -08:00
Daniel Han
7028dc02a5 Update qwen3_moe.py 2025-11-30 23:37:32 -08:00
Daniel Han
60fd9d870d Update vision.py 2025-11-30 21:32:07 -08:00
VED
f23f17e8ba set defualt [128, 128] insted of none (#3658)
Co-authored-by: Ved <ved.work2024@gmail.com>
2025-11-30 17:00:31 -08:00
Daniel Han
bf11ba0c53 Update rl.py 2025-11-30 04:40:03 -08:00
Daniel Han
dbcedbbf65 Merge branch 'main' into nightly 2025-11-30 04:39:55 -08:00
DoubleMathew
f9d2a11dba make unsloth_tiled_mlp a from_pretrained arg (#3655)
* make unsloth_tiled_mlp a from_pretrained arg

* adjust patching logic
2025-11-29 22:47:51 -08:00
Bhuvan Prakash
cd24a2896c Fix: prevent load_in_fp8 kwarg from reaching Qwen3MoeForCausalLM constructor (Fix #3649) (#3654)
* Fix: remove load_in_fp8 from kwargs to prevent Qwen3Moe init TypeError (Fix #3649)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-11-29 20:18:11 -08:00
gitpullpull
77d47ecee5 Fix broken link for Advanced pip install instructions (#3652) 2025-11-29 15:33:48 -08:00
Michael Han
bfdf73fa66 Update README.md 2025-11-29 08:01:00 -08:00
DoubleMathew
8953a06764 fix rope_theta -> rope_parameters['rope_theta'] (#3651) 2025-11-29 06:44:26 -08:00
Michael Han
f668897b3c Update README.md 2025-11-27 20:52:27 -08:00
Michael Han
ef30739fd7 Update README.md 2025-11-27 20:49:47 -08:00
Daniel Han
1abf47e27c Merge branch 'main' into nightly 2025-11-27 05:45:20 -08:00
mk0walsk
460f2cf6ad Fix indefinite article usage in comments and docstrings (#3648) 2025-11-26 18:15:27 -08:00
Dina Suehiro Jones
c740e14937 Fix llama tokenizer padding_side when using model.generate in inference mode (#3644)
* Only restore training mode after generation, if the model started out in training mode

Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Dina Suehiro Jones <dina.s.jones@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2025-11-25 17:33:28 -08:00
Daniel Han
d7eafb1042 Merge branch 'main' into nightly 2025-11-25 07:59:24 -08:00
Daniel Han
ea4afe1154 Update mapper.py 2025-11-25 07:59:21 -08:00
Daniel Han
499758b0b5 Merge branch 'main' into nightly 2025-11-25 07:45:27 -08:00
Daniel Han
8119697202 Update loader.py 2025-11-25 07:45:14 -08:00
Daniel Han
8fc18d1a84 Merge branch 'main' into nightly 2025-11-25 07:39:00 -08:00