unsloth/unsloth/models
Daniel Han 39428fc5af CI(consolidated): strict mode -- drop continue-on-error, tighten ledger
Now that the upstream patch fixes have landed (#5319 for the three
patch_* helpers, unsloth-zoo#628 for the MoE coverage canary), every
observed cell-level red was one of those two things. Both are fixed,
so re-run the matrix in strict mode:

- Removed every per-step `continue-on-error: true`. A failing test step
  fails the cell. The previous green-with-fail-prints lie is gone.
- Runtime patch ledger: was `assert REQUIRED helpers exist by name`
  (an inventory walk). Now also `assert len(fail) == 0` -- any
  zero-arg patch that raises is a real regression. NEEDS_PRECONDITION
  still skips the three patches that legitimately need real CUDA /
  runtime args.
- patch_tiled_mlp shim: bumped seq_len from 4 to 192 with hidden=64 so
  divmod(192, 64) = (3, 0) and the tiled path actually runs 3 shards
  instead of degenerating to n_shards=1 (which is bit-exact and only
  confirms patching installed something). Added an explicit
  pre-assertion that we are exercising multi-shard.
- openenv graceful-skip warning: previous text said "Weight reload
  still functional" which over-promised. Replaced with the literal
  consequence: duplicate `collective_rpc("reload_weights")` is not
  stripped and `wake_up(tags=["kv_cache"])` is not retagged. Most
  users are unaffected; openenv GRPO users on this TRL build may see
  redundant reload_weights or partial wake_up.

Includes a merge of main into this branch so the consolidated cells
pip-install the post-#5319 unsloth tree.
2026-05-07 07:15:41 +00:00
..
__init__.py Revert "feat: Add Mixtral model support" 2026-03-13 22:38:49 -07:00
_utils.py fix: 3 patch_* helpers — fast_lora import, sft_trainer Union, openenv OSError (#5319) 2026-05-07 00:12:09 -07:00
cohere.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
dpo.py Formatting & bug fixes (#3563) 2025-11-07 06:00:22 -08:00
falcon_h1.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
gemma.py Fix/pr 3699 leftpad prefill main (#4100) 2026-02-25 07:21:04 -08:00
gemma2.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
glm4_moe.py [MoE] Improve moe kernels for unsloth fine tuning (#3812) 2026-02-05 06:03:25 -08:00
granite.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
llama.py fix: multi-GPU inference crash for bnb 4-bit/8-bit models (#5068) 2026-04-16 11:35:02 -07:00
llama4.py Qwen 3 2025-05-02 03:09:44 -07:00
loader.py Restrict flash attn to <=256 head dim. Consolidate attn impl checks (#5051) 2026-04-16 09:00:17 -05:00
loader_utils.py studio: reuse HF cached repo casing to prevent duplicate downloads (#4822) 2026-04-03 05:48:24 -07:00
mapper.py Re-apply #4939: updated models template mappers (#4950) 2026-04-15 07:52:12 -07:00
mistral.py Fix Mistral DPO/preference training crash on non-xformers platforms (e.g. Intel XPU) (#4889) 2026-04-09 04:38:44 -07:00
qwen2.py Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks" 2025-12-01 07:24:58 -08:00
qwen3.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
qwen3_moe.py Fix correctness bugs across multiple model files (#3813) 2026-01-01 02:36:33 -08:00
rl.py Gate trl disable_gradient_checkpointing patch warning on UNSLOTH_ENABLE_LOGGING (#5038) 2026-04-15 07:33:48 -07:00
rl_replacements.py CI(consolidated): strict mode -- drop continue-on-error, tighten ledger 2026-05-07 07:15:41 +00:00
sentence_transformer.py Fix FastSentenceTransformer loading with newer sentence-transformers (#5259) 2026-05-05 04:15:54 -07:00
vision.py fix: multi-GPU inference crash for bnb 4-bit/8-bit models (#5068) 2026-04-16 11:35:02 -07:00