ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
unsloth/unsloth/models
History
Exact
DoubleMathew a4d4dfe4ac
 fix Gemma4 flash attn disable (#5045) 
* fix pass attn implementation

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2026-04-15 17:50:48 -05:00
..
__init__.py Revert "feat: Add Mixtral model support" 2026-03-13 22:38:49 -07:00
_utils.py fix Gemma4 flash attn disable (#5045) 2026-04-15 17:50:48 -05:00
cohere.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
dpo.py Formatting & bug fixes (#3563) 2025-11-07 06:00:22 -08:00
falcon_h1.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
gemma.py Fix/pr 3699 leftpad prefill main (#4100) 2026-02-25 07:21:04 -08:00
gemma2.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
glm4_moe.py [MoE] Improve moe kernels for unsloth fine tuning (#3812) 2026-02-05 06:03:25 -08:00
granite.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
llama.py Fix grad-accum accepts_loss_kwargs detection for vision wrappers (#5036) 2026-04-15 06:59:36 -07:00
llama4.py Qwen 3 2025-05-02 03:09:44 -07:00
loader.py feat: Add support for OLMo-3 model (#4678) 2026-04-15 07:39:11 -07:00
loader_utils.py studio: reuse HF cached repo casing to prevent duplicate downloads (#4822) 2026-04-03 05:48:24 -07:00
mapper.py Re-apply #4939: updated models template mappers (#4950) 2026-04-15 07:52:12 -07:00
mistral.py Fix Mistral DPO/preference training crash on non-xformers platforms (e.g. Intel XPU) (#4889) 2026-04-09 04:38:44 -07:00
qwen2.py Revert "[pre-commit.ci] auto fixes from pre-commit.com hooks" 2025-12-01 07:24:58 -08:00
qwen3.py Fix forward compatibility with transformers 5.x (#4752) 2026-04-01 06:04:03 -07:00
qwen3_moe.py Fix correctness bugs across multiple model files (#3813) 2026-01-01 02:36:33 -08:00
rl.py Gate trl disable_gradient_checkpointing patch warning on UNSLOTH_ENABLE_LOGGING (#5038) 2026-04-15 07:33:48 -07:00
rl_replacements.py fix (#4887) 2026-04-15 07:21:03 -07:00
sentence_transformer.py Fix EmbeddingGemma float16 NaN via FORCE_FLOAT32 for gemma3_text (#4014) 2026-02-10 01:40:13 -08:00
vision.py fix Gemma4 flash attn disable (#5045) 2026-04-15 17:50:48 -05:00