Daniel Han
d020b5008f
Merge branch 'main' into nightly
2025-08-02 03:35:03 -07:00
dongbin-lunark
4c4edba26f
docs: Add WSL installation guide for xformers ( #3079 )
2025-08-02 03:32:47 -07:00
DoubleMathew
b20d1e2a70
get_per_token_logps_and_entropies: return tuple instead of dict ( #3080 )
2025-08-02 03:31:41 -07:00
Datta Nimmaturi
7d040c4b9d
fixup rope sync for everything ( #3061 )
2025-08-02 03:30:34 -07:00
Daniel Han
a44c59e9d5
Merge branch 'main' into nightly
2025-07-29 03:07:00 -07:00
Daniel Han
5266ead104
Update _utils.py
2025-07-29 02:19:43 -07:00
Daniel Han
2b40d9cd1c
Update rl_replacements.py
2025-07-29 01:59:08 -07:00
Daniel Han
50b2235919
Update rl.py
2025-07-29 01:32:39 -07:00
Daniel Han
93141e14ca
Update pyproject.toml
2025-07-29 01:03:19 -07:00
Daniel Han
4fc2063029
Merge branch 'main' of https://github.com/unslothai/unsloth
2025-07-29 00:43:52 -07:00
Daniel Han
76febc7197
Merge branch 'pr/3055'
2025-07-29 00:43:19 -07:00
Etherll
72579e5d67
Add gemma-3n chat template to chat_templates.py ( #3051 )
...
* Update chat_templates.py
* Update chat_templates.py
2025-07-29 00:39:38 -07:00
Daniel Han
bfa744f0a0
Merge branch 'pr/3052'
2025-07-29 00:38:50 -07:00
Daniel Han
e282e27e2b
Fix TRL 0.20.0
2025-07-29 00:36:25 -07:00
Daniel Han
0b136d4d87
Merge branch 'main' of https://github.com/unslothai/unsloth
2025-07-29 00:35:41 -07:00
Sekinal
6c0c50a04e
Fixed wrong syntax in f-string for exception
2025-07-28 23:16:05 -06:00
Sekinal
38faa5fdfe
Fix: Added specific check for Gemma so models like BERT properly initialize
2025-07-28 22:47:58 -06:00
Etherll
936719df8b
Update loader.py
2025-07-28 22:15:23 +03:00
Etherll
11fd23b26f
Update _utils.py
2025-07-28 21:48:36 +03:00
Etherll
3003725367
Update vision.py
2025-07-28 20:55:07 +03:00
Etherll
d7007d0cb5
Update loader.py
2025-07-28 20:53:38 +03:00
Daniel Han
dad5dec327
Update _utils.py
2025-07-28 08:28:18 -07:00
Datta Nimmaturi
00af713a3d
Fixup multi GPU workload. ( #3049 )
...
* sync all instead
* sync after move and rope init instead
* sync after rope inside
* Return new tensors and no sync
* Sync only current stream
* Fixup mask for xformers
* sync for prefill only
* clean up
2025-07-28 03:04:49 -07:00
Daniel Han
15f320aaad
Merge branch 'main' into nightly
2025-07-24 23:40:23 -07:00
Edd
e6d0877695
Fix Llama and Gemma inference ( #3034 )
...
* Fix Llama and Gemma inference
* Add simple quality life for CUDA link error (which is not captured since we bypass all error)
2025-07-24 23:38:20 -07:00
Daniel Han
07929997bc
Merge branch 'main' into nightly
2025-07-23 06:08:35 -07:00
Daniel Han
001729e962
Update _utils.py
2025-07-23 06:08:31 -07:00
Daniel Han
7f5efd0de1
Merge branch 'main' into nightly
2025-07-23 06:04:39 -07:00
Daniel Han
c9817af0f0
Update pyproject.toml
2025-07-23 06:04:35 -07:00
Daniel Han
18b87543e6
Merge branch 'main' into nightly
2025-07-23 05:53:09 -07:00
Daniel Han
74b255b5e6
Fix torch compile issues ( #3028 )
...
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Small fixes
* Update vision.py
* Update vision.py
* versioning
* Update __init__.py
* Update llama.py
* Update rl.py
* Update rl.py
* Update _utils.py
* Update vision.py
* Update vision.py
* compiler stance
* Update _utils.py
* Update pyproject.toml
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Revert "Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model me…" (#2990 )
This reverts commit 204fc46e19
2025-07-23 05:52:28 -07:00
Daniel Han
d2ffc89dc7
Fix set_stance
2025-07-23 05:19:08 -07:00
Daniel Han
6f40f252e0
Update gemma2.py
2025-07-23 03:27:52 -07:00
Daniel Han
24c63dcd9b
Update rope_embedding.py
2025-07-23 03:26:16 -07:00
Daniel Han
d425883e3a
Cleanup
2025-07-23 03:23:23 -07:00
Daniel Han
8b46eefc92
check stride
2025-07-23 02:52:29 -07:00
Daniel Han
946f08f443
Merge branch 'main' into nightly
2025-07-23 02:51:00 -07:00
DoubleMathew
3547416e16
falcon force float32 on sm<75 machines ( #3026 )
2025-07-22 13:18:42 -07:00
Daniel Han
cfea95e051
Fix Gemma 2 ( #3024 )
...
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Small fixes
* Update vision.py
* Update vision.py
* versioning
* Update __init__.py
* Update llama.py
* Update rl.py
* Update rl.py
* Update _utils.py
* Update vision.py
* Update vision.py
* compiler stance
* Update _utils.py
* Update pyproject.toml
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Revert "Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model me…" (#2990 )
This reverts commit 204fc46e19
2025-07-22 04:43:43 -07:00
Daniel Han
292007a02d
Update _utils.py
2025-07-22 04:42:51 -07:00
Daniel Han
183d53aa77
Update _utils.py
2025-07-22 04:42:06 -07:00
Daniel Han
b41d409f9c
Update _utils.py
2025-07-22 04:39:04 -07:00
Daniel Han
51f05eac72
Merge branch 'main' into nightly
2025-07-22 03:34:55 -07:00
Daniel Han
0477c5804e
Update llama.py
2025-07-22 03:34:51 -07:00
Lei Zhenyuan
a2d41ea66a
[intel] add for intel path for llama.py ( #3012 )
...
* fix for intel path
* remove unuse code
* Update unsloth/models/llama.py
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-07-22 03:33:26 -07:00
Lei Zhenyuan
a44149b328
fix for casual mask ( #3011 )
2025-07-22 03:27:57 -07:00
Daniel Han
015eb60694
Merge branch 'main' into nightly
2025-07-21 05:35:09 -07:00
Daniel Han
6e495eb15d
Bug fixes ( #3017 )
...
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update pyproject.toml
* Delete .gitignore
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update _utils.py
* Update pyproject.toml
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update synthetic.py
* Update chat_templates.py
* Seasame force float16 / float32
* Fix Seasame
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* is_multimodal
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update vision.py
* Update vision.py
* Update vision.py
* UNSLOTH_DISABLE_STATIC_GENERATION
* Update vision.py
* Auto vision detection
* Sesame
* Whisper
* Update loader.py
* Update loader.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update vision.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update loader.py
* Update _utils.py
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* Update rl.py
* logging
* Update pyproject.toml
* Update rl.py
* versioning
* Update rl.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* logits / temperature
* Update rl_replacements.py
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Debugging only
* Update llama.py
* Update llama.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Generic efficient GRPO
* Update rl_replacements.py
* Update rl_replacements.py
* Remove debugging
* Update rl_replacements.py
* Update rl_replacements.py
* Update vision.py
* Update llama.py
* Update rl_replacements.py
* versioning
* Update _utils.py
* Update vision.py
* Update mapper.py
* Update loader.py
* Update mapper.py
* Update vision.py
* Update loader.py
* Update vision.py
* Update loader.py
* Update _utils.py
* Update vision.py
* gradient checkpointing
* Gemma 3N fixes
* Update loader.py
* Versioning
* Gemma 3N fixes
* Update vision.py
* Update vision.py
* Update loader.py
* Update vision.py
* Fix setup.py
* setup.py
* Prints
* Update setup.py
* Update setup.py
* Update setup.py
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update pyproject.toml
* Update vision.py
* Update vision.py
* Update pyproject.toml
* Update vision.py
* Update _utils.py
* Update __init__.py
* Update __init__.py
* Small fixes
* Update vision.py
* Update vision.py
* versioning
* Update __init__.py
* Update llama.py
* Update rl.py
* Update rl.py
* Update _utils.py
* Update vision.py
* Update vision.py
* compiler stance
* Update _utils.py
* Update pyproject.toml
* Update pyproject.toml
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Update rl_replacements.py
* Revert "Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model me…" (#2990 )
This reverts commit 204fc46e19
2025-07-21 05:30:14 -07:00
Daniel Han
369c2b4e54
versioning
2025-07-21 05:15:48 -07:00
Daniel Han
194d237b99
Fix quantization_method
2025-07-21 05:14:17 -07:00
