Daniel Han
19d36655f7
Update rl_replacements.py
2025-06-22 05:32:38 -07:00
Daniel Han
5a16891484
logits / temperature
2025-06-22 04:54:18 -07:00
Daniel Han
f8484e7a19
Update rl_replacements.py
2025-06-22 03:44:56 -07:00
Daniel Han
56c17900ca
Update rl_replacements.py
2025-06-22 03:39:30 -07:00
Daniel Han
bc8af1191d
Update rl.py
2025-06-22 03:29:20 -07:00
Daniel Han
edb70686d3
Update rl_replacements.py
2025-06-22 02:55:00 -07:00
Daniel Han
3fa2f1436a
Update rl_replacements.py
2025-06-22 02:37:52 -07:00
Daniel Han
2cb0ebc47e
Merge branch 'main' into nightly
2025-06-22 02:37:11 -07:00
Daniel Han
c340fa3ac8
Update rl.py
2025-06-21 23:29:08 -07:00
Daniel Han
b8a990cfe4
Fix bf16 = None
2025-06-21 22:50:29 -07:00
Daniel Han
fc15642f52
Update rl.py
2025-06-21 22:26:46 -07:00
Daniel Han
8ba4f3f808
Merge branch 'main' into nightly
2025-06-21 22:21:10 -07:00
Daniel Han
016b4bff34
Update _utils.py
2025-06-21 22:20:46 -07:00
Daniel Han
d00ebe5fe6
Update rl_replacements.py
2025-06-21 22:20:32 -07:00
Daniel Han
8aa0a2dc37
Fix DAPO, TRL 0.19.0
2025-06-21 22:14:21 -07:00
simpissa
3e75f21086
Fix for grpo_compute_loss_slow ( #2702 )
...
* slice last logit
* move slicing
2025-06-21 21:58:06 -07:00
Daniel Han
a9b70d94e4
Mistral Small 3.2
2025-06-21 06:44:14 -07:00
amrothemich
dab00ef9a6
Update pyproject.toml ( #2778 )
...
Switched pyproject license to dictionary type
2025-06-21 02:44:24 -07:00
Michael Han
09ae01fa91
Merge pull request #2780 from rolandtannous/fix/gemma3-grpo-self-llm
...
Fix AttributeError in GRPO trainer for models without llm attribute
2025-06-20 21:15:54 -07:00
Roland Tannous
17563176d9
Fix Gemma3ForCausalLm does not have attribute self.llm
2025-06-21 01:07:32 +00:00
Roland Tannous
4a70f8e880
Additional tests for unsloth-zoo PR#174
2025-06-21 00:22:00 +00:00
Daniel Han
7e7510daf6
Merge branch 'main' of https://github.com/unslothai/unsloth
2025-06-20 06:30:43 -07:00
Daniel Han
9fbb88479c
Update pyproject.toml
2025-06-20 06:30:35 -07:00
marcandrelarochelle
35d37ea567
Fix TRL 1.8.2 ( #2774 )
...
* Fix for TRL 1.8.2
Regex matching LLM initialization
* Update Regex
2025-06-20 06:28:58 -07:00
Daniel Han
1c7a9f46dc
Update __init__.py
2025-06-20 06:13:45 -07:00
Daniel Han
a1e12d4243
Fix bugs
2025-06-20 06:09:03 -07:00
Datta Nimmaturi
83f20be8ad
Enable vLLM to share memory space ( #2712 )
...
* vLLM sleep once generation is done
* Make enable_sleep_model configurable
* Make default to false
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
* Force standby under environment variable
---------
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
2025-06-19 04:04:14 -07:00
Edd
3a7cf48532
Fix renaming on other model than Llama ( #2762 )
2025-06-18 13:38:36 -07:00
leopardracer
8a192b7d72
Fix Typos in Documentation and Comments ( #2721 )
...
* Update ocr_eval.md
* Update backward.py
2025-06-17 04:34:51 -07:00
pluesclues
0270b7166a
Reward modeling update (There seems to be another patch) ( #2710 )
...
* Update llama.py, sequence_classifcaiton update
* Update llama.py, adapting to original commit
* Update llama.py, for seqeuence classifcation update
* Update llama.py, added transformer import
* Update llama.py, dealt with output weight
* Update llama.py, renamed it peft model fast forward
* Update llama.py, set up is classification varaiable
* Update llama.py, updated lora dict to initialize sequence classification object
* Update llama.py, gets model name correctly before Lora dict is initialized
* Update llama.py, Task_type_SEQ_CLS doesnt work but it does work with Task_type.CAUSAL_LM
2025-06-17 04:33:45 -07:00
Michael Han
701692fcfa
Update issue templates
...
Adding Reddit link
2025-06-12 01:23:36 -07:00
Roland Tannous
d0287bc596
tests for additional merge fix unsloth zoo pr 163 ( #2719 )
...
* tests for additional merge fix unsloth zoo pr 163
* fixed load_dataset indent in mistral perplexity test file
2025-06-11 14:08:41 -07:00
Daniel Han
4573105fc8
Versioning
2025-06-10 06:51:07 -07:00
user799595
a497f8878b
Making protobuf version more flexible ( #2637 )
...
* Making protobuf version more flexible
* Update pyproject.toml
* Update pyproject.toml
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-06-10 04:13:25 -07:00
Daniel Han
737dc347d4
Update pyproject.toml
2025-06-10 04:04:25 -07:00
Lei Zhenyuan
14cab69d43
add support for torch270 ( #2709 )
2025-06-10 03:59:15 -07:00
Daniel Han
b92a5a8cfe
Merge branch 'main' into nightly
2025-06-06 05:55:46 -07:00
Daniel Han
d463db673d
versioning
2025-06-06 05:46:49 -07:00
Salpingopharyngeus
5cd191b520
Ignore None to Subprocess_Commands ( #2680 )
...
Ignores none params when building the subprocess_command for vllm. As none values stop vllm from deploying properly, as --quantize will be passed with none if quantization type isn't specified in the model name.
2025-06-05 01:25:12 -07:00
DoubleMathew
e160305b66
Update prepare 4d causal attention call ( #2678 )
2025-06-04 12:58:50 -07:00
Daniel Han
64e07fc306
Update rl.py
2025-06-03 00:07:52 -07:00
DoubleMathew
c1076ed540
patch sft_trainer to favor max_seq_length over max_length in config ( #2669 )
2025-06-03 00:06:44 -07:00
DoubleMathew
c33bb76972
unsloth checkpointing fix for latest transformers==4.52.x ( #2674 )
2025-06-03 00:06:06 -07:00
Roland Tannous
7677750b67
reroute merge logic language models + comprehensive tests + eval kits ( #2673 )
2025-06-02 20:32:57 -07:00
Daniel Han
cb71afe4a0
Merge branch 'main' into nightly
2025-06-02 18:58:24 -07:00
RunFMe
d80e8a5cd8
Fix batched generation for prompts of different lengths ( #2216 )
...
* fix ignoring of attention mask after prefill stage in decoding
* update naming to avoid confusion
---------
Co-authored-by: Неизвестный Пользователь722497 <dolegosmirnov@sberbank.ru>
2025-06-02 03:59:10 -07:00
Michael Han
cb07a3608b
Merge pull request #2662 from Datta0/model_param_fix
...
Fix quant model param fetch regex
2025-06-01 04:19:12 -07:00
datta0
e6b1a3703d
Make replacement logic conscise
2025-06-01 05:57:43 +00:00
Michael Han
0ff1996273
Update issue templates
2025-05-31 14:38:55 -07:00
datta0
fa98cee8f4
Fix quant model param fetch regex
2025-05-31 18:52:46 +00:00
