Daniel Han
d36abd3b71
Update rl_replacements.py
2025-06-22 03:44:56 -07:00
Daniel Han
7837f6f40c
Update rl_replacements.py
2025-06-22 03:39:30 -07:00
Daniel Han
9b612677f9
Update rl.py
2025-06-22 03:29:20 -07:00
Daniel Han
c465cf2fd2
Update rl_replacements.py
2025-06-22 02:55:00 -07:00
Daniel Han
0815525b15
Update rl_replacements.py
2025-06-22 02:37:52 -07:00
Daniel Han
0012c8906c
Merge branch 'main' into nightly
2025-06-22 02:37:11 -07:00
Daniel Han
c7c6f2c88d
Update rl.py
2025-06-21 23:29:08 -07:00
Daniel Han
d9be145849
Fix bf16 = None
2025-06-21 22:50:29 -07:00
Daniel Han
2f2930ee50
Update rl.py
2025-06-21 22:26:46 -07:00
Daniel Han
6af83b76b0
Merge branch 'main' into nightly
2025-06-21 22:21:10 -07:00
Daniel Han
05867537c1
Update _utils.py
2025-06-21 22:20:46 -07:00
Daniel Han
d71dfb1d01
Update rl_replacements.py
2025-06-21 22:20:32 -07:00
Daniel Han
3461b987fd
Fix DAPO, TRL 0.19.0
2025-06-21 22:14:21 -07:00
simpissa
8a202d6175
Fix for grpo_compute_loss_slow ( #2702 )
...
* slice last logit
* move slicing
2025-06-21 21:58:06 -07:00
Daniel Han
447ce0fb4f
Mistral Small 3.2
2025-06-21 06:44:14 -07:00
amrothemich
ca150bb27a
Update pyproject.toml ( #2778 )
...
Switched pyproject license to dictionary type
2025-06-21 02:44:24 -07:00
Michael Han
2a200e739a
Merge pull request #2780 from rolandtannous/fix/gemma3-grpo-self-llm
...
Fix AttributeError in GRPO trainer for models without llm attribute
2025-06-20 21:15:54 -07:00
Roland Tannous
8c563abb87
Fix Gemma3ForCausalLm does not have attribute self.llm
2025-06-21 01:07:32 +00:00
Roland Tannous
061f038ec7
Additional tests for unsloth-zoo PR#174
2025-06-21 00:22:00 +00:00
Daniel Han
1be2a6e90a
Merge branch 'main' of https://github.com/unslothai/unsloth
2025-06-20 06:30:43 -07:00
Daniel Han
d8846ebdfd
Update pyproject.toml
2025-06-20 06:30:35 -07:00
marcandrelarochelle
481292a96a
Fix TRL 1.8.2 ( #2774 )
...
* Fix for TRL 1.8.2
Regex matching LLM initialization
* Update Regex
2025-06-20 06:28:58 -07:00
Daniel Han
e43babe76f
Update __init__.py
2025-06-20 06:13:45 -07:00
Daniel Han
2e9724f279
Fix bugs
2025-06-20 06:09:03 -07:00
Datta Nimmaturi
b87ff3f528
Enable vLLM to share memory space ( #2712 )
...
* vLLM sleep once generation is done
* Make enable_sleep_model configurable
* Make default to false
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
* Force standby under environment variable
---------
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
2025-06-19 04:04:14 -07:00
Edd
a398484d0a
Fix renaming on other model than Llama ( #2762 )
2025-06-18 13:38:36 -07:00
leopardracer
c6e0366e0d
Fix Typos in Documentation and Comments ( #2721 )
...
* Update ocr_eval.md
* Update backward.py
2025-06-17 04:34:51 -07:00
pluesclues
440bbf5b52
Reward modeling update (There seems to be another patch) ( #2710 )
...
* Update llama.py, sequence_classifcaiton update
* Update llama.py, adapting to original commit
* Update llama.py, for seqeuence classifcation update
* Update llama.py, added transformer import
* Update llama.py, dealt with output weight
* Update llama.py, renamed it peft model fast forward
* Update llama.py, set up is classification varaiable
* Update llama.py, updated lora dict to initialize sequence classification object
* Update llama.py, gets model name correctly before Lora dict is initialized
* Update llama.py, Task_type_SEQ_CLS doesnt work but it does work with Task_type.CAUSAL_LM
2025-06-17 04:33:45 -07:00
Michael Han
ee76be7d58
Update issue templates
...
Adding Reddit link
2025-06-12 01:23:36 -07:00
Roland Tannous
efe2cc43a7
tests for additional merge fix unsloth zoo pr 163 ( #2719 )
...
* tests for additional merge fix unsloth zoo pr 163
* fixed load_dataset indent in mistral perplexity test file
2025-06-11 14:08:41 -07:00
Daniel Han
d535bf067e
Versioning
2025-06-10 06:51:07 -07:00
user799595
19399e09f9
Making protobuf version more flexible ( #2637 )
...
* Making protobuf version more flexible
* Update pyproject.toml
* Update pyproject.toml
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-06-10 04:13:25 -07:00
Daniel Han
af47cfb9a3
Update pyproject.toml
2025-06-10 04:04:25 -07:00
Lei Zhenyuan
fc78af6d76
add support for torch270 ( #2709 )
2025-06-10 03:59:15 -07:00
Daniel Han
0ab4544d37
Merge branch 'main' into nightly
2025-06-06 05:55:46 -07:00
Daniel Han
16af0ceb8e
versioning
2025-06-06 05:46:49 -07:00
Salpingopharyngeus
0012b13573
Ignore None to Subprocess_Commands ( #2680 )
...
Ignores none params when building the subprocess_command for vllm. As none values stop vllm from deploying properly, as --quantize will be passed with none if quantization type isn't specified in the model name.
2025-06-05 01:25:12 -07:00
DoubleMathew
aa50ef2862
Update prepare 4d causal attention call ( #2678 )
2025-06-04 12:58:50 -07:00
Daniel Han
8f465e21c5
Update rl.py
2025-06-03 00:07:52 -07:00
DoubleMathew
9bf691061d
patch sft_trainer to favor max_seq_length over max_length in config ( #2669 )
2025-06-03 00:06:44 -07:00
DoubleMathew
90a4aacbf8
unsloth checkpointing fix for latest transformers==4.52.x ( #2674 )
2025-06-03 00:06:06 -07:00
Roland Tannous
58f3a6e29d
reroute merge logic language models + comprehensive tests + eval kits ( #2673 )
2025-06-02 20:32:57 -07:00
Daniel Han
a58fec36a5
Merge branch 'main' into nightly
2025-06-02 18:58:24 -07:00
RunFMe
332eabf309
Fix batched generation for prompts of different lengths ( #2216 )
...
* fix ignoring of attention mask after prefill stage in decoding
* update naming to avoid confusion
---------
Co-authored-by: Неизвестный Пользователь722497 <dolegosmirnov@sberbank.ru>
2025-06-02 03:59:10 -07:00
Michael Han
e76172c638
Merge pull request #2662 from Datta0/model_param_fix
...
Fix quant model param fetch regex
2025-06-01 04:19:12 -07:00
datta0
e8d6ede1fd
Make replacement logic conscise
2025-06-01 05:57:43 +00:00
Michael Han
45a32bc599
Update issue templates
2025-05-31 14:38:55 -07:00
datta0
f2a8a437b4
Fix quant model param fetch regex
2025-05-31 18:52:46 +00:00
Daniel Han
03965930e7
DeepSeek R1 Qwen
2025-05-30 01:38:53 -07:00
Daniel Han
125e9f5f84
Merge branch 'main' into nightly
2025-05-29 09:59:48 -07:00
