Daniel Han
590bd55179
Update rl_replacements.py
2025-06-22 03:44:56 -07:00
Daniel Han
794682fc4e
Update rl_replacements.py
2025-06-22 03:39:30 -07:00
Daniel Han
ee992699f4
Update rl.py
2025-06-22 03:29:20 -07:00
Daniel Han
baf8ff478f
Update rl_replacements.py
2025-06-22 02:55:00 -07:00
Daniel Han
4ab232d111
Update rl_replacements.py
2025-06-22 02:37:52 -07:00
Daniel Han
b81018c3bb
Merge branch 'main' into nightly
2025-06-22 02:37:11 -07:00
Daniel Han
8767244b6e
Update rl.py
2025-06-21 23:29:08 -07:00
Daniel Han
41421bfb52
Fix bf16 = None
2025-06-21 22:50:29 -07:00
Daniel Han
798530797b
Update rl.py
2025-06-21 22:26:46 -07:00
Daniel Han
166f536542
Merge branch 'main' into nightly
2025-06-21 22:21:10 -07:00
Daniel Han
e82cc4ba8a
Update _utils.py
2025-06-21 22:20:46 -07:00
Daniel Han
02d7b01b37
Update rl_replacements.py
2025-06-21 22:20:32 -07:00
Daniel Han
d8a29af1cb
Fix DAPO, TRL 0.19.0
2025-06-21 22:14:21 -07:00
simpissa
8242205636
Fix for grpo_compute_loss_slow ( #2702 )
...
* slice last logit
* move slicing
2025-06-21 21:58:06 -07:00
Daniel Han
5b9f59600e
Mistral Small 3.2
2025-06-21 06:44:14 -07:00
amrothemich
9a4ca12b70
Update pyproject.toml ( #2778 )
...
Switched pyproject license to dictionary type
2025-06-21 02:44:24 -07:00
Michael Han
db8185dd11
Merge pull request #2780 from rolandtannous/fix/gemma3-grpo-self-llm
...
Fix AttributeError in GRPO trainer for models without llm attribute
2025-06-20 21:15:54 -07:00
Roland Tannous
88b2a9c8e7
Fix Gemma3ForCausalLm does not have attribute self.llm
2025-06-21 01:07:32 +00:00
Roland Tannous
8a718020a8
Additional tests for unsloth-zoo PR#174
2025-06-21 00:22:00 +00:00
Daniel Han
46795df0d4
Merge branch 'main' of https://github.com/unslothai/unsloth
2025-06-20 06:30:43 -07:00
Daniel Han
f30ca61d67
Update pyproject.toml
2025-06-20 06:30:35 -07:00
marcandrelarochelle
b832e562c8
Fix TRL 1.8.2 ( #2774 )
...
* Fix for TRL 1.8.2
Regex matching LLM initialization
* Update Regex
2025-06-20 06:28:58 -07:00
Daniel Han
1d98f5dc0b
Update __init__.py
2025-06-20 06:13:45 -07:00
Daniel Han
0b5aa9bbdd
Fix bugs
2025-06-20 06:09:03 -07:00
Datta Nimmaturi
37e577a913
Enable vLLM to share memory space ( #2712 )
...
* vLLM sleep once generation is done
* Make enable_sleep_model configurable
* Make default to false
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
* Force standby under environment variable
---------
Signed-off-by: datta0 <venkatadattasainimmaturi@gmail.com>
2025-06-19 04:04:14 -07:00
Edd
397bb72146
Fix renaming on other model than Llama ( #2762 )
2025-06-18 13:38:36 -07:00
leopardracer
9d984899e0
Fix Typos in Documentation and Comments ( #2721 )
...
* Update ocr_eval.md
* Update backward.py
2025-06-17 04:34:51 -07:00
pluesclues
ca839d8bc8
Reward modeling update (There seems to be another patch) ( #2710 )
...
* Update llama.py, sequence_classifcaiton update
* Update llama.py, adapting to original commit
* Update llama.py, for seqeuence classifcation update
* Update llama.py, added transformer import
* Update llama.py, dealt with output weight
* Update llama.py, renamed it peft model fast forward
* Update llama.py, set up is classification varaiable
* Update llama.py, updated lora dict to initialize sequence classification object
* Update llama.py, gets model name correctly before Lora dict is initialized
* Update llama.py, Task_type_SEQ_CLS doesnt work but it does work with Task_type.CAUSAL_LM
2025-06-17 04:33:45 -07:00
Michael Han
3d49ad5776
Update issue templates
...
Adding Reddit link
2025-06-12 01:23:36 -07:00
Roland Tannous
89668784e5
tests for additional merge fix unsloth zoo pr 163 ( #2719 )
...
* tests for additional merge fix unsloth zoo pr 163
* fixed load_dataset indent in mistral perplexity test file
2025-06-11 14:08:41 -07:00
Daniel Han
3915e73cb5
Versioning
2025-06-10 06:51:07 -07:00
user799595
07b9490cd0
Making protobuf version more flexible ( #2637 )
...
* Making protobuf version more flexible
* Update pyproject.toml
* Update pyproject.toml
---------
Co-authored-by: Daniel Han <danielhanchen@gmail.com>
2025-06-10 04:13:25 -07:00
Daniel Han
3e12cbd8c2
Update pyproject.toml
2025-06-10 04:04:25 -07:00
Lei Zhenyuan
07d1feef9e
add support for torch270 ( #2709 )
2025-06-10 03:59:15 -07:00
Daniel Han
c688bddb88
Merge branch 'main' into nightly
2025-06-06 05:55:46 -07:00
Daniel Han
c1b73fa883
versioning
2025-06-06 05:46:49 -07:00
Salpingopharyngeus
8c432a9d52
Ignore None to Subprocess_Commands ( #2680 )
...
Ignores none params when building the subprocess_command for vllm. As none values stop vllm from deploying properly, as --quantize will be passed with none if quantization type isn't specified in the model name.
2025-06-05 01:25:12 -07:00
DoubleMathew
6ebef501f9
Update prepare 4d causal attention call ( #2678 )
2025-06-04 12:58:50 -07:00
Daniel Han
3340eaa41c
Update rl.py
2025-06-03 00:07:52 -07:00
DoubleMathew
0c21999fdd
patch sft_trainer to favor max_seq_length over max_length in config ( #2669 )
2025-06-03 00:06:44 -07:00
DoubleMathew
1a1b51c834
unsloth checkpointing fix for latest transformers==4.52.x ( #2674 )
2025-06-03 00:06:06 -07:00
Roland Tannous
c6b62083fe
reroute merge logic language models + comprehensive tests + eval kits ( #2673 )
2025-06-02 20:32:57 -07:00
Daniel Han
ac82936a43
Merge branch 'main' into nightly
2025-06-02 18:58:24 -07:00
RunFMe
45f26cda99
Fix batched generation for prompts of different lengths ( #2216 )
...
* fix ignoring of attention mask after prefill stage in decoding
* update naming to avoid confusion
---------
Co-authored-by: Неизвестный Пользователь722497 <dolegosmirnov@sberbank.ru>
2025-06-02 03:59:10 -07:00
Michael Han
c5a2a36e47
Merge pull request #2662 from Datta0/model_param_fix
...
Fix quant model param fetch regex
2025-06-01 04:19:12 -07:00
datta0
46b722842b
Make replacement logic conscise
2025-06-01 05:57:43 +00:00
Michael Han
a0362f793c
Update issue templates
2025-05-31 14:38:55 -07:00
datta0
0b02cc23bc
Fix quant model param fetch regex
2025-05-31 18:52:46 +00:00
Daniel Han
beef0cbcb6
DeepSeek R1 Qwen
2025-05-30 01:38:53 -07:00
Daniel Han
8e36979719
Merge branch 'main' into nightly
2025-05-29 09:59:48 -07:00
