unsloth/studio/backend
Roland Tannous c6bd55ec61
fix(llm_assist): disable thinking mode for helper model JSON output (#4358)
* fix(llm_assist): disable thinking mode for helper model JSON output

Pass enable_thinking=False to generate_chat_completion() in both
_run_with_helper() and _generate_with_backend() so the Qwen3.5-4B
helper model produces clean JSON instead of wrapping responses in
<think> tags.

* fix(llm_assist): log per-request enable_thinking=False override

Add info-level log lines so the user can see that each helper/advisor
request overrides the server-level thinking default to False.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2026-03-17 15:58:08 +04:00
..
assets studio: web search, KV cache dtype, training progress, inference fixes 2026-03-17 00:30:01 -07:00
auth fix: remove old comments (#4292) 2026-03-14 16:50:13 +04:00
core fix: comment out debug print statements (#4357) 2026-03-17 15:43:27 +04:00
loggers Final cleanup 2026-03-12 18:28:04 +00:00
models studio: web search, KV cache dtype, training progress, inference fixes 2026-03-17 00:30:01 -07:00
plugins Final cleanup 2026-03-12 18:28:04 +00:00
requirements studio: web search, KV cache dtype, training progress, inference fixes 2026-03-17 00:30:01 -07:00
routes studio: fix stale GGUF metadata, update helper model, auth improvements (#4346) 2026-03-17 01:22:08 -07:00
state Final cleanup 2026-03-12 18:28:04 +00:00
tests fix(seed): disable remote code execution in seed inspect dataset loads (#4275) 2026-03-13 19:37:43 +04:00
utils fix(llm_assist): disable thinking mode for helper model JSON output (#4358) 2026-03-17 15:58:08 +04:00
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
colab.py Fix/colab comment edits (#4317) 2026-03-16 16:15:46 -07:00
main.py studio: web search, KV cache dtype, training progress, inference fixes 2026-03-17 00:30:01 -07:00
run.py fix: Ctrl+C not terminating backend on Linux (#4316) 2026-03-16 11:58:09 +04:00