unsloth/studio/backend/core/inference
Roland Tannous 6d12a6b13b
Improve AI Assist: Update default model, model output parsing, logging, and dataset mapping UX (#4323)
* Strip <think> blocks from LLM assist model output

* Add debug logging for raw LLM assist output

* Quiet llama-server logs, use structlog in llm_assist

* Fix think-tag stripping when response is inside tags

* Remove debug logging of raw model output

* Clarify GGUF download logs: show cache hit vs actual download

* Clarify heuristic-detected mapping in UI text

* Default helper model to Qwen3-4B-Instruct-2507 UD-Q4_K_XL

* Remove package-lock.json from tracking, add to .gitignore

* Auto-open mapping dialog on Start Training for custom_heuristic format

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Use last think block when extracting inner content (review feedback)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2026-03-16 16:04:35 +04:00
..
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
audio_codecs.py Final cleanup 2026-03-12 18:28:04 +00:00
defaults.py chat only with gguf for mac devices (#4300) 2026-03-15 23:20:48 +04:00
inference.py Set repetition_penalty default to 1.0 (disabled) everywhere 2026-03-16 02:46:56 -07:00
llama_cpp.py Improve AI Assist: Update default model, model output parsing, logging, and dataset mapping UX (#4323) 2026-03-16 16:04:35 +04:00
orchestrator.py [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-03-16 02:46:56 -07:00
worker.py Set repetition_penalty default to 1.0 (disabled) everywhere 2026-03-16 02:46:56 -07:00