unsloth/studio/backend/core/inference
Daniel Han 34cdbf42bf studio: training progress visibility + deferred llama.cpp compilation
Training progress:
- Show row counts in status messages: "Loaded dataset from HuggingFace:
  Open-Orca/OpenOrca (4,233,923 rows)" instead of just the dataset name
- Emit "Formatting dataset (N rows)..." and "Applying chat template
  (N rows)..." status updates so users see progress during the
  preprocessing stages that previously appeared stuck

Deferred llama.cpp compilation:
- Add LlamaCppBuilder that runs cmake build in a background thread
  at server startup if the llama-server binary is missing
- Studio starts immediately and is usable for training/non-GGUF tasks
  while llama.cpp compiles in the background
- GGUF model loads wait for the build to finish with a helpful message
- Add /api/inference/llama-cpp-status endpoint for build status
- Frontend shows "Waiting for llama.cpp to compile..." toast when
  loading a GGUF while build is in progress
2026-03-16 14:02:20 +00:00
..
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
audio_codecs.py studio: per-model inference defaults, GGUF slider fix, reasoning toggle (#4325) 2026-03-16 06:37:55 -07:00
defaults.py chat only with gguf for mac devices (#4300) 2026-03-15 23:20:48 +04:00
inference.py studio: per-model inference defaults, GGUF slider fix, reasoning toggle (#4325) 2026-03-16 06:37:55 -07:00
llama_cpp.py studio: per-model inference defaults, GGUF slider fix, reasoning toggle (#4325) 2026-03-16 06:37:55 -07:00
llama_cpp_builder.py studio: training progress visibility + deferred llama.cpp compilation 2026-03-16 14:02:20 +00:00
orchestrator.py [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-03-16 02:46:56 -07:00
worker.py Set repetition_penalty default to 1.0 (disabled) everywhere 2026-03-16 02:46:56 -07:00