unsloth/studio/backend/core/inference
Roland Tannous 43a633e550 feat: boot llama-server with --parallel 4 by default
Raise the default parallel slot count so Studio chat and the external API
endpoint can run concurrently without a subprocess restart. Enable/disable
of the Access Endpoint is now instant — it only mints or clears the API
key, since the parallel slots are already in place from the initial load.
2026-04-09 14:56:01 +00:00
..
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
_html_to_md.py fix: studio web search SSL failures and empty page content (#4754) 2026-04-01 06:12:02 -07:00
audio_codecs.py studio: per-model inference defaults, GGUF slider fix, reasoning toggle (#4325) 2026-03-16 06:37:55 -07:00
defaults.py UI Changes (#4782) 2026-04-02 08:05:55 -07:00
inference.py [studio] multi gpu: revert to balanced for inference. (#4698) 2026-03-31 01:24:41 -07:00
llama_cpp.py feat: boot llama-server with --parallel 4 by default 2026-04-09 14:56:01 +00:00
orchestrator.py fix(studio): prioritize curated defaults over HF download ranking in Recommended (#4792) 2026-04-02 10:46:53 -07:00
tools.py fix(studio): harden sandbox security for terminal and python tools (#4827) 2026-04-03 13:33:42 -07:00
worker.py split venv_t5 into tiered 5.3.0/5.5.0 and fix trust_remote_code (#4878) 2026-04-07 20:05:01 +04:00