unsloth/studio/backend
Daniel Han c59f028150 studio: kill orphaned llama-server processes on startup
When the studio process is killed (SIGTERM/SIGKILL), atexit handlers
may not run in the subprocess orchestrator, leaving llama-server
processes orphaned and holding GPU memory. This caused OOM errors when
trying to load a new model after a studio restart.

On init, LlamaCppBackend now runs pgrep to find and SIGKILL any stale
llama-server processes before starting fresh.
2026-03-15 05:24:06 -07:00
..
assets Final cleanup 2026-03-12 18:28:04 +00:00
auth fix: remove old comments (#4292) 2026-03-14 16:50:13 +04:00
core studio: kill orphaned llama-server processes on startup 2026-03-15 05:24:06 -07:00
loggers Final cleanup 2026-03-12 18:28:04 +00:00
models studio: don't cap max_tokens for GGUF inference 2026-03-15 05:24:06 -07:00
plugins Final cleanup 2026-03-12 18:28:04 +00:00
requirements fix: remove old comments (#4292) 2026-03-14 16:50:13 +04:00
routes studio: don't cap max_tokens for GGUF inference 2026-03-15 05:24:06 -07:00
state Final cleanup 2026-03-12 18:28:04 +00:00
tests fix(seed): disable remote code execution in seed inspect dataset loads (#4275) 2026-03-13 19:37:43 +04:00
utils studio: sort GGUF dropdown client-side -- recommended first, OOM last, rest by size descending 2026-03-15 05:24:06 -07:00
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
colab.py Final cleanup 2026-03-12 18:28:04 +00:00
main.py [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-03-15 05:24:06 -07:00
run.py studio: auto-find free port if requested port is in use 2026-03-15 05:24:06 -07:00