ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
unsloth/studio/backend/routes
History
Exact
Daniel Han 9e2fc49851
 Studio: free the llama-server slot when a chat stream reaches [DONE] (#7564) 
* Studio: free the llama-server slot when a chat stream reaches [DONE]

* Release the slot before yielding, only on a completed decode

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Tighten the comments added by this PR

* Inline the done-sentinel check and use plain bools for the decode flags

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2026-07-28 18:34:00 -07:00
..
data_recipe Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
.gitkeep root studio folder 2026-02-02 09:13:49 +00:00
__init__.py Studio: add Deep Research (#7219) 2026-07-26 23:36:02 -07:00
auth.py Studio: reject whitespace-only passwords (#7341) 2026-07-23 00:44:37 -07:00
chat_history.py feat(studio): adjustable llama-server parallel slots from the web UI (#7447) 2026-07-28 18:03:28 -07:00
datasets.py Studio: add configurable model download location (#7274) 2026-07-23 01:34:38 -07:00
export.py Studio: offer the latest transformers release for brand-new architectures (#7056) 2026-07-15 05:25:26 -07:00
inference.py Studio: free the llama-server slot when a chat stream reaches [DONE] (#7564) 2026-07-28 18:34:00 -07:00
llama.py Studio: add local speech-to-text dictation engine (#7095) 2026-07-23 01:39:03 -07:00
mcp_servers.py Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
models.py Let a decode failure degrade instead of escaping a fail-closed helper (#7487) 2026-07-27 03:26:08 -07:00
preview.py Studio: opt-in OpenAI /v1 model auto-switch and idle keep-warm (#6392) 2026-07-01 06:42:23 -07:00
prompts.py Studio: clean-room compact RAG (knowledge bases, hybrid search, fast indexing) (#5910) 2026-06-09 21:17:04 -07:00
providers.py fix(studio): persist connection model selections for remote clients (#7298) 2026-07-23 19:11:50 -07:00
rag.py Add drag and drop sources to the create project dialog (#7441) 2026-07-25 23:54:48 -07:00
research_runs.py Studio: add Deep Research (#7219) 2026-07-26 23:36:02 -07:00
settings.py Studio: fix the "No model loaded" error, and optionally auto-download a model named in an API request (#7454) 2026-07-27 05:02:06 -07:00
training.py feat(studio): add DoRA support to studio (#7315) 2026-07-24 03:24:16 -07:00
training_history.py Studio: require signed capability tokens for /p preview links (#6666) 2026-06-25 21:40:48 -07:00
training_vram.py Add Intel XPU support to Unsloth Studio (#4724) 2026-07-24 02:22:07 -03:00
whisper.py Studio: add local speech-to-text dictation engine (#7095) 2026-07-23 01:39:03 -07:00