* Studio: add Voice settings tab (dictation, dictionary, read aloud) New Voice tab in Settings, placed just before About: - Dictation: microphone picker, browser STT engine, recognition language, and an inline mic test with a live transcript - Dictation dictionary: entries rewrite matching speech to their exact spelling and casing, applied in both dictation paths - Recent dictations: last 20 final transcripts with copy and clear, so text can be recovered if it lands in the wrong place - Read aloud: optional button on assistant responses with two engines, curated system voices (novelty and legacy voices filtered, quality ranked, capped at 20) or the TTS audio model loaded in Unsloth via /audio/generate (e.g. Orpheus), plus speed, pitch, volume and preview Settings persist in localStorage (unsloth_voice_settings) and are read at call time so changes apply without reloading the runtime. Adds en keys plus the tab label for ja, zh-CN and pt-BR. * Studio: drop the single option STT engine select, rename TTS option The STT engine dropdown only had one entry, so it added noise without giving a real choice. The engine row can come back once local STT models land. Also renames the TTS engine option Unsloth TTS model to Load TTS model to make the action clearer. * Studio: harden Voice settings against edge cases found in simulation Simulated the feature across Chromium, Firefox and WebKit plus node level unit runs and backend contract checks. Fixes from the findings: - Dictionary rewrite used a replacement string, so entries containing dollar patterns corrupted transcripts (A$$AP became A$AP, $& injected the match). Switched to the callback form of String.replace - Persisted voice settings now validate types on hydration: non string micDeviceId, dictationLanguage and ttsVoiceURI, and non boolean ttsEnabled fall back to defaults instead of flowing into the UI - Dictionary entries are trimmed, capped at 120 chars and re-sanitized on hydration - The Test dictation panel now falls back to the default microphone when the saved device is unplugged, matching the composer adapter Test coverage: 46 unit assertions (dictionary regex edge cases across unicode, word boundaries and injection, voice curation for simulated macOS, Windows and Linux voice inventories, corrupt storage merge), 13 backend contract checks against /audio/generate on an isolated instance, and 60 browser assertions across the three engines covering rendering, degradation without SpeechRecognition, curation in a real DOM, dictionary persistence with unicode and dollar entries, the no-model preview error path and corrupt localStorage recovery. * Studio: address Voice settings review feedback Verified each review comment before acting. Confirmed and fixed: - Editing a dictionary entry was broken in two ways: the store trimmed on every keystroke so spaces could not be typed, and clearing the field deleted the entry and unmounted the input mid edit. Updates now keep the raw value and a blur commit trims or removes the entry - The unplugged mic fallback checked instanceof DOMException, but a cross browser probe showed Firefox and WebKit throw OverconstrainedError objects that are not DOMExceptions, so the fallback never fired there. Matching on the error name now - When the browser ended a dictation test on its own (silence timeout), the mic stream stayed open. All recognition end paths now stop the tracks and save the transcript through a single finalize path - The studio TTS audio element now releases its WAV data URL as soon as playback ends, fails or is cancelled - Allow microphone now reports insecure contexts (no mediaDevices) accurately instead of claiming access was blocked - Voice tab copy moved into i18n keys per src/i18n/AGENTS.md, so locale overlays can translate it; en is the baseline and parity passes - unsloth_voice_settings added to the Reset all local preferences key list so voice preferences obey the reset - Non default microphones note that the system default is used when the browser speech engine cannot bind a specific device, since browsers without the start(track) overload ignore the argument silently Re-ran the full simulation set after the changes: 46 unit assertions, 13 backend contract checks and 60 browser assertions across Chromium, Firefox and WebKit all pass, plus a dedicated browser probe for the dictionary editing behavior. * Studio: use the chat mic icon in Voice settings for consistency The Voice tab and its buttons used the hugeicons Mic02 glyph while the chat composer uses a custom filled mic. Extract that composer icon into a shared lib/mic-icon component, drop the duplicate inline copies in thread.tsx and shared-composer.tsx, and use it for the Voice tab icon and the tab's mic buttons so the microphone looks the same everywhere. * Studio: address second round of Voice settings review feedback Verified each new comment against the current code first. One item was already fixed in the previous round (recording transcripts when the browser ends a dictation test on its own). Confirmed and fixed: - The microphone row showed a picker with generic names when browsers enumerate unlabeled devices before permission, leaving no way to grant access from the row. It now branches on whether labels are visible and shows Allow microphone otherwise - Compare chat dictation ignored the selected microphone. It now opens the chosen device with the same fallback rules as the main adapter, passes the track to recognition where supported and releases the stream when recognition ends - Closing the Voice tab cancelled the shared speechSynthesis even when read aloud was playing a chat message. Cleanup now only cancels when the tab owns an active preview - Double clicking Start test could race two recognizers and leak the first stream. A starting flag set before the getUserMedia await makes start reentrancy safe - Turning off the read aloud setting mid playback removed the only stop control. The stop button now renders whenever a message is speaking - When an engine lacks the start(track) overload, both dictation paths now release the selected device stream before retrying with the default microphone instead of holding it open - Read aloud support no longer requires Web Speech synthesis: the Unsloth TTS engine only needs audio playback, so it stays available in WebViews without speechSynthesis, with a clear error if the system engine is chosen there Not addressed here: cancelling in flight backend TTS generation on stop. The route runs generation in a worker thread without a cancellation path, which is shared pre existing behavior with audio chat generation and belongs in a backend change. All suites re-run green: 46 unit, 13 backend contract and 60 browser matrix assertions across Chromium, Firefox and WebKit, plus probes for the unlabeled device branch and the double click race. * Studio: drop empty and duplicate voiceURIs so the Voice tab never renders a crashing Select item * Studio: guard dictation mic lifecycle in Voice test and Compare composer Release a microphone opened after the component unmounts, and stop Compare dictation on a permission or security failure instead of silently recording from the default device, matching the main chat adapter. * Studio: fix dictation and read-aloud lifecycle edge cases in Voice settings - Join final dictation chunks with a space so recorded transcripts do not merge words - Ignore a stale recognizer onend so a quick stop then restart is not torn down - Use previewingRef so a double click on TTS preview does not orphan the first request - Keep the read-aloud stop control visible when a new run starts while a message is spoken - Stop the dictionary remove button from deleting an adjacent entry on a blur then click race * Studio: trim redundant Voice settings comments * Studio: fix Voice preview and Compare dictation edge cases - Only cancel the shared speechSynthesis for a system-voice preview, so stopping a Studio preview no longer stops an unrelated chat read-aloud - Release the Studio preview audio and its WAV data URL on normal completion - Iterate every finalized result in Compare dictation so batched phrases are kept - Cap persisted recent dictations to the last 20 on hydration * Studio: use clipboard fallback for recents and release failed preview audio - Copy recent dictations via the copyToClipboard helper so the execCommand fallback works in Safari and insecure http LAN contexts - Release the Studio preview audio when play() rejects, not just on ended/error * Studio: add local speech-to-text dictation engine Add an offline dictation engine that transcribes with a local faster-whisper model, alongside the existing browser (Web Speech) engine. The browser engine streams audio to Apple or Google speech services and needs internet; the new engine runs on the server, works offline, and drives any chat model without evicting it (it loads in the backend process, separate from the model subprocess). It also gives Firefox dictation, which has no Web Speech support. Backend: a lazily-loaded, kept-warm faster-whisper sidecar and three routes under /api/inference/audio (stt/status, stt/load, transcribe). faster-whisper is torch-free, so this does not disturb the existing model stack. Frontend: a Dictation engine setting (browser or local model), a curated model picker with sizes, and MediaRecorder capture posted to the transcribe route. The model warms automatically when the engine is selected, with live status. * Studio: stream local STT transcription as you speak Local dictation showed nothing until you stopped, because the whole clip was transcribed once on stop. Now the growing recording is re-transcribed on a fast pass every second and emitted as live interim text, with an accurate final pass on stop. Partial recordings decode fine, and the model refines earlier words as more audio arrives. Adds an interim flag to the transcribe route (beam 1, no VAD) for the fast preview pass; the final stop uses the accurate path. * Studio: make local dictation stop instant and reliable Stopping local dictation waited for a final network transcription before the session ended, so the stop button did not flip and a second click ended the session early and dropped the text. Now stop commits the live transcript immediately, releases the mic at once, and ignores a second stop while finalizing. Previews run more often so the committed text is current. * Studio: record local dictation in short clips for reliable streaming Re-transcribing a growing buffer every second got slower as it grew, flooded the backend, showed stale words, and could leave the stop button stuck waiting on a backlog. Record short independent clips instead and transcribe each once, appending the text as you speak. Work per clip is bounded, so stopping is prompt (with a hard timeout as a safety net) and long dictations stay smooth. * Studio: dictate then transcribe once on stop, ChatGPT style Local STT dictation streamed by re-transcribing the growing clip, which was quadratic and saturated the backend (multi-second lag), and stop only halted the recorder without releasing the mic, so it kept recording. Record the microphone continuously, release it the instant the user stops, and transcribe the whole clip once. Stopping is immediate and the transcript lands in about a second. Also add the tiny model for the fastest option. * Studio: surface dictation and read-aloud failures instead of failing silently - Compare dictation reports microphone and speech-recognition errors via toast, reusing the main chat adapter's describeMediaError and describeSpeechError - Read-aloud toasts genuine model or synthesis failures while ignoring cancellations * Studio: ChatGPT-style recording bar for dictation Clicking the mic now drops the composer into a dedicated recording bar with a live waveform, a discard (X) and a confirm (tick), instead of a plain stop button. The tick stops recording and transcribes the clip; the X throws the recording away and keeps whatever text was already in the composer. The model adapter taps the mic with an analyser to drive the waveform, and the router tracks the live session so the X can cancel it without transcribing. * Studio: transcribe dictation while speaking, ChatGPT layout Match ChatGPT's recording layout: the bar now renders in place of the input with the left plus button kept, the waveform in the middle, and the discard and confirm buttons together on the right. Cut the post-confirm delay by transcribing in the background as the user talks. The audio is split at natural pauses (voice-activity detection off the same analyser that drives the waveform) and each clip is transcribed as it is cut, so confirming only has to finish the short final tail. The model is also warmed when recording starts so the first run never pays a cold load. * Studio: ChatGPT waveform, hide tools while dictating, faster STT Make the recording UI read like ChatGPT: the waveform is now a dense row of round dots that rise into thin centered bars, and while dictating only the plus button shows, with the mode badge and tool toggles hidden so the bar is just the waveform and controls. Speed up transcription: decode greedily (beam_size=1), which is several times faster on CPU with negligible accuracy loss on short dictation clips, and cap background segments at 6s so the final tail after confirm stays short. * Studio: finish ChatGPT voice bar and low-latency STT * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Studio: full-width waveform with a timer that freezes on stop Use the full-width waveform for the recording bar: brighter, bigger bars that advance on a fixed cadence (keeping peaks between advances) so they glide instead of racing by, inset from the composer edges. Keep a visible timer and the green confirm button, matching the ChatGPT reference, and freeze the timer and waveform the moment the user confirms. * Studio: fix multilingual local dictation * Studio: speed up dictation and release local STT * Studio: harden dictation finalization and STT decoding * Studio: restore Firefox dictation fallback * Studio: add dictation history manager * Studio: manage speech model downloads * Studio: remove em dash from voice model label * Studio: move dictation history into Voice * Studio: source local STT from Unsloth Whisper models Point the dictation STT sidecar and its Model Hub download entries at Unsloth's Hugging Face Whisper repos (small, large-v3-turbo, large-v3) and run them through Transformers, so Studio only ever downloads Unsloth-uploaded weights. Drop faster-whisper and the Systran/mobiuslabs repos; keep the Model Hub as the only download path via local_files_only, and keep PyAV for audio decoding. Device selection uses float16 on CUDA and float32 on MPS and CPU, since Whisper's decoder is unstable in float16 on MPS and repeats tokens. Shorten the model picker labels to name plus download size and update the STT tests for the new backend. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Studio: smooth dictation waveform and keep pill height * Studio: align STT model dropdown width and tidy voice copy * Studio: guide to local engine when browser dictation is offline * Studio: clarify voice section and STT model copy * Studio: keep STT warm with training-aware eviction * Harden STT lifecycle and browser compatibility * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix model discovery test lint * Harden cross-browser microphone errors * Harden cross-browser microphone errors * Surface voice test recognition errors and fall back to Studio TTS - Voice test now toasts non-abort speech-recognition failures instead of ending silently, matching the main and Compare dictation paths. - Read-aloud routes to the backend model when the runtime lacks Web Speech synthesis (audio-only WebView), so it no longer errors immediately. * Fix reviewed STT lifecycle races * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix read-aloud fallback controls * Guard read-aloud stop when deleting a non-speaking message aui.message().stopSpeaking() throws unless this message is the one being read aloud, so calling it unconditionally rejected the delete handler before the message was removed. Only stop speech when this message is speaking. * Cap recent dictation transcript length before persisting Recent dictations only limited entry count, so a long transcript stored the full text in the persisted voice settings and a few could exceed the localStorage quota, throwing synchronously from the uncaught dictation cleanup path. Truncate each entry on save and on hydration, matching the dictionary cap. * Studio: keep dictation mic clickable and guide to local model Register the dictation adapter unconditionally so the mic stays enabled for any engine and starts working right after switching to the local model on an already-open thread. When the browser engine cannot run (Firefox, Brave, non-secure origins), clicking the mic shows a toast that points to the local speech-to-text model instead of leaving a disabled button. The toast stacks its action below the text with a fully rounded button. * Studio: add bottom padding below the dictation guidance toast button * Studio: increase bottom padding under the dictation toast button * Studio: add bottom padding inside the dictation toast button * Studio: add five Whisper defaults and custom model search Add private UnslothAI Tiny and Base mirrors to the curated local STT choices while keeping Small as the default. Let users search or paste a Transformers-compatible Whisper repository and validate it end to end. Keep short dictations in one clip to avoid repeated padded encoder work, then split longer recordings near Whisper's 30-second boundary. Update hidden model filters and tests, including the CPU-only CI runtime stub for PyAV. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Studio: use public Unsloth Whisper repositories Point the Tiny and Base dictation defaults to the public unsloth repositories and remove the private mirror references from model filtering and tests. * Studio: update Whisper download sizes Reflect the cleaned public Tiny and Base repositories in the curated model labels. * Studio: right-align STT model size, fix dropdown wheel scroll, refresh sizes - Show the download size on the right of each model row so long names like Whisper Large v3 Turbo no longer hide it - Update curated Whisper sizes to the safetensors weights actually downloaded: Tiny 151 MB, Base 290 MB, Small 967 MB - Drive the model list scroll from a wheel handler so the mouse wheel scrolls it inside the Settings dialog, not just the scrollbar - Add a search icon and shorten the placeholder to Search model * Studio: do not search when a dictation model is picked, shrink repo label - Treat the filled-in model text as a selection, not a query, so choosing a model no longer kicks off a Hugging Face search - Make the repository line under each model name smaller * Studio: tighten dictation model and local engine descriptions * Studio: keep model display on pick instead of the query, shrink row text - Guard the combobox input so selecting a model shows its name and does not echo the typed query back or start a search - Map the item label to the friendly display so picks fill the field - Reduce the model name and size text in each row * Studio: show only the model name in the dictation field, shrink size label - Drop the download size from the search field; the name alone is shown once a model is selected, with sizes kept in the dropdown list - Reduce the size label text in each row * Studio: clarify the dictation model description * Studio: drop Hugging Face from the dictation model description * Studio: move the dictation dictionary to its own Manage subpage - Replace the inline entry list with a Manage row, matching Dictation history, so a long dictionary no longer crowds Voice settings - Add a DictationDictionaryView subpage that holds the entry editor * Studio: match STT field font, use best voice for System default - Bump the dictation model field text to text-sm so it matches the engine dropdown next to it - Resolve the System default read-aloud voice to the top curated voice instead of the browser default, which is a robotic legacy voice on macOS * Studio: rerank read-aloud voices and drop duplicate voice entries - Rank by vendor quality, then the user's locale, then a preferred list of natural voices, so the best voice leads instead of the first alphabetically - Collapse voices that macOS reports twice under one name and language * Studio: fold dictionary and recents into the dictation section - Drop the separate Dictation dictionary and Recent dictations headings; their Manage rows now sit under Dictation, split by the row divider - Shorten the custom spellings description * Studio: add search and sort to dictation history - Filter saved dictations by text with a search field - Sort by newest, oldest, or A to Z; show a no-matches message - Keep Clear all available regardless of the current filter * Studio: settle cancelled STT loads before training and fix dictation review items Wait for a cancelled STT load to exit and release its memory before reporting it freed for training, so the loader cannot still be inside from_pretrained()/.to(device) holding VRAM when the training subprocess starts. A load that finishes before observing the cancel now gets unloaded so the memory is actually reclaimed. Clear the accelerator cache before the CPU fallback in load() so a failed CUDA/MPS load does not strand reserved VRAM once the sidecar is marked CPU-resident. Send the saved Hugging Face token when polling STT download progress so a gated or private repo resolves and shows the correct Load/Downloaded state instead of reporting missing. Mark the composer Dictate button as type="button" so clicking it does not also submit the draft when the composer already has text or attachments. * Studio: pin dictation settings per session and close STT startup races Capture the STT model and language when a dictation session starts and pass them to every queued segment and the warm-up load, so changing the model or language mid-recording no longer transcribes the same clip with the wrong model or a model that is not downloaded. Check the local runtime at the top of transcribe(), before the model cache lookup and the bounded audio decode, so a server missing PyTorch or Transformers returns 501 up front instead of decoding a long clip first. Treat the training startup window as active for STT device selection. start_training frees VRAM in before_spawn but only assigns _proc later, so a concurrent STT load could take the GPU that was just cleared. A startup flag now reports training active from the free until the process is live, forcing those loads to CPU; a finally clears it on every exit. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Studio: stub the STT runtime check in transcribe orchestration tests transcribe() now verifies the local runtime up front, so the unit tests that exercise transcription orchestration must treat the runtime as present to keep passing where PyTorch, Transformers, and PyAV are not installed. Stub ensure_stt_available in the shared fixture and restore the real check in the availability and load-rejection tests. * Harden custom Whisper dictation models * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Add whisper.cpp dictation engine with per-engine downloads and history rework Engines - New GGML STT sidecar that runs a managed whisper-server subprocess with idle unload, plus a pinned static build script (scripts/build_whisper_cpp.sh) - Dictation engine picker now offers Browser, Local transcription (whisper.cpp), and Local transcription (Transformers) - Both local engines serve the same five curated Whisper models and download them directly with byte-level progress reported by /audio/stt/status - Models auto load on selection and when their download finishes - Unload and training admission account for both engines Benchmarks (Apple Silicon, greedy, warm, same checkpoints) - whisper.cpp transcribes 2.4x to 5x faster than Transformers and loads in about 0.45s vs 0.86s for Whisper Small - whisper.cpp GGUF path is unchanged by the Transformers addition (load 0.445s -> 0.444s, short clip 0.391s -> 0.347s, long 1.197s -> 1.129s) Voice settings UI - Plain curated model select replaces the searchable combobox - Single download progress bar with transfer rate for both engines - Dictation history now stores every dictation with Show more pagination, a top Clear history action, and links back to the chat it was spoken into - Archived chats dialog gets the same pagination - Delete dialog offers deleting a dictation together with its chat Tests: 88 backend STT tests pass, including new snapshot download coverage. Frontend typecheck, lint, i18n parity, and production build pass. * Merge local engines into one option and source GGML models from unslothai Engine selection - The dictation engine dropdown is back to two choices: Browser and Local transcription. The selected model decides the backend: curated ids run GGML checkpoints through whisper.cpp, searched Hugging Face repositories run safetensors through Transformers - Model picker lists the curated models and searches Hugging Face for other Whisper repositories, validating them before selection. The trigger is a plain button so the selection never renders inside a text input - /audio/stt/status accepts a model query param so downloaded state works for custom repositories; the engine param on load, transcribe, and download routes is derived from the model everywhere Model source - Curated GGML checkpoints now download from the Unsloth-hosted unslothai/whisper-*-GGUF repositories (one repo per model) instead of ggerganov/whisper.cpp; cache lookups, progress totals, and in-flight blob tracking are per-model Fixes - Voice settings and dictation history were not persisting: the quota-safe localStorage wrapper was declared after the store that uses it, so the persist storage factory failed silently. Every settings write also threw mid-click, which kept the model picker popover from closing on selection - is_model_downloaded now verifies config, preprocessor config, and real weight files instead of trusting an offline snapshot lookup, so a partial download left by an aborted fetch shows the Download button instead of failing to load - Removed whisper.cpp mentions from user-facing text: the ready status shows Loaded instead of the runtime name, picker rows show the source repository, and runtime error messages say local transcription runtime Verified with automated browser sessions and live API checks: selection closes the picker with no page errors, persisted settings hydrate on reload, a stale partial snapshot triggers download then loads on MPS and transcribes, and curated models download from the unslothai repos. 88 backend STT tests, typecheck, lint, i18n parity, and build pass. * Skip the duplicate source line for custom models in the STT picker A custom repository's display name is its id, so search results and the appended current selection rendered the same string twice. The source line now only renders when it differs from the name; curated rows keep their name, unslothai source repository, and download size. * Verify every shard of a sharded checkpoint in the downloaded check A snapshot holding one of N shards (or a corrupt shard index) passed the downloaded check and then failed at load. When model.safetensors.index.json exists, every shard in its weight map must now be present. Found by simulation; covered by a regression test. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Rename stale _starting references in the pump resilience tests The startup flag on TrainingBackend was renamed to _spawn_in_progress but two tests added alongside it still asserted on the old name, failing the Python 3.11 to 3.13 CI jobs. * Make the selected model row clearly highlighted in the STT picker The current selection was a faint background tint. It now uses the accent background with a medium weight name. Two line rows use a small corner radius; single line custom repo rows keep the pill shape. * Address review feedback on STT snapshot checks, VRAM release, and dictation UX Verify snapshot completeness in the load preflight so a partial download fails before the audio is decoded, for curated and custom repos alike. Drop the failed accelerator traceback before the CPU retry so the cache clear can actually release that memory. Keep unloading the GGUF sidecar after cancelling an in-flight Transformers load; both engines can hold memory at once. Allow Auto language with English-only .en checkpoints, matching the backend which sends no forced language. Keep the discard button usable while a transcription is pending so a slow or hung request cannot trap the composer in dictation mode. Stop linking Compare and settings test dictations to the unrelated active single chat thread. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Move the CPU retry out of the exception handler On Python 3.10 the interpreter exception state keeps its own reference to the traceback, so dropping it from the caught exception was not enough to release the failed accelerator load during the retry. Leaving the handler before clearing the cache works on every supported version. * Address review feedback on session handoff, chat pinning, and server lifetime Starting a dictation from a second entry point now cancels the session it replaces, so the old recording cannot keep the microphone open or save a transcript with no discard button pointing at it. The linked chat is pinned when recording starts, so switching threads while a transcription finalizes cannot relink the transcript to the newly opened chat. whisper-server is now bound to Studio's lifetime like the other long-lived children: PDEATHSIG on Linux, the parent job object on Windows, and pid adoption so the shutdown sweep reaps it; before this it survived a Ctrl+C exit as an orphan still holding the model. * Remove the dictation mic test from Voice settings The composer dictate button covers the same check, so the test row, its transcript panel, the unsupported fallback row, and their strings and search entry are gone. * Studio STT: gate GGUF whisper-server on training and fix dictation retry and dictionary edits GGUF (whisper.cpp) sidecar: - Launch whisper-server with --no-gpu while training is active, mirroring the Transformers sidecar's CPU device choice, so a mid-training dictation cannot reclaim the VRAM training just freed. - Report is_loading() during whisper-server startup so training VRAM admission accounts for the accelerator memory it is about to bind. - Require PyAV in is_available() so /audio/stt/status reports the engine unavailable when uploads cannot be decoded, instead of loading fine and then 501ing at transcription. - Reject a missing model before decoding audio, matching the Transformers download preflight. Voice settings: - The download Retry button now restarts the download; the sidecar error is sticky until a new start(), so re-polling alone never cleared it. Dictation dictionary: - Tabbing from an emptied entry to its remove button no longer commit-splices the row first, which shifted indices and deleted the wrong entry. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Studio STT: fix curated GGUF whisper filenames to match hosted repos The unslothai/whisper-*-GGUF repos host the checkpoint as whisper-<id>.bin, not ggml-<id>.bin, so every curated dictation download and cached-path lookup 404'd and the whisper.cpp engine could never load a model. Point GGML_STT_MODELS at the real filenames and guard the naming with a test. * Studio STT: validate a custom dictation repo before downloading it The Transformers STT engine accepts an arbitrary owner/model repo, but the download route handed it straight to snapshot_download, pulling a possibly large non-Whisper repository into the shared HF cache. Confirm the repo is a Whisper checkpoint first with the existing metadata-only validate_remote_model (no weights); curated ids short-circuit and the GGUF engine (curated-only) is unaffected. A non-Whisper repo now 422s before any download. * Studio STT: preempt a still-loading GGUF server for training admission A whisper-server still in its startup window binds accelerator memory but has no loaded_model yet, so training admission could miss it and launch into an OOM. Make the GGUF startup cancellable (cancel_pending_load signals an abort event and terminates the starting process without the load lock; _wait_for_server observes it and raises SttLoadCancelledError; wait_for_load_to_settle blocks on the lock until the killed server is reaped), and always fold the GGUF sidecar into the resident-STT summary so a resident Transformers model cannot mask a loading GGUF server. free_stt_model_for_training now cancels an in-flight load and waits for it to settle before training claims the memory. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Studio STT: fall back to Transformers when whisper-server is absent A curated dictation model (including the default small) hard-pinned the GGUF engine, but standard installs do not ship whisper-server, so every recording 501'd instead of using the Transformers engine that serves the same checkpoint -- the GGUF sidecar's own documented contract. Add _resolve_serving_stt_engine: a GGUF request for a curated id (the only ids GGUF accepts, all Transformers- servable) downgrades to Transformers when whisper-server is unavailable, applied consistently to download, load and transcribe (not unload, which targets a specific engine). The Voice tab likewise falls back to the Transformers status so the model is not shown unavailable and download is not blocked. * Studio STT: hide custom Whisper caches from the legacy model pickers The legacy /cached-models (and /cached-gguf) routes called is_hidden_model with only the owner/model id, which cannot reach the config-based Whisper check, so a downloaded custom (non-curated) Whisper checkpoint was still offered as a chat model. Pass the cached snapshot path so _path_is_whisper_model inspects the repo config and hides it, matching the discovery route. * Studio STT: hide GGUF dictation repos, lock-free status, unload fallback, split training eviction - Hide the curated GGUF dictation repos (unslothai/whisper-*-GGUF) from the chat model inventory and pickers, backend and frontend. Only their Transformers safetensors companions were hidden; the GGUF repos use a different org and a -GGUF suffix and carry a raw .bin with no whisper config.json, so they leaked into chat pickers. - Make the GGUF sidecar loaded_model/device accessors lock-free, mirroring the Transformers sidecar. transcribe() holds self._lock across the whole inference call, so /audio/stt status polls and training admission previously blocked behind an in-flight transcription. - stt_unload resolves through the serving resolver: a "gguf" pick on a host without whisper-server is served by the Transformers fallback, so unload must target that engine or the resident model is never freed. Unload also attempts every engine even if one raises, so a failure freeing one backend no longer skips the other. - free_stt_model_for_training frees the Transformers and GGUF sidecars under independent exception boundaries so a failure unloading one no longer skips the other before training claims the memory. Adds tests/test_stt_review_fixes.py covering all four. * Studio STT: resolve Auto dictation language for the model engine + snapshot process liveness - The model dictation adapter sent the raw setting (the literal "auto") to the backend, while the browser engine resolves Auto via resolveDictationLanguage. A batch of non-English voice notes came back mostly English on Auto. Add resolveModelDictationLanguage: only the literal "auto" is resolved to a concrete locale, gated so it becomes a language the model AND Whisper can honor (mirroring the backend's known-whisper-languages set); an explicit language, or a locale Whisper cannot honor, stays unchanged/auto-detect. Wire it into both adapter call sites. - GgmlSttSidecar._process_alive() read self._process twice; a concurrent unload() nulls it under the lock while loaded_model/device read lock-free, so a null between the two reads called None.poll(). Snapshot once. Adds a deterministic regression test. * studio: tighten comments and docstrings in the dictation modules * studio: harden dictation model downloads, GGML readiness, and recording paths Address review findings on the STT dictation feature: - build_whisper_cpp.sh refuses to delete a whisper.cpp tree under a custom Studio home unless it carries the Studio ownership marker, matching the setup.sh policy, and marks trees it creates - _snapshot_is_complete validates every shard of a sharded PyTorch (pytorch_model.bin.index.json) checkpoint like the safetensors path, and requires tokenizer assets (tokenizer.json or vocab.json + merges.txt) - custom-repo downloads pin the revision resolved at validation time and restrict snapshot_download to the model/tokenizer/config/preprocessor file classes Studio loads - the GGML sidecar holds its port reservation until just before spawning whisper-server and only accepts readiness from a responder that both looks like whisper.cpp's server and belongs to the still-running managed child, probing twice, so mic audio cannot be posted to a foreign local process - the recording adapter transcribes every non-empty segment; the RMS meter only shapes segment boundaries and can no longer discard quiet speech - Compare-pane dictation can cancel a pending transcription on second click, with the button relabeled while finalizing - localStorage quota recovery halves the dictation history until the save fits, so small histories shrink too - the System default TTS voice resolves to the platform default voice - new dictation UI imports go through the chat and hub feature barrels Regression tests cover the build-script gate, sharded PyTorch and tokenizer completeness, revision pinning and allow patterns, and the whisper-server readiness probe. * Fix STT download and voice picker follow-ups * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Add dictation button regression coverage * Studio: prebuilt whisper.cpp via the shared llama.cpp install core, slim bundles paired to the llama prebuilt (#7294) * Studio STT: add prebuilt whisper.cpp (whisper-server) installer New install_whisper_prebuilt.py downloads a per-platform whisper-server bundle published by the unslothai/whisper.cpp prebuilt CI into the managed whisper.cpp dir (build/bin/whisper-server) so local dictation needs no compiler. Mirrors install_node_prebuilt.py / install_llama_prebuilt.py: host + backend detection, sha256 pins (whisper_prebuilt_pins.json) as the trust anchor, staging + install lock + atomic swap, traversal-safe extract, co-located shared libs (RUNPATH=$ORIGIN), an UNSLOTH_WHISPER_PREBUILT_INFO.json marker with idempotent "already matches", and exit codes 0/1/2/3. Not wired into setup yet; the pins ship empty so every asset fails closed until the first fork release is published and its digests are reviewed in. * Studio STT: install prebuilt whisper.cpp during setup and update Add a fail-open whisper.cpp block to setup.sh after the llama.cpp section so `unsloth studio update` (and a fresh install) fetch the prebuilt whisper-server into the managed whisper.cpp dir the sidecar discovers. It skips a user-set WHISPER_SERVER_PATH/UNSLOTH_WHISPER_CPP_PATH, honors UNSLOTH_SKIP_WHISPER_INSTALL, forwards the resolved ROCm gfx, and never aborts setup: a busy install keeps the existing runtime, and an unavailable prebuilt stays quiet (source build is opt-in via UNSLOTH_WHISPER_FORCE_COMPILE) since Transformers STT and browser dictation remain. Register UNSLOTH_WHISPER_PREBUILT_INFO.json as Studio-owned evidence. * Studio STT: harden whisper-server child env + WSL ROCm detection - Sidecar spawns whisper-server with a scrubbed child env that prepends the binary dir (co-located GPU libs) to the loader path, and on WSL2 ROCm loads the system HIP first (HSA_ENABLE_DXG_DETECTION=1) so a bundle's bare-metal HIP does not segfault on /dev/dxg. Secret-bearing vars are dropped from the child. - find_whisper_server_binary now requires an executable, not just a file. - Installer rocm probe passes HSA_ENABLE_DXG_DETECTION and falls back to /opt/rocm/bin/rocminfo so a WSL ROCm host is not misdetected as CPU-only; gfx parsing skips the gfx000 CPU agent and generic ISA lines. - Tests for the child env (secret scrub, lib dir, WSL HIP precedence), the executable check, and the WSL rocm detection. * Studio STT: in-app whisper.cpp prebuilt update stack + ship pins in the wheel Mirror the llama.cpp update stack for the whisper.cpp prebuilt so Studio can detect and install a newer whisper-server release from inside the app: - backend/utils/whisper_cpp_freshness.py: read UNSLOTH_WHISPER_PREBUILT_INFO.json and compare the installed release against the newest unslothai/whisper.cpp release. Whisper tags are v<upstream>-unsloth.<N>, so is_behind compares a (major, minor, patch, serial) key with a strict downgrade guard; 24h cache; fail-open. - backend/utils/whisper_cpp_update.py: run install_whisper_prebuilt.py to fetch and atomically swap the newest bundle, unloading the warm GGUF sidecar first. - backend/routes/whisper.py mounted at /api/whisper (update-status + update). - pyproject: add whisper_prebuilt_pins.json to studio package-data so the installer's trust anchor ships in the wheel (it is a data file, not a .py module, so package discovery alone does not include it; node_prebuilt_pins.json is listed for the same reason). Without this a pip-installed wheel had no pins and the prebuilt install aborted to Transformers STT. Adds test_whisper_cpp_freshness.py (version parser, is_behind matrix + downgrade guard, marker layouts, stale decision, fail-open). * Studio STT: verify whisper prebuilts via the release checksum index, like llama.cpp Re-align the whisper.cpp prebuilt installer to install_llama_prebuilt.py's trust model: instead of a committed whisper_prebuilt_pins.json, verify every download against the release's own whisper-prebuilt-sha256.json checksum index, fetched from the same GitHub release. - parse_release_checksums / fetch_release_checksums / expected_sha256_for replace the pins layer. The index is validated for schema/component and that its release_tag matches the resolved release; an asset absent from it, a release that does not publish it, or a manifest sha256 that disagrees with it all fail closed to a source build. - resolve_release_tag now resolves the newest published release at runtime (or an explicit --published-release-tag), matching llama and the freshness check; removed the pinned-default and the UNSLOTH_WHISPER_ALLOW_UNVERIFIED opt-in. - Delete studio/whisper_prebuilt_pins.json and drop its pyproject package-data entry (nothing to ship now, same as llama which has no committed pins). - Adds test_install_whisper_prebuilt_checksums.py (index parser, fail-closed on uncovered asset, tampered-manifest guard, newest-release resolution). This is a same-origin checksum (integrity, not authenticity), identical to the llama.cpp installer; pair releases with GitHub artifact attestations for provenance. * Resolve whisper prebuilt release via the download host (no GitHub API) Mirror install_llama_prebuilt.py's fast path: resolve the release tag from the releases/latest redirect and fetch the manifest + checksum index from constructed releases/download URLs, so the common install path makes zero api.github.com calls (unauthenticated api.github.com is capped at 60 req/hour per IP; the download host is not). Fall back to the GitHub API only on a 404, malformed asset, or tag mismatch. * Studio STT: coverage-aware whisper prebuilt selection via a shared core whisper's select_artifact returned the first os/arch/backend manifest match and ignored the SM-coverage fields the release manifest already carries, so a Blackwell B200 (sm_100) was served cuda12-legacy (sms 50-61) -- runnable only via forward PTX JIT. install_llama_prebuilt.py on the same host correctly picks cuda13-newer. Extract the coverage-aware selection into a shared, component-agnostic core under studio/backend/utils/prebuilt/ (selection + GPU host-capability detection), lifted from llama's linux_cuda_choice_from_release / _artifact_covers_sms / _sm_range and generalised over a normalised artifact. whisper's HostInfo now records the GPU compute caps + driver CUDA version (honoring CUDA_VISIBLE_DEVICES), and select_artifact routes CUDA/ROCm through the shared selector: every visible SM must be covered, the tightest-covering profile wins (Blackwell-aware runtime-line ordering), ROCm matches the gfx target exactly, and an uncovered GPU falls back to the CPU bundle. CPU/Metal/Vulkan keep first-match. The resolver JSON, exit codes, and "already matches" contract are unchanged. On the B200 the installer now resolves cuda13-newer, matching llama. * Studio STT: gate whisper CUDA selection on the on-disk runtime, like llama The prebuilt CUDA bundles are dynamically linked and intentionally do NOT ship libcudart/libcublas -- they load the same runtime the host already has. So the driver's advertised CUDA version is only an upper bound: a cuda13 bundle still needs cuda13 runtime libraries present on disk. Port llama's on-disk runtime scan (detected_linux_runtime_lines / detected_windows_runtime_lines) into the shared core and intersect it with the driver-compatible lines in select_cuda_attempts. A host with a cuda13 driver but only cuda12 runtime (e.g. torch-cuda12) now correctly gets a cuda12 bundle instead of an unloadable cuda13 one; a host with no CUDA runtime at all falls back to CPU. Fixes a glob bug in the port (any(Path(d).glob(p) for d in dirs) tests generator truthiness, not a match) that made every major report present; add a real filesystem test that exercises the scan. * studio: harden shared prebuilt core to full llama parity Apply the review findings on the shared coverage-aware prebuilt-consumer core so whisper.cpp selection is exactly equivalent to the llama.cpp path. hosts.py: port llama's CUDA_VISIBLE_DEVICES handling. A GPU hidden by an index/UUID selector now reports has_usable_nvidia False instead of staying usable, via supports_explicit_visible_device_matching plus the physical / explicit-match branches, and _select_visible_rows now matches rows the way llama does (index or UUID, gpu- prefix optional) and skips unmatched tokens rather than keeping all rows. Adds the Linux /proc/driver/nvidia/gpus fallback and has_physical_nvidia. Adds parse_macos_version. runtime_libs.py: the Linux on-disk scan now requires the exact libcudart / libcublas SONAME (libcudart.so.13), not a libcudart.so.13* glob, so a bare versioned file without the SONAME symlink no longer counts as loadable. Hardens the ldconfig parse against an empty left-hand side. selection.py: fix the Blackwell/torch reordering so it keys on the covering runtime lines (falls through to the torch preference when the covering lines were filtered out), matching linux_cuda_choice_from_release. Corrects the compatible_runtime_lines_for_driver docstring: the bundles do not ship the CUDA runtime, so the driver version is only an upper bound and the caller must intersect with the on-disk scan. install_whisper_prebuilt.py: enforce a macOS artifact's min_os (new HostInfo.macos_version) so a bundle that cannot load on the host OS version is dropped. Keep resolver stdout to only the JSON line by leaving logs on stderr in --resolve-prebuilt mode, and map an unexpected probe failure to prebuilt_available False instead of a traceback. Tests: new host-probe suite for the visible-device logic, exact-SONAME runtime-scan cases, macOS min_os filtering, resolver stdout-only-JSON, exit-code mapping, and the repo key. * studio: fix whisper prebuilt selection + launch parity gaps from review A parallel review surfaced integration defects where the whisper path could select or launch a bundle that cannot run on a concrete host. Each is fixed to match install_llama_prebuilt.py. macOS min_os: the manifest labels macOS requirements as macos-<version> (e.g. macos-14.0), which the version parser could not read, so the guard was a no-op and a macOS-13 host would install the macos-14 Metal bundle. Strip the platform prefix before parsing. ROCm gfx detection: _detect_rocm_gfx returned the first gfx token and ignored HIP_VISIBLE_DEVICES / ROCR_VISIBLE_DEVICES / CUDA_VISIBLE_DEVICES. Since exact ROCm matching treats that token as the active GPU, a mixed APU + dGPU host (gfx1151 + gfx1100) with HIP_VISIBLE_DEVICES=1 installed the wrong archive. Route through a shared pick_rocm_gfx_target (lifted from llama) that parses per-GPU sections and honors the visibility vars (empty / -1 -> no AMD GPU). --rocm-gfx override: recording the arch without setting has_rocm left the host on its CUDA/CPU path so the ROCm bundle was never picked. --rocm-gfx now implies has_rocm and clears NVIDIA state, like llama's _apply_host_overrides. CUDA launch env: a CUDA bundle ships the ggml CUDA backend but not libcudart/libcublas, and the sidecar launch env exposed only the bundle dir, so on a host whose CUDA runtime lives only in the PyTorch wheels the selection would gate cuda usable but the server could not load it. Add the CUDA-from-PyTorch runtime dirs to the child loader path for CUDA bundles (bundle dir still first), mirroring binary_env. Also normalize a manifest artifact's supported_sms defensively (parity with llama's parser) and document that blackwell_min_toolkit_for_caps is retained for the Phase B llama Windows path. Not changed (verified parity, not defects): Linux/Windows min_os is enforced nowhere in llama (macOS only); the resolver is optimistic about the checksum index and the install path verifies. * studio: tighten prebuilt-core code comments * studio: lift shared prebuilt installer core out of the whisper installer * studio: reuse the llama.cpp prebuilt installer machinery for whisper * studio: unify llama and whisper prebuilt installers on a shared descriptor core * studio: consolidate prebuilt installer tests into the shared core suite Grow tests/studio/install/test_prebuilt_core.py from 62 to 164 tests so every component-agnostic behavior runs against both descriptors: the full seven profile CUDA release matrix (multi-GPU, on-disk runtime gating, shuffle stability, missing SM metadata, dotted SM normalization, no-driver fallback policy), the ROCm gfx family matrix, macOS min_os gating and its helper, backend resolution incl. cpu-fallback precedence and Intel-mac auto detect, checksum-index non-object and plain-lookup cases, the tar symlink/hardlink extraction guards moved from the llama suite, and the compute-cap, visible device, runtime-line and Blackwell helper value tables moved verbatim from the llama characterization suites. Delete only tests whose exact behavior the master now asserts for the same component: 40 pure-alias helper cases in test_selection_logic.py (replaced by value-identical master tables plus an alias-identity pin), 6 extraction moves and the master-absorbed zip-symlink case in the llama logic suite, 3 routing twins in test_rocm_support.py already pinned byte-for-byte in test_selection_logic.py, the 2 Blackwell helper tables in the backend resolve suite, 28 whisper logic tests and 10 whisper checksum tests re-asserted by the master whisper parameterization. Wrapper wiring pins, the llama release plan dialect, fingerprints and every llama-only behavior stay untouched. * studio: dedupe sidecar and update helpers into the backend prebuilt package * studio: chain whisper.cpp prebuilt updates onto the llama.cpp update flow * studio: consume paired slim whisper prebuilts via the llama ggml runtime * studio: serve every whisper backend from slim prebuilts * studio: drop the whisper fat per-accelerator selection chain unslothai/whisper.cpp releases are slim-only from v1.9.1-unsloth.2: one ggml-less bundle per os/arch, paired to the llama.cpp prebuilt that provides every ggml backend. Delete the whisper-side fat CUDA/ROCm/metal/vulkan selection glue; keep slim selection + pairing, link_ggml_runtime, and one legacy shape, the published fat CPU bundle of an explicitly pinned pre-slim release. Exit 2 now reads as prebuilt unavailable (whisper never source builds); setup already treats it that way. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Wire libomp runtime DLL alongside ggml in slim whisper installs llama's clang-built windows-arm64 ggml-base.dll imports libomp140.aarch64.dll, shipped in the llama bundle but not a system DLL. Without it next to whisper-server.exe the loader fails with STATUS_DLL_NOT_FOUND before main. MSVC x64 links vcomp140.dll from System32 and Linux ggml uses system libgomp.so.1, so only windows-arm64 was affected. The empty-runtime guard still requires a real ggml library; libomp alone is not a pairing. * studio: drop whisper-side fat-selection support structure Slim whisper bundles are selected per os/arch only; all accelerator capability comes from the installed llama.cpp prebuilt, whose installer already did the coverage-aware selection. Remove the machinery that only existed to pick among fat per-accelerator whisper bundles: - prebuilt_core: delete the generic CUDA/ROCm coverage selection (select_cuda_artifact, select_rocm_artifact, ArtifactView adapters, detected_cuda_runtime_lines, the exact-SONAME linux probe) that no shipped component routes through; llama keeps its own selection chain and whisper shadows select_artifact with the slim-only version. select_artifact is now a plain os/arch/backend first-match. - install_whisper_prebuilt: drop the HostInfo CUDA fields (compute_caps, driver_cuda_version, torch_runtime_line) and the torch runtime probe that populated them; nothing reachable reads them, and the resolver payload sources runtime_line from the artifact. - whisper_cpp_update: delete the standalone start_update job worker; whisper applies only run as the chained phase of the combined llama+whisper update. The status payload keeps its job field (idle). - routes/whisper: drop the progress logger that could never fire. - tests: remove tests of the deleted paths and tests duplicating the descriptor-parameterized core suite or the llama freshness suite. Contracts unchanged: resolver JSON keys, exit codes, marker fields, pairing logs, and the pinned pre-slim fat CPU escape hatch. * Address review feedback on the whisper prebuilt update and install paths - Pin the chained whisper phase to the release the freshness check offered, so the download-host latest pointer cannot reinstall an older build in a loop - Wire the whisper prebuilt install into setup.ps1 (Windows setup previously skipped it entirely) - Treat a non-executable server or missing wired ggml libraries as a broken install instead of reporting already matches - Keep whisper sidecar reloads out of the job-level reload flag and resync chat state after a partial chained update that unloaded llama - Repoint home and profile vars for the whisper-server subprocess at a managed scratch dir and drop credential-store pointers - Clear the prebuilt marker before the opt-in source build overwrite - Write the prebuilt marker with explicit utf-8 encoding * Tighten comments in the whisper prebuilt consumer * Harden the Windows whisper setup phase and the chained update edges - setup.ps1: honor WHISPER_SERVER_PATH / UNSLOTH_WHISPER_CPP_PATH / UNSLOTH_SKIP_WHISPER_INSTALL, run the custom-home ownership guard before the atomic install, and forward the release-tag pin and ROCm hints like setup.sh - sidecar: a cpu-selected install launches whisper-server with --no-gpu (slim wiring links every llama backend, so the flag is what keeps a deliberate CPU choice off the GPU) - chained update: leave whisper unpinned on macOS (the llama phase can walk back there, and a newest-tag pin could be an impossible pairing on every retry) and treat installer exit 2 as kept-existing-runtime instead of failing the combined job - job.to_tag now comes only from the llama phase, so a whisper-only round cannot report a llama update that never ran * Fix slim whisper runtime follow-ups * Address remaining whisper update reviews * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Address remaining prebuilt update reviews * Fix remaining chained update reviews * Fix remaining whisper runtime review edges * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: danielhanchen <unslothai@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com> --------- Co-authored-by: danielhanchen <danielhanchen@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Unsloth <michaelhan@Michaels-MacBook-Pro.local> Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
894 lines
39 KiB
Python
894 lines
39 KiB
Python
"""install.sh/install.ps1 must refuse to rm -rf an existing Unsloth venv in env-mode without a sentinel."""
|
|
|
|
from __future__ import annotations
|
|
|
|
import re
|
|
import subprocess
|
|
from pathlib import Path
|
|
|
|
REPO_ROOT = Path(__file__).resolve().parents[1]
|
|
INSTALL_SH = REPO_ROOT / "install.sh"
|
|
INSTALL_PS1 = REPO_ROOT / "install.ps1"
|
|
SETUP_PS1 = REPO_ROOT / "studio" / "setup.ps1"
|
|
SETUP_SH = REPO_ROOT / "studio" / "setup.sh"
|
|
|
|
# Stubs for helpers the extracted guard block calls; mv-based replacement reproduces the venv-gone
|
|
# effect without the full rollback machinery.
|
|
_INSTALL_GUARD_STUBS = (
|
|
"substep() { :; }\n"
|
|
"_start_studio_venv_replacement() {\n"
|
|
' mv -- "$1" "$1.replaced"\n'
|
|
"}\n"
|
|
)
|
|
|
|
|
|
def _extract_install_sh_guard_block() -> str:
|
|
"""Extract install.sh's venv guard block (up to the first elif) as a self-contained snippet."""
|
|
src = INSTALL_SH.read_text()
|
|
m = re.search(
|
|
r'(if \[ -x "\$VENV_DIR/bin/python" \]; then\n.*?)elif \[ "\$_STUDIO_HOME_REDIRECT" != "env"',
|
|
src,
|
|
re.DOTALL,
|
|
)
|
|
assert m, "install.sh venv guard block not found"
|
|
return m.group(1) + "fi\n"
|
|
|
|
|
|
def _build_install_guard_script(
|
|
studio_home: Path,
|
|
redirect: str,
|
|
block: str | None = None,
|
|
) -> str:
|
|
"""Build a self-contained bash script exercising the extracted guard block (with helper stubs)."""
|
|
if block is None:
|
|
block = _extract_install_sh_guard_block()
|
|
return (
|
|
_INSTALL_GUARD_STUBS
|
|
+ f'STUDIO_HOME="{studio_home}"\n'
|
|
+ f'VENV_DIR="$STUDIO_HOME/unsloth_studio"\n'
|
|
+ f'_STUDIO_HOME_REDIRECT="{redirect}"\n'
|
|
+ block
|
|
+ "echo RESULT=ok\n"
|
|
)
|
|
|
|
|
|
def _run_install_guard(
|
|
studio_home: Path,
|
|
redirect: str,
|
|
create_share_conf: bool = False,
|
|
create_bin_shim: bool = False,
|
|
create_venv_marker: bool = False,
|
|
) -> subprocess.CompletedProcess:
|
|
venv_dir = studio_home / "unsloth_studio"
|
|
(venv_dir / "bin").mkdir(parents = True, exist_ok = True)
|
|
py = venv_dir / "bin" / "python"
|
|
py.write_text("#!/bin/sh\nexit 0\n")
|
|
py.chmod(0o755)
|
|
if create_share_conf:
|
|
(studio_home / "share").mkdir(parents = True, exist_ok = True)
|
|
(studio_home / "share" / "studio.conf").write_text("")
|
|
if create_bin_shim:
|
|
(studio_home / "bin").mkdir(parents = True, exist_ok = True)
|
|
(studio_home / "bin" / "unsloth").write_text("")
|
|
if create_venv_marker:
|
|
(venv_dir / ".unsloth-studio-owned").write_text("")
|
|
script = _build_install_guard_script(studio_home, redirect)
|
|
return subprocess.run(
|
|
["bash", "-c", script],
|
|
env = {"PATH": "/usr/bin:/bin"},
|
|
text = True,
|
|
capture_output = True,
|
|
)
|
|
|
|
|
|
def test_env_mode_blocks_unsloth_studio_without_sentinels(tmp_path):
|
|
studio_home = tmp_path / "ws"
|
|
res = _run_install_guard(studio_home, redirect = "env")
|
|
assert res.returncode != 0, (
|
|
"env-mode without sentinels must refuse to rm -rf $VENV_DIR; "
|
|
f"stdout={res.stdout!r} stderr={res.stderr!r}"
|
|
)
|
|
assert "does not look like an Unsloth Studio install" in res.stderr
|
|
assert (studio_home / "unsloth_studio" / "bin" / "python").is_file()
|
|
|
|
|
|
def test_env_mode_passes_when_share_studio_conf_present(tmp_path):
|
|
studio_home = tmp_path / "ws"
|
|
res = _run_install_guard(studio_home, redirect = "env", create_share_conf = True)
|
|
assert res.returncode == 0, (
|
|
f"share/studio.conf sentinel must allow cleanup;"
|
|
f" stdout={res.stdout!r} stderr={res.stderr!r}"
|
|
)
|
|
assert "RESULT=ok" in res.stdout
|
|
assert not (studio_home / "unsloth_studio").exists()
|
|
|
|
|
|
def test_env_mode_passes_when_bin_unsloth_shim_present(tmp_path):
|
|
studio_home = tmp_path / "ws"
|
|
res = _run_install_guard(studio_home, redirect = "env", create_bin_shim = True)
|
|
assert res.returncode == 0, res.stderr
|
|
assert not (studio_home / "unsloth_studio").exists()
|
|
|
|
|
|
def test_default_mode_skips_sentinel_check(tmp_path):
|
|
studio_home = tmp_path / "ws"
|
|
res = _run_install_guard(studio_home, redirect = "default")
|
|
assert res.returncode == 0, res.stderr
|
|
assert "RESULT=ok" in res.stdout
|
|
assert not (studio_home / "unsloth_studio").exists()
|
|
|
|
|
|
def test_install_ps1_has_matching_env_mode_guard():
|
|
src = INSTALL_PS1.read_text()
|
|
block_start = src.index("if (Test-Path -LiteralPath $VenvPython)")
|
|
block = src[block_start : block_start + 2000]
|
|
assert (
|
|
"$StudioRedirectMode -eq 'env'" in block
|
|
), "install.ps1 must gate Remove-Item $VenvDir on env-mode"
|
|
assert "share\\studio.conf" in block, "install.ps1 guard must check share\\studio.conf sentinel"
|
|
assert "bin\\unsloth.exe" in block, "install.ps1 guard must check bin\\unsloth.exe sentinel"
|
|
assert "Refusing to delete non-Unsloth venv" in block
|
|
|
|
|
|
def test_setup_ps1_has_writability_probe():
|
|
src = SETUP_PS1.read_text()
|
|
idx = src.index("if (Test-Path -LiteralPath $_studioOverride -PathType Container)")
|
|
block = src[idx : idx + 2000]
|
|
assert (
|
|
"WriteAllText" in block
|
|
), "setup.ps1 must write-probe UNSLOTH_STUDIO_HOME like setup.sh:417"
|
|
assert (
|
|
"is not writable" in block
|
|
), "setup.ps1 probe failure must produce a clear writable-error message"
|
|
|
|
|
|
def test_env_mode_blocks_when_bin_unsloth_is_a_directory(tmp_path):
|
|
"""A bare directory at bin/unsloth must NOT pass the sentinel (regression: `-e` accepted any type)."""
|
|
studio_home = tmp_path / "ws"
|
|
venv = studio_home / "unsloth_studio"
|
|
(venv / "bin").mkdir(parents = True)
|
|
py = venv / "bin" / "python"
|
|
py.write_text("#!/bin/sh\nexit 0\n")
|
|
py.chmod(0o755)
|
|
(venv / "important.txt").write_text("keep me")
|
|
(studio_home / "bin" / "unsloth").mkdir(parents = True)
|
|
script = _build_install_guard_script(studio_home, "env")
|
|
res = subprocess.run(
|
|
["bash", "-c", script],
|
|
env = {"PATH": "/usr/bin:/bin"},
|
|
text = True,
|
|
capture_output = True,
|
|
)
|
|
assert res.returncode != 0, (
|
|
"directory at bin/unsloth must NOT satisfy the Unsloth sentinel; "
|
|
f"stdout={res.stdout!r} stderr={res.stderr!r}"
|
|
)
|
|
assert (venv / "important.txt").is_file(), "unrelated workspace data must survive"
|
|
|
|
|
|
def test_env_mode_passes_when_bin_unsloth_is_a_symlink(tmp_path):
|
|
"""A symlink at bin/unsloth (real installer artefact) must still satisfy the sentinel."""
|
|
studio_home = tmp_path / "ws"
|
|
venv = studio_home / "unsloth_studio"
|
|
(venv / "bin").mkdir(parents = True)
|
|
py = venv / "bin" / "python"
|
|
py.write_text("#!/bin/sh\nexit 0\n")
|
|
py.chmod(0o755)
|
|
(studio_home / "bin").mkdir(parents = True)
|
|
target = studio_home / "bin" / "unsloth-real"
|
|
target.write_text("#!/bin/sh\nexit 0\n")
|
|
target.chmod(0o755)
|
|
(studio_home / "bin" / "unsloth").symlink_to(target)
|
|
script = _build_install_guard_script(studio_home, "env")
|
|
res = subprocess.run(
|
|
["bash", "-c", script],
|
|
env = {"PATH": "/usr/bin:/bin"},
|
|
text = True,
|
|
capture_output = True,
|
|
)
|
|
assert res.returncode == 0, res.stderr
|
|
assert "RESULT=ok" in res.stdout
|
|
assert not venv.exists()
|
|
|
|
|
|
def test_install_ps1_sentinel_uses_pathtype_leaf():
|
|
"""Remove-Item $VenvDir gate must use -PathType Leaf so a sentinel-path directory cannot satisfy it."""
|
|
src = INSTALL_PS1.read_text()
|
|
block_start = src.index("if (Test-Path -LiteralPath $VenvPython)")
|
|
block = src[block_start : block_start + 2000]
|
|
assert (
|
|
'share\\studio.conf") -PathType Leaf' in block
|
|
), "install.ps1 share\\studio.conf check must use -PathType Leaf"
|
|
assert (
|
|
'bin\\unsloth.exe") -PathType Leaf' in block
|
|
), "install.ps1 bin\\unsloth.exe check must use -PathType Leaf"
|
|
|
|
|
|
def test_setup_ps1_stale_venv_has_env_mode_guard():
|
|
"""setup.ps1 stale-venv branch must gate Remove-Item $VenvDir on a custom-root Unsloth sentinel."""
|
|
src = SETUP_PS1.read_text()
|
|
idx = src.index("Stale venv detected")
|
|
block = src[idx : idx + 1500]
|
|
assert (
|
|
"$StudioHomeIsCustom" in block
|
|
), "setup.ps1 stale-venv branch must gate on $StudioHomeIsCustom"
|
|
assert (
|
|
'share\\studio.conf") -PathType Leaf' in block
|
|
), "setup.ps1 stale-venv guard must check share\\studio.conf with -PathType Leaf"
|
|
assert (
|
|
'bin\\unsloth.exe") -PathType Leaf' in block
|
|
), "setup.ps1 stale-venv guard must check bin\\unsloth.exe with -PathType Leaf"
|
|
# The guard must fire BEFORE the destructive call.
|
|
guard_idx = block.index("$StudioHomeIsCustom")
|
|
rm_idx = block.index("Remove-Item -LiteralPath $VenvDir")
|
|
assert guard_idx < rm_idx, "custom-root guard must precede Remove-Item -LiteralPath $VenvDir"
|
|
|
|
|
|
def test_setup_sh_prebuilt_llama_cpp_has_ownership_guard():
|
|
"""setup.sh prebuilt llama.cpp path must _assert_studio_owned_or_absent before install_llama_prebuilt.py."""
|
|
src = SETUP_SH.read_text()
|
|
idx = src.index("installing prebuilt llama.cpp...")
|
|
block = src[idx : idx + 2000]
|
|
assert (
|
|
'_assert_studio_owned_or_absent "$LLAMA_CPP_DIR" "llama.cpp install"' in block
|
|
), "setup.sh must guard the prebuilt llama.cpp path with the ownership marker"
|
|
guard_idx = block.index('_assert_studio_owned_or_absent "$LLAMA_CPP_DIR"')
|
|
# Anchor on the actual command-array entry, not the why-comment mention.
|
|
helper_idx = block.index('python "$SCRIPT_DIR/install_llama_prebuilt.py"')
|
|
assert guard_idx < helper_idx, "ownership guard must precede the install_llama_prebuilt.py call"
|
|
|
|
|
|
def test_setup_ps1_prebuilt_llama_cpp_has_ownership_guard():
|
|
"""setup.ps1 prebuilt llama.cpp path must Assert-StudioOwnedOrAbsent before install_llama_prebuilt.py."""
|
|
src = SETUP_PS1.read_text()
|
|
idx = src.index("installing prebuilt llama.cpp bundle (preferred path)")
|
|
block = src[idx : idx + 2000]
|
|
assert (
|
|
'Assert-StudioOwnedOrAbsent -Path $LlamaCppDir -Label "llama.cpp install"' in block
|
|
), "setup.ps1 must guard the prebuilt llama.cpp path with Assert-StudioOwnedOrAbsent"
|
|
guard_idx = block.index("Assert-StudioOwnedOrAbsent -Path $LlamaCppDir")
|
|
# Anchor on the actual command-array entry, not the why-comment mention.
|
|
helper_idx = block.index('"$PSScriptRoot\\install_llama_prebuilt.py"')
|
|
assert (
|
|
guard_idx < helper_idx
|
|
), "Assert-StudioOwnedOrAbsent must precede the install_llama_prebuilt.py call"
|
|
|
|
|
|
def test_setup_ps1_adopts_existing_whisper_prebuilt_marker():
|
|
text = SETUP_PS1.read_text(encoding = "utf-8")
|
|
helper_start = text.index("function Test-StudioOwnedAdoptable")
|
|
helper_end = text.index("function Assert-StudioOwnedOrAbsent", helper_start)
|
|
helper = text[helper_start:helper_end]
|
|
assert "UNSLOTH_WHISPER_PREBUILT_INFO.json" in helper
|
|
|
|
|
|
def test_env_mode_passes_when_venv_marker_present(tmp_path):
|
|
"""install.sh env-mode guard must accept the in-VENV .unsloth-studio-owned marker as a sentinel."""
|
|
studio_home = tmp_path / "ws"
|
|
res = _run_install_guard(studio_home, redirect = "env", create_venv_marker = True)
|
|
assert res.returncode == 0, (
|
|
f"in-VENV marker must allow cleanup; " f"stdout={res.stdout!r} stderr={res.stderr!r}"
|
|
)
|
|
assert "RESULT=ok" in res.stdout
|
|
assert not (studio_home / "unsloth_studio").exists()
|
|
|
|
|
|
def test_env_mode_blocks_when_bin_unsloth_is_symlink_to_directory(tmp_path):
|
|
"""install.sh guard must reject a symlink-to-directory at bin/unsloth; only -f (file/symlink-to-file) counts."""
|
|
studio_home = tmp_path / "ws"
|
|
venv = studio_home / "unsloth_studio"
|
|
(venv / "bin").mkdir(parents = True)
|
|
py = venv / "bin" / "python"
|
|
py.write_text("#!/bin/sh\nexit 0\n")
|
|
py.chmod(0o755)
|
|
(venv / "important.txt").write_text("keep me")
|
|
(studio_home / "bin").mkdir(parents = True)
|
|
target_dir = studio_home / "bin" / "unsloth-target-dir"
|
|
target_dir.mkdir()
|
|
(studio_home / "bin" / "unsloth").symlink_to(target_dir)
|
|
script = _build_install_guard_script(studio_home, "env")
|
|
res = subprocess.run(
|
|
["bash", "-c", script],
|
|
env = {"PATH": "/usr/bin:/bin"},
|
|
text = True,
|
|
capture_output = True,
|
|
)
|
|
assert res.returncode != 0, (
|
|
"symlink-to-directory at bin/unsloth must NOT pass; "
|
|
f"stdout={res.stdout!r} stderr={res.stderr!r}"
|
|
)
|
|
assert (venv / "important.txt").is_file(), "unrelated workspace data must survive"
|
|
|
|
|
|
def test_env_mode_blocks_when_bin_unsloth_is_broken_symlink(tmp_path):
|
|
"""install.sh guard must reject a broken symlink at bin/unsloth."""
|
|
studio_home = tmp_path / "ws"
|
|
venv = studio_home / "unsloth_studio"
|
|
(venv / "bin").mkdir(parents = True)
|
|
py = venv / "bin" / "python"
|
|
py.write_text("#!/bin/sh\nexit 0\n")
|
|
py.chmod(0o755)
|
|
(venv / "important.txt").write_text("keep me")
|
|
(studio_home / "bin").mkdir(parents = True)
|
|
(studio_home / "bin" / "unsloth").symlink_to(studio_home / "bin" / "does-not-exist")
|
|
script = _build_install_guard_script(studio_home, "env")
|
|
res = subprocess.run(
|
|
["bash", "-c", script],
|
|
env = {"PATH": "/usr/bin:/bin"},
|
|
text = True,
|
|
capture_output = True,
|
|
)
|
|
assert res.returncode != 0, (
|
|
"broken symlink at bin/unsloth must NOT pass; "
|
|
f"stdout={res.stdout!r} stderr={res.stderr!r}"
|
|
)
|
|
assert (venv / "important.txt").is_file()
|
|
|
|
|
|
def test_install_sh_writes_venv_marker_after_uv_venv():
|
|
"""install.sh must write .unsloth-studio-owned into $VENV_DIR right after `uv venv` succeeds."""
|
|
src = INSTALL_SH.read_text()
|
|
create_idx = src.index('run_install_cmd "create venv" uv venv "$VENV_DIR"')
|
|
tail = src[create_idx : create_idx + 600]
|
|
assert (
|
|
".unsloth-studio-owned" in tail
|
|
), "install.sh must write .unsloth-studio-owned after uv venv create"
|
|
|
|
|
|
def test_install_ps1_writes_venv_marker_after_uv_venv():
|
|
"""install.ps1 must write .unsloth-studio-owned into $VenvDir after `uv venv` succeeds."""
|
|
src = INSTALL_PS1.read_text()
|
|
venv_create = src.index("uv venv $VenvDir --python")
|
|
tail = src[venv_create : venv_create + 1500]
|
|
assert (
|
|
".unsloth-studio-owned" in tail
|
|
), "install.ps1 must write .unsloth-studio-owned after uv venv create"
|
|
|
|
|
|
def test_install_ps1_guard_accepts_venv_marker():
|
|
"""install.ps1 env-mode guard must accept the in-VENV .unsloth-studio-owned marker as a sentinel."""
|
|
src = INSTALL_PS1.read_text()
|
|
block_start = src.index("if (Test-Path -LiteralPath $VenvPython)")
|
|
block = src[block_start : block_start + 2000]
|
|
assert (
|
|
'$VenvDir ".unsloth-studio-owned") -PathType Leaf' in block
|
|
), "install.ps1 guard must check the in-VENV marker with -PathType Leaf"
|
|
|
|
|
|
def test_setup_helpers_gate_on_canonical_custom_root():
|
|
"""setup.sh/setup.ps1 ownership guards must gate on a canonical custom-vs-legacy root comparison."""
|
|
sh_src = SETUP_SH.read_text()
|
|
sh_idx = sh_src.index("_assert_studio_owned_or_absent() {")
|
|
sh_func = sh_src[sh_idx : sh_idx + 600]
|
|
assert (
|
|
'"$_STUDIO_HOME_IS_CUSTOM" = true' in sh_func
|
|
), "setup.sh _assert_studio_owned_or_absent must gate on _STUDIO_HOME_IS_CUSTOM"
|
|
assert (
|
|
"_LEGACY_STUDIO_HOME=" in sh_src
|
|
and "_studio_home_canon=" in sh_src
|
|
and "_STUDIO_HOME_IS_CUSTOM=" in sh_src
|
|
), "setup.sh must compute the canonical custom-root flag"
|
|
|
|
ps_src = SETUP_PS1.read_text()
|
|
ps_idx = ps_src.index("function Assert-StudioOwnedOrAbsent")
|
|
ps_func = ps_src[ps_idx : ps_idx + 800]
|
|
assert (
|
|
"$StudioHomeIsCustom -and" in ps_func
|
|
), "setup.ps1 Assert-StudioOwnedOrAbsent must gate on $StudioHomeIsCustom"
|
|
assert (
|
|
"$StudioOwnedMarker) -PathType Leaf" in ps_func
|
|
), "setup.ps1 marker check must use -PathType Leaf so a directory cannot satisfy it"
|
|
|
|
|
|
def test_setup_ps1_inplace_git_sync_marks_studio_owned():
|
|
"""setup.ps1 in-place git-sync branch must Mark-StudioOwned after a successful sync."""
|
|
src = SETUP_PS1.read_text()
|
|
inplace_idx = src.index('Test-Path -LiteralPath (Join-Path $LlamaCppDir ".git")')
|
|
# The in-place branch ends just before the temp-dir clone branch.
|
|
clone_idx = src.index("Cloning llama.cpp @", inplace_idx)
|
|
inplace_block = src[inplace_idx:clone_idx]
|
|
assert (
|
|
"Mark-StudioOwned -Path $LlamaCppDir" in inplace_block
|
|
), "in-place git-sync branch must call Mark-StudioOwned on success"
|
|
assert (
|
|
"$StudioHomeIsCustom" in inplace_block
|
|
), "in-place Mark-StudioOwned call should be gated on $StudioHomeIsCustom"
|
|
|
|
|
|
def test_setup_ps1_inplace_git_sync_asserts_studio_owned_before_mutation():
|
|
"""setup.ps1 in-place git-sync must Assert-StudioOwnedOrAbsent before any destructive git op."""
|
|
src = SETUP_PS1.read_text()
|
|
inplace_idx = src.index('Test-Path -LiteralPath (Join-Path $LlamaCppDir ".git")')
|
|
clone_idx = src.index("Cloning llama.cpp @", inplace_idx)
|
|
inplace_block = src[inplace_idx:clone_idx]
|
|
assert (
|
|
"Assert-StudioOwnedOrAbsent -Path $LlamaCppDir" in inplace_block
|
|
), "in-place git-sync must Assert-StudioOwnedOrAbsent before mutating $LlamaCppDir"
|
|
guard_idx = inplace_block.index("Assert-StudioOwnedOrAbsent -Path $LlamaCppDir")
|
|
git_idx = inplace_block.index("git -C $LlamaCppDir remote set-url")
|
|
assert guard_idx < git_idx, "Assert-StudioOwnedOrAbsent must precede the first git mutation"
|
|
|
|
|
|
def _extract_check_health_function() -> str:
|
|
src = INSTALL_SH.read_text()
|
|
fn_start = src.index("_check_health() {")
|
|
fn_end = src.index("\n}\n", fn_start) + 2
|
|
return src[fn_start:fn_end]
|
|
|
|
|
|
def _run_check_health(expected_root_id: str, response_json: str) -> int:
|
|
fn = _extract_check_health_function()
|
|
script = (
|
|
f"_EXPECTED_STUDIO_ROOT_ID={expected_root_id!r}\n"
|
|
"_http_get() { printf '%s' \"$1\"; }\n"
|
|
+ fn.replace(
|
|
'_resp=$(_http_get "http://127.0.0.1:$_port/api/health") || return 1',
|
|
f"_resp={response_json!r}",
|
|
)
|
|
+ "\n_check_health 8888\n"
|
|
"echo rc=$?\n"
|
|
)
|
|
res = subprocess.run(
|
|
["bash", "-c", script],
|
|
env = {"PATH": "/usr/bin:/bin"},
|
|
text = True,
|
|
capture_output = True,
|
|
)
|
|
rc_lines = [l for l in res.stdout.splitlines() if l.startswith("rc=")]
|
|
return int(rc_lines[0].split("=")[1]) if rc_lines else res.returncode
|
|
|
|
|
|
def test_check_health_accepts_matching_studio_root_id():
|
|
"""Matching baked studio_root_id lets the launcher attach to its own backend."""
|
|
expected_id = "a" * 64
|
|
rc = _run_check_health(
|
|
expected_id,
|
|
f'{{"status":"healthy","service":"Unsloth UI Backend","studio_root_id":"{expected_id}"}}',
|
|
)
|
|
assert rc == 0, f"matching studio_root_id must allow attach (rc={rc})"
|
|
|
|
|
|
def test_check_health_rejects_mismatched_studio_root_id():
|
|
"""Mismatched studio_root_id rejects attach (workspace isolation across same-port Studios)."""
|
|
expected_id = "a" * 64
|
|
other_id = "b" * 64
|
|
rc = _run_check_health(
|
|
expected_id,
|
|
f'{{"status":"healthy","service":"Unsloth UI Backend","studio_root_id":"{other_id}"}}',
|
|
)
|
|
assert rc != 0, "mismatched studio_root_id must reject attach (workspace isolation)"
|
|
|
|
|
|
def test_check_health_rejects_missing_studio_root_id_field():
|
|
"""A backend omitting studio_root_id must not be attached when an expected id is baked in."""
|
|
expected_id = "a" * 64
|
|
rc = _run_check_health(
|
|
expected_id,
|
|
'{"status":"healthy","service":"Unsloth UI Backend"}',
|
|
)
|
|
assert rc != 0, "missing studio_root_id field must reject attach"
|
|
|
|
|
|
def test_check_health_no_baked_id_accepts_any_healthy_backend():
|
|
"""Empty _EXPECTED_STUDIO_ROOT_ID falls back to legacy contract: accept any healthy Unsloth backend."""
|
|
rc = _run_check_health(
|
|
"",
|
|
'{"status":"healthy","service":"Unsloth UI Backend","studio_root_id":"deadbeef"}',
|
|
)
|
|
assert rc == 0, "no baked id → accept any healthy Unsloth backend"
|
|
|
|
|
|
def test_check_health_rejects_non_unsloth_service():
|
|
rc = _run_check_health(
|
|
"",
|
|
'{"status":"healthy","service":"Other UI Backend"}',
|
|
)
|
|
assert rc != 0, "non-Unsloth service must be rejected"
|
|
|
|
|
|
def test_check_health_handles_arbitrary_id_token():
|
|
"""A fully arbitrary 64-char hex install id must round-trip cleanly (hex-only, no JSON escapes)."""
|
|
expected_id = "f0" + ("ed" * 31) # 64 hex chars, not derived from any path
|
|
rc = _run_check_health(
|
|
expected_id,
|
|
f'{{"status":"healthy","service":"Unsloth UI Backend","studio_root_id":"{expected_id}"}}',
|
|
)
|
|
assert rc == 0, "arbitrary 64-hex install id must round-trip cleanly (no JSON escape issue)"
|
|
|
|
|
|
def test_install_ps1_test_studio_health_verifies_studio_root_id():
|
|
"""install.ps1 Test-StudioHealth must compare studio_root_id against baked $_ExpectedStudioRootId."""
|
|
src = INSTALL_PS1.read_text()
|
|
fn_start = src.index("function Test-StudioHealth")
|
|
fn_end = src.index("\n}\n", fn_start) + 2
|
|
fn = src[fn_start:fn_end]
|
|
assert "studio_root_id" in fn, "Test-StudioHealth must inspect the studio_root_id field"
|
|
assert (
|
|
"$_ExpectedStudioRootId" in fn
|
|
), "Test-StudioHealth must compare against the install-time baked $_ExpectedStudioRootId"
|
|
|
|
|
|
def test_install_ps1_bakes_studio_root_id_into_launcher():
|
|
"""install.ps1 must persist a CSPRNG id at share/studio_install_id and bake it as $_ExpectedStudioRootId."""
|
|
src = INSTALL_PS1.read_text()
|
|
assert "$_studioRootId" in src, "install.ps1 must compute $_studioRootId for the launcher"
|
|
assert (
|
|
'"share"' in src and "studio_install_id" in src
|
|
), "install.ps1 must persist the id at $StudioHome\\share\\studio_install_id"
|
|
assert (
|
|
"RandomNumberGenerator" in src
|
|
), "install.ps1 must seed the id from a CSPRNG (RandomNumberGenerator)"
|
|
assert (
|
|
"$_ExpectedStudioRootId" in src
|
|
), "install.ps1 must bake $_ExpectedStudioRootId into the launcher"
|
|
|
|
|
|
def test_health_endpoint_exposes_studio_root_id_not_raw_path():
|
|
"""/api/health must expose studio_root_id (hex digest), NOT the raw path (info disclosure on -H 0.0.0.0)."""
|
|
main_py = REPO_ROOT / "studio" / "backend" / "main.py"
|
|
src = main_py.read_text()
|
|
health_idx = src.index('@app.get("/api/health")')
|
|
# Slice up to the next top-level @app. so a growing body stays in scope.
|
|
next_app_idx = src.find("\n@app.", health_idx + 1)
|
|
if next_app_idx == -1:
|
|
next_app_idx = len(src)
|
|
health_block = src[health_idx:next_app_idx]
|
|
assert '"studio_root_id"' in health_block, "/api/health must expose studio_root_id (hex digest)"
|
|
assert (
|
|
'"studio_root":' not in health_block
|
|
), "/api/health must NOT expose the raw studio_root path (information disclosure)"
|
|
assert "_studio_root_id()" in health_block, "/api/health must call the _studio_root_id helper"
|
|
|
|
|
|
def test_install_sh_bakes_studio_root_id_into_launcher():
|
|
"""install.sh must persist the id at share/studio_install_id and bake it into the launcher for ALL modes."""
|
|
src = INSTALL_SH.read_text()
|
|
assert (
|
|
"_css_studio_root_id" in src
|
|
), "install.sh must compute _css_studio_root_id for the launcher"
|
|
assert (
|
|
'_css_id_file="$_css_id_dir/studio_install_id"' in src
|
|
), "install.sh must persist the id at $STUDIO_HOME/share/studio_install_id"
|
|
assert (
|
|
"od -An -N32 -tx1 /dev/urandom" in src
|
|
), "install.sh must seed new ids from /dev/urandom (CSPRNG)"
|
|
assert (
|
|
"@@STUDIO_ROOT_ID@@" in src
|
|
), "install.sh must use @@STUDIO_ROOT_ID@@ placeholder in the launcher heredoc"
|
|
assert (
|
|
"s|@@STUDIO_ROOT_ID@@|$_css_studio_root_id|g" in src
|
|
), "install.sh must sed-substitute @@STUDIO_ROOT_ID@@ unconditionally (not just env-mode)"
|
|
|
|
|
|
def test_tauri_preflight_scrubs_studio_home_env():
|
|
"""Tauri CLI-spawn sites must env_remove UNSLOTH_STUDIO_HOME and STUDIO_HOME."""
|
|
# PR #5341 split preflight into a submodule dir; read whichever shape is on disk.
|
|
preflight_root = REPO_ROOT / "studio" / "src-tauri" / "src"
|
|
preflight_paths = [
|
|
preflight_root / "preflight.rs",
|
|
*(preflight_root / "preflight").glob("*.rs"),
|
|
]
|
|
preflight = "\n".join(p.read_text() for p in preflight_paths if p.exists())
|
|
commands = (REPO_ROOT / "studio" / "src-tauri" / "src" / "commands.rs").read_text()
|
|
# Expect 2 scrubs in preflight (run_cli_probe + probe_cli_capability), 1 in commands.
|
|
assert (
|
|
preflight.count('cmd.env_remove("UNSLOTH_STUDIO_HOME")') >= 2
|
|
), "preflight must scrub UNSLOTH_STUDIO_HOME in both run_cli_probe and probe_cli_capability"
|
|
assert (
|
|
preflight.count('cmd.env_remove("STUDIO_HOME")') >= 2
|
|
), "preflight must scrub STUDIO_HOME in both run_cli_probe and probe_cli_capability"
|
|
assert (
|
|
'cmd.env_remove("UNSLOTH_STUDIO_HOME")' in commands
|
|
), "commands.rs check_install_status must scrub UNSLOTH_STUDIO_HOME"
|
|
assert (
|
|
'cmd.env_remove("STUDIO_HOME")' in commands
|
|
), "commands.rs check_install_status must scrub STUDIO_HOME"
|
|
|
|
|
|
def test_install_sh_shim_uses_atomic_replace():
|
|
"""install.sh shim install must use ln -sfn for atomic replace (rm+ln left a missing-shim window)."""
|
|
src = INSTALL_SH.read_text()
|
|
shim_idx = src.index('_shim_path="$_LOCAL_BIN/unsloth"')
|
|
block = src[shim_idx : shim_idx + 1500]
|
|
assert (
|
|
'ln -sfn "$VENV_DIR/bin/unsloth" "$_shim_path"' in block
|
|
), "install.sh must use ln -sfn for atomic shim replacement"
|
|
assert (
|
|
'rm -f -- "$_shim_path"' not in block
|
|
), "the explicit rm + ln pair must be replaced by atomic ln -sfn"
|
|
|
|
|
|
def test_install_sh_create_shortcuts_seeds_id_from_csprng_with_python_fallback(tmp_path):
|
|
"""_create_shortcuts seeds ids from /dev/urandom (python3 secrets fallback) and is re-run idempotent."""
|
|
src = INSTALL_SH.read_text()
|
|
fn_start = src.index('_css_data_dir="$DATA_DIR"')
|
|
block = src[fn_start : fn_start + 3000]
|
|
urandom_idx = block.index("od -An -N32 -tx1 /dev/urandom")
|
|
py_fallback_idx = block.index("python3 -c 'import secrets;", urandom_idx)
|
|
assert (
|
|
urandom_idx < py_fallback_idx
|
|
), "/dev/urandom must be tried before the python3 secrets fallback"
|
|
# Non-empty id file check before generation is what makes re-runs idempotent.
|
|
assert (
|
|
'if [ ! -s "$_css_id_file" ]; then' in block
|
|
), "install.sh must skip id generation when the file already has content"
|
|
|
|
# Behavioral check: run the generation block twice to confirm idempotence.
|
|
studio_home = tmp_path / "studio"
|
|
(studio_home / "share").mkdir(parents = True)
|
|
gen_script = (
|
|
f'STUDIO_HOME="{studio_home}"\n'
|
|
'_css_id_dir="$STUDIO_HOME/share"\n'
|
|
'_css_id_file="$_css_id_dir/studio_install_id"\n'
|
|
# Replicate the generation block narrowly so it fails loud on contract drift.
|
|
"gen() {\n"
|
|
' if [ ! -s "$_css_id_file" ]; then\n'
|
|
' _css_new_id=$(od -An -N32 -tx1 /dev/urandom 2>/dev/null | tr -d " \\n")\n'
|
|
' printf "%s" "$_css_new_id" > "$_css_id_file.$$.tmp"\n'
|
|
' mv "$_css_id_file.$$.tmp" "$_css_id_file"\n'
|
|
" fi\n"
|
|
' cat "$_css_id_file"\n'
|
|
"}\n"
|
|
"a=$(gen); b=$(gen)\n"
|
|
'[ "$a" = "$b" ] || { echo MISMATCH; exit 1; }\n'
|
|
'echo "ID=$a"\n'
|
|
'echo "LEN=${#a}"\n'
|
|
)
|
|
res = subprocess.run(["bash", "-c", gen_script], text = True, capture_output = True)
|
|
assert res.returncode == 0, res.stderr
|
|
out = dict(line.split("=", 1) for line in res.stdout.strip().splitlines() if "=" in line)
|
|
assert out.get("LEN") == "64", f"id must be 64 hex chars, got LEN={out.get('LEN')!r}"
|
|
assert all(
|
|
c in "0123456789abcdef" for c in out.get("ID", "")
|
|
), f"id must be lowercase hex, got {out.get('ID')!r}"
|
|
|
|
|
|
def test_install_sh_create_shortcuts_fails_fast_when_no_entropy():
|
|
"""With no entropy source, _create_shortcuts must `return 1` not bake an empty studio_root_id."""
|
|
src = INSTALL_SH.read_text()
|
|
fn_start = src.index('_css_data_dir="$DATA_DIR"')
|
|
block = src[fn_start : fn_start + 3000]
|
|
assert (
|
|
"[WARN] Cannot create launcher: no entropy source for studio_install_id" in block
|
|
), "install.sh must warn when neither urandom nor python3 is available"
|
|
assert (
|
|
"[WARN] Cannot create launcher: failed to read" in block
|
|
), "install.sh must warn when the id file read produces no content"
|
|
assert (
|
|
block.count("return 1") >= 2
|
|
), "both the no-entropy branch and the empty-read branch must `return 1`"
|
|
|
|
|
|
def test_install_sh_bakes_installed_is_env_mode_flag_in_launcher():
|
|
"""install.sh must bake the install-time mode into the launcher so a sourced studio.conf can't flip it."""
|
|
src = INSTALL_SH.read_text()
|
|
assert (
|
|
"_INSTALLED_IS_ENV_MODE='@@INSTALLED_IS_ENV_MODE@@'" in src
|
|
), "launcher heredoc must declare _INSTALLED_IS_ENV_MODE='@@INSTALLED_IS_ENV_MODE@@'"
|
|
assert "_css_is_env_mode=false" in src, "install.sh must default _css_is_env_mode to false"
|
|
assert (
|
|
'[ "$_STUDIO_HOME_REDIRECT" = "env" ] && _css_is_env_mode=true' in src
|
|
), "install.sh must set _css_is_env_mode=true only when _STUDIO_HOME_REDIRECT=env"
|
|
assert (
|
|
"s|@@INSTALLED_IS_ENV_MODE@@|$_css_is_env_mode|g" in src
|
|
), "install.sh sed pipeline must substitute @@INSTALLED_IS_ENV_MODE@@"
|
|
|
|
|
|
def test_install_sh_launcher_gates_port_file_on_baked_flag_not_runtime_env():
|
|
"""Launcher PORT_FILE/LOCK_DIR must gate on baked $_INSTALLED_IS_ENV_MODE, not runtime $UNSLOTH_STUDIO_HOME."""
|
|
src = INSTALL_SH.read_text()
|
|
heredoc_start = src.index("cat > \"$_css_launcher\" << 'LAUNCHER_EOF'")
|
|
heredoc_end = src.index("LAUNCHER_EOF\n", heredoc_start)
|
|
heredoc = src[heredoc_start:heredoc_end]
|
|
assert (
|
|
'if [ "$_INSTALLED_IS_ENV_MODE" = "true" ]; then' in heredoc
|
|
), "launcher must gate PORT_FILE/LOCK_DIR on baked _INSTALLED_IS_ENV_MODE"
|
|
port_block_start = heredoc.index('if [ "$_INSTALLED_IS_ENV_MODE" = "true" ]; then')
|
|
port_block_end = heredoc.index("\nfi\n", port_block_start) + len("\nfi\n")
|
|
port_block = heredoc[port_block_start:port_block_end]
|
|
assert 'PORT_FILE="$DATA_DIR/studio.port"' in port_block
|
|
assert (
|
|
'if [ -n "${UNSLOTH_STUDIO_HOME:-}" ]; then\n if command -v cksum' not in heredoc
|
|
), "launcher must NOT gate PORT_FILE on runtime UNSLOTH_STUDIO_HOME"
|
|
|
|
def _run_launcher_gate(installed_flag: str, runtime_env: dict) -> str:
|
|
# Run the LOCK_DIR/PORT_FILE init block in isolation.
|
|
script = (
|
|
f"_INSTALLED_IS_ENV_MODE={installed_flag!r}\n"
|
|
"DATA_DIR=/tmp/test_data_dir\n"
|
|
'LOCK_DIR="${XDG_RUNTIME_DIR:-/tmp}/unsloth-studio-launcher-$(id -u).lock"\n'
|
|
'PORT_FILE=""\n' + port_block + '\necho "PORT_FILE=$PORT_FILE"\n'
|
|
)
|
|
env = {"PATH": "/usr/bin:/bin"}
|
|
env.update(runtime_env)
|
|
res = subprocess.run(
|
|
["bash", "-c", script],
|
|
text = True,
|
|
capture_output = True,
|
|
env = env,
|
|
)
|
|
for line in res.stdout.splitlines():
|
|
if line.startswith("PORT_FILE="):
|
|
return line[len("PORT_FILE=") :]
|
|
return ""
|
|
|
|
# default-mode must keep PORT_FILE empty even if UNSLOTH_STUDIO_HOME leaks in.
|
|
assert (
|
|
_run_launcher_gate("false", {"UNSLOTH_STUDIO_HOME": "/tmp/leaked"}) == ""
|
|
), "default-mode launcher must keep PORT_FILE empty even with UNSLOTH_STUDIO_HOME in env"
|
|
# env-mode must set PORT_FILE regardless of runtime env.
|
|
assert (
|
|
_run_launcher_gate("true", {}) == "/tmp/test_data_dir/studio.port"
|
|
), "env-mode launcher must set PORT_FILE based on baked DATA_DIR"
|
|
|
|
|
|
def test_main_py_studio_root_id_caches_at_module_load():
|
|
"""_studio_root_id() must read the id once at module load and reuse it (no per-poll FS/hash work)."""
|
|
main_py = (REPO_ROOT / "studio" / "backend" / "main.py").read_text()
|
|
assert (
|
|
"_STUDIO_ROOT_ID_CACHE: str = _read_studio_install_id()" in main_py
|
|
), "main.py must populate _STUDIO_ROOT_ID_CACHE from _read_studio_install_id() at module load"
|
|
fn_idx = main_py.index("def _studio_root_id() -> str:")
|
|
next_def_idx = main_py.index("\ndef ", fn_idx + 1)
|
|
fn_block = main_py[fn_idx:next_def_idx]
|
|
assert (
|
|
"return _STUDIO_ROOT_ID_CACHE" in fn_block
|
|
), "_studio_root_id() body must return the cached value"
|
|
assert (
|
|
"read_text(" not in fn_block and "hashlib" not in fn_block
|
|
), "_studio_root_id() must NOT do filesystem or hash work on every call"
|
|
|
|
|
|
def test_main_py_read_studio_install_id_validates_hex_and_handles_missing(tmp_path, monkeypatch):
|
|
"""_read_studio_install_id returns "" for absent/empty/non-hex/wrong-length ids, else the token."""
|
|
import re
|
|
|
|
pattern = re.compile(r"^[0-9a-f]{64}$")
|
|
|
|
def _read(root: Path) -> str:
|
|
# Mirror the implementation to pin the exact accepted contract.
|
|
try:
|
|
token = (root / "share" / "studio_install_id").read_text().strip()
|
|
except (OSError, ValueError):
|
|
return ""
|
|
return token if pattern.fullmatch(token) else ""
|
|
|
|
root = tmp_path / "studio"
|
|
(root / "share").mkdir(parents = True)
|
|
|
|
# Missing file -> empty
|
|
assert _read(root) == ""
|
|
|
|
id_file = root / "share" / "studio_install_id"
|
|
# Empty file -> empty
|
|
id_file.write_text("")
|
|
assert _read(root) == ""
|
|
# Non-hex content -> empty
|
|
id_file.write_text("not-a-hex-id-just-text-padded-to-64-chars-zzzzzzzzzzzzzzzzzzzzzz")
|
|
assert _read(root) == ""
|
|
# Uppercase hex -> empty (must be lowercase)
|
|
id_file.write_text("F" * 64)
|
|
assert _read(root) == ""
|
|
# Wrong length -> empty (32 chars, not 64)
|
|
id_file.write_text("a" * 32)
|
|
assert _read(root) == ""
|
|
# Valid 64-char lowercase hex with surrounding whitespace -> stripped+accepted
|
|
valid = "0123456789abcdef" * 4
|
|
id_file.write_text(f"\n {valid} \n")
|
|
assert _read(root) == valid
|
|
|
|
|
|
def test_llama_cpp_search_roots_handles_studio_root_oserror():
|
|
"""Root resolution must catch (ImportError, OSError, ValueError) from studio_root().
|
|
Discovery (_find_llama_server_binary) and cleanup (_kill_orphaned_servers) both
|
|
delegate to the shared _resolved_studio_root_and_is_legacy() classifier, which
|
|
holds the handler so the two never disagree on which root is legacy."""
|
|
llama_cpp = (
|
|
REPO_ROOT / "studio" / "backend" / "core" / "inference" / "llama_cpp.py"
|
|
).read_text()
|
|
|
|
def _method_body(name: str) -> str:
|
|
# Whole method body (def to next sibling def) so the check survives growth.
|
|
start = llama_cpp.index(f"def {name}")
|
|
indent = " " * (start - llama_cpp.rfind("\n", 0, start) - 1)
|
|
nxt = llama_cpp.find(f"\n{indent}def ", start + 1)
|
|
return llama_cpp[start : nxt if nxt != -1 else len(llama_cpp)]
|
|
|
|
assert (
|
|
"except (ImportError, OSError, ValueError):"
|
|
in _method_body("_resolved_studio_root_and_is_legacy")
|
|
), "_resolved_studio_root_and_is_legacy must catch (ImportError, OSError, ValueError) from studio_root()"
|
|
# Both callers must route through the shared classifier so neither crashes.
|
|
for caller in ("_find_llama_server_binary", "_kill_orphaned_servers"):
|
|
assert "LlamaCppBackend._resolved_studio_root_and_is_legacy()" in _method_body(
|
|
caller
|
|
), f"{caller} must resolve the install root via the shared classifier"
|
|
|
|
|
|
def test_install_sh_install_id_survives_symlinked_studio_home(tmp_path):
|
|
"""Regression: install id read from a file (not sha256(canonical_path)) agrees under a symlinked $STUDIO_HOME."""
|
|
real = tmp_path / "realhome"
|
|
real.mkdir()
|
|
link = tmp_path / "linkhome"
|
|
link.symlink_to(real)
|
|
studio_home = real / ".unsloth" / "studio"
|
|
(studio_home / "share").mkdir(parents = True)
|
|
valid_id = "ab12" * 16
|
|
(studio_home / "share" / "studio_install_id").write_text(valid_id)
|
|
# Canonical and symlinked paths must see the SAME content (cat and read_text agree).
|
|
raw_via_link = link / ".unsloth" / "studio" / "share" / "studio_install_id"
|
|
raw_direct = studio_home / "share" / "studio_install_id"
|
|
assert raw_via_link.read_text() == valid_id
|
|
assert raw_direct.read_text() == valid_id
|
|
# install.sh's `cat` sees the same.
|
|
import subprocess as _sp
|
|
|
|
res = _sp.run(["cat", str(raw_via_link)], capture_output = True, text = True)
|
|
assert res.returncode == 0
|
|
assert res.stdout == valid_id
|
|
|
|
|
|
def test_install_sh_substitutes_root_id_before_data_dir():
|
|
"""sed must bake the non-user-controlled placeholders before @@DATA_DIR@@ so a crafted $DATA_DIR isn't mutated."""
|
|
src = INSTALL_SH.read_text()
|
|
root_id_idx = src.index("s|@@STUDIO_ROOT_ID@@|$_css_studio_root_id|g")
|
|
env_mode_idx = src.index("s|@@INSTALLED_IS_ENV_MODE@@|$_css_is_env_mode|g")
|
|
data_dir_idx = src.index("s|@@DATA_DIR@@|$_sed_safe|g")
|
|
assert root_id_idx < data_dir_idx, (
|
|
"@@STUDIO_ROOT_ID@@ substitution must happen BEFORE @@DATA_DIR@@ "
|
|
"(non-user-controlled placeholders first)"
|
|
)
|
|
assert (
|
|
env_mode_idx < data_dir_idx
|
|
), "@@INSTALLED_IS_ENV_MODE@@ substitution must happen BEFORE @@DATA_DIR@@"
|
|
|
|
|
|
def test_install_sh_root_id_pass_does_not_mutate_user_data_dir(tmp_path):
|
|
"""A $DATA_DIR containing the literal @@STUDIO_ROOT_ID@@ must survive the placeholder-first sed passes."""
|
|
src = INSTALL_SH.read_text()
|
|
heredoc_start = src.index("cat > \"$_css_launcher\" << 'LAUNCHER_EOF'")
|
|
heredoc_body_start = src.index("\n", heredoc_start) + 1
|
|
heredoc_body_end = src.index("LAUNCHER_EOF\n", heredoc_start)
|
|
template = src[heredoc_body_start:heredoc_body_end]
|
|
launcher_path = tmp_path / "launch.sh"
|
|
launcher_path.write_text(template)
|
|
# sed order: root-id first, then data-dir.
|
|
weird_data_dir = "/tmp/with-@@STUDIO_ROOT_ID@@/share"
|
|
root_id = "deadbeef" * 8
|
|
is_env = "true"
|
|
script = f"""
|
|
sed -e "s|@@STUDIO_ROOT_ID@@|{root_id}|g" \\
|
|
-e "s|@@INSTALLED_IS_ENV_MODE@@|{is_env}|g" \\
|
|
"{launcher_path}" > "{launcher_path}.tmp" && mv "{launcher_path}.tmp" "{launcher_path}"
|
|
_sq_escaped=$(printf '%s' "{weird_data_dir}" | sed "s/'/'\\\\\\\\''/g")
|
|
_sed_safe=$(printf '%s' "$_sq_escaped" | sed 's/[\\\\&|]/\\\\&/g')
|
|
sed "s|@@DATA_DIR@@|$_sed_safe|g" "{launcher_path}" > "{launcher_path}.tmp" \\
|
|
&& mv "{launcher_path}.tmp" "{launcher_path}"
|
|
"""
|
|
subprocess.run(["bash", "-c", script], check = True)
|
|
final = launcher_path.read_text()
|
|
assert (
|
|
f"DATA_DIR='{weird_data_dir}'" in final
|
|
), f"DATA_DIR must be preserved verbatim (no @@STUDIO_ROOT_ID@@ mutation); got: {final[:500]}"
|
|
assert (
|
|
f"_EXPECTED_STUDIO_ROOT_ID='{root_id}'" in final
|
|
), "STUDIO_ROOT_ID placeholder must still be substituted in the launcher heredoc"
|
|
|
|
|
|
def test_install_ps1_install_id_file_layout_matches_backend_read_path():
|
|
"""install.ps1 must write the id at share/studio_install_id where the backend reads it, idempotently."""
|
|
src = INSTALL_PS1.read_text()
|
|
id_idx = src.index('$_studioIdDir = Join-Path $StudioHome "share"')
|
|
context = src[id_idx : id_idx + 1500]
|
|
assert (
|
|
'$_studioIdFile = Join-Path $_studioIdDir "studio_install_id"' in context
|
|
), "install.ps1 must persist the id at $StudioHome\\share\\studio_install_id"
|
|
assert (
|
|
"Test-Path -LiteralPath $_studioIdFile" in context
|
|
), "install.ps1 must skip id generation when the file already has content (re-run idempotence)"
|
|
assert (
|
|
"RandomNumberGenerator" in context and "GetBytes($_idBytes)" in context
|
|
), "install.ps1 must seed new ids from a CSPRNG (RandomNumberGenerator)"
|
|
assert (
|
|
"Move-Item -LiteralPath $_idTmp" in context
|
|
), "install.ps1 must atomic-rename the temp file into place to avoid half-written ids"
|