unsloth/tests/studio
Daniel Han 29f2829582 CI(studio): new Studio API & Auth Tests workflow + integration test
HTTP-level integration smoke for the Studio FastAPI surface, no
Playwright. ~30 s per run on warm cache. Boots a fresh Studio, then
asserts:

  1. CORS hardening -- no wildcard-origin + credentials=true; cross-
     origin GET / does not leak the bootstrap password to evil.example.
  2. /api/system + /api/system/hardware + /api/system/gpu-visibility
     all require auth (closes the info-disclosure leak).
  3. Auth state machine -- rotation invariants (old=401, new=200),
     refresh-without-body returns 4xx, login burst documents the
     current "no rate-limit" behaviour so future hardening updates the
     test in the same PR.
  4. JWT-expiry forgery -- mint a JWT with exp=now-1 using the install's
     own secret + assert it returns 401.
  5. API key lifecycle E2E -- create -> list -> use against
     /v1/chat/completions -> delete -> verify 401.
  6. Auth file-mode hardening (Linux only): auth/ is 0700, auth.db +
     -wal + -shm + .bootstrap_password are 0600.
  7. Inference lifecycle gaps -- /v1/models lists the loaded model,
     /v1/embeddings + /v1/responses return 200 OR structured 4xx,
     bogus gguf_variant rejected, force-reload swaps the llama-server
     PID.
  8. Endpoint-by-endpoint auth audit -- pins the EXPECTED auth posture
     for known routes; an unauthenticated /api/shutdown is rejected
     BEFORE the shutdown trigger fires.

Reuses the same GGUF cache key as studio-ui-smoke.yml so the model
download is one cache-hit across CI.

Random per-run rotated passwords + ::add-mask:: pattern matches
studio-ui-smoke.yml + studio-inference-smoke.yml.
2026-05-07 04:09:09 +00:00
..
install Add Studio PR-time CI: pin enforcement, frontend, backend, wheel smoke (#5298) 2026-05-06 04:41:57 -07:00
playwright_chat_ui.py CI(ui): STUDIO_UI_STRICT mode + theme cycle fix + Recents thread-match assertion 2026-05-07 04:09:09 +00:00
run_real_mlx_smoke.py [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-05-07 03:48:54 +00:00
test_cancel_atomicity.py Studio: make stop button actually stop generation (#5069) 2026-04-24 10:09:25 -07:00
test_cancel_id_wiring.py Studio: make stop button actually stop generation (#5069) 2026-04-24 10:09:25 -07:00
test_chat_preset_builtin_invariants.py [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-05-06 11:55:39 +00:00
test_cli_repo_variant.py Studio: forward llama-server args from unsloth studio run , activate unsloth run , and allow passing model:quant to load models (#5271) 2026-05-04 17:08:04 +04:00
test_cli_run_alias.py Studio: forward llama-server args from unsloth studio run , activate unsloth run , and allow passing model:quant to load models (#5271) 2026-05-04 17:08:04 +04:00
test_cli_studio_defaults.py Default Studio host to 127.0.0.1 and prompt before auto-start (#5267) 2026-05-04 13:03:16 +04:00
test_export_output_path_contract.py feat(studio): MLX training tab on Apple Silicon (LoRA / full FT, VLM, export) (#5265) 2026-05-05 23:54:58 -07:00
test_hardware_dispatch_matrix.py [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-05-07 03:33:12 +00:00
test_is_mlx_dispatch_gate.py feat(studio): MLX training tab on Apple Silicon (LoRA / full FT, VLM, export) (#5265) 2026-05-05 23:54:58 -07:00
test_llama_cpp_wall_clock_cap.py Studio: make stop button actually stop generation (#5069) 2026-04-24 10:09:25 -07:00
test_mlx_training_worker_behaviors.py feat(studio): MLX training tab on Apple Silicon (LoRA / full FT, VLM, export) (#5265) 2026-05-05 23:54:58 -07:00
test_stream_cancel_registration_timing.py Studio: make stop button actually stop generation (#5069) 2026-04-24 10:09:25 -07:00
test_studio_api_smoke.py CI(studio): new Studio API & Auth Tests workflow + integration test 2026-05-07 04:09:09 +00:00
test_studio_gguf_export_script_pin.py Pin Studio GGUF export to llama.cpp's local convert script (#5275) 2026-05-05 04:03:28 -07:00
test_studio_text_descender_clipping.py Studio: Fix clipped model selector text descenders (#5210) 2026-04-29 02:51:25 -07:00