unsloth/.github/workflows
Daniel Han 9510bba7e9 ci(mlx): use llama-server /completion for GGUF inference test
Studio's install_llama_prebuilt.py only bundles llama-server +
llama-quantize from the prebuilt (line 3677:
return ["llama-server", "llama-quantize", "lib*.dylib"]); the
upstream tarball's llama-cli is intentionally dropped because
Studio drives inference through llama-server's HTTP API, not the
CLI. Switch the CI step to:

  1. Verify both binaries are present + dynamically link
     (llama-quantize --help is a cheap loader smoke test).
  2. Start llama-server with the downloaded
     unsloth/gemma-3-270m-it-GGUF Q4_K_M model on
     127.0.0.1:18080.
  3. Wait up to 30s for /health to come up.
  4. POST a /completion request with the same fixed
     temperature=0 / seed=3407 settings used elsewhere.
  5. Assert the response's `content` field is non-empty.

This drives the same install + inference path Studio's setup.sh
takes on macOS (which already passes --published-repo
ggml-org/llama.cpp + --simple-policy) and the same runtime path
Studio's chat backend takes (HTTP /completion against
llama-server).
2026-05-07 05:01:18 +00:00
..
consolidated-tests-ci.yml CI(consolidated): set UNSLOTH_IS_PRESENT=1 so unsloth_zoo.__init__ accepts the bootstrap 2026-05-07 04:51:52 +00:00
lint-ci.yml CI: SHA-pin every action; fix 4 bugs in advisory-audit 2026-05-07 01:12:40 +00:00
mlx-ci.yml ci(mlx): use llama-server /completion for GGUF inference test 2026-05-07 05:01:18 +00:00
release-desktop.yml Fix Studio desktop tray installer and titlebar and bux fixes (#5179) 2026-04-30 08:40:39 -07:00
security-audit.yml CI: SHA-pin every action; fix 4 bugs in advisory-audit 2026-05-07 01:12:40 +00:00
stale.yml CI: SHA-pin every action; fix 4 bugs in advisory-audit 2026-05-07 01:12:40 +00:00
studio-api-smoke.yml CI(studio): fix 4 real failures surfaced by the new smoke jobs 2026-05-07 04:20:11 +00:00
studio-backend-ci.yml CI: SHA-pin every action; fix 4 bugs in advisory-audit 2026-05-07 01:12:40 +00:00
studio-frontend-ci.yml CI(studio): always-upload artifacts + gate /api/system + path/health plumbing 2026-05-07 04:09:09 +00:00
studio-inference-smoke.yml CI(studio): always-upload artifacts + gate /api/system + path/health plumbing 2026-05-07 04:09:09 +00:00
studio-tauri-smoke.yml CI(studio): always-upload artifacts + gate /api/system + path/health plumbing 2026-05-07 04:09:09 +00:00
studio-ui-smoke.yml CI(ui): add second Playwright job covering Compare/Recipes/Export/Studio/Settings 2026-05-07 04:09:09 +00:00
studio-update-smoke.yml CI(studio): always-upload artifacts + gate /api/system + path/health plumbing 2026-05-07 04:09:09 +00:00
wheel-smoke.yml CI: SHA-pin every action; fix 4 bugs in advisory-audit 2026-05-07 01:12:40 +00:00