unsloth/.github/workflows/studio-windows-update-smoke.yml
Daniel Han 00e863ed8c CI(windows): four Windows Studio CI workflows on free windows-latest + Linux chat-UI fix
Adds four Windows counterparts to the existing Mac Studio jobs, all on
the free windows-latest runner (4 vCPU / 16 GB / 14 GB SSD; no premium
SKU). Mirrors the Mac coverage 1:1 in name and assertion shape so the
PR-status grid reads "Mac Studio * = Windows Studio *":

  studio-windows-ui-smoke.yml         -> "Windows Studio UI CI"
  studio-windows-inference-smoke.yml  -> "Windows Studio GGUF CI" (3 jobs)
  studio-windows-update-smoke.yml     -> "Windows Studio Update CI"
  studio-windows-api-smoke.yml        -> "Windows Studio API CI"

Key Windows differences vs the Mac mirrors:
  * runs-on: windows-latest (free public runner)
  * defaults.run.shell: bash so curl / jq / heredoc steps go through
    Git Bash (windows-latest's default shell is pwsh)
  * Install step uses pwsh + ./install.ps1 --local --no-torch (NOT
    bash install.sh; install.sh has no Windows branch and would hit
    apt-get / brew calls). install.ps1 is Studio's documented Windows
    installer and is exercised by release-desktop.yml today.
  * Asserter looks for bin-win-cpu-x64 (the prebuilt that
    windows-latest, no GPU, hits via studio/install_llama_prebuilt.py
    line 1272). Source-build fallback is rejected as a Studio bug.
  * setup-python: drop cache:'pip' across all four (install.ps1 +
    setup.ps1 use uv; setup-python's post-step otherwise fatal-errors
    with "Cache folder path is retrieved for pip but doesn't exist").
  * api-smoke: do NOT pin STUDIO_AUTH_DIR (Mac mirror hardcodes
    /Users/runner/...). studio_api_smoke.py defaults to
    Path.home()/'.unsloth'/'studio'/'auth' which resolves correctly
    on every OS.
  * inference-smoke: drop the Linux-only `ss -tln` diagnostic line.

No code changes to install.ps1, setup.ps1, install_llama_prebuilt.py,
or unsloth_cli/commands/studio.py -- Windows is already fully wired
in those (~30 host.is_windows branches in the prebuilt installer +
three sys.platform=='win32' branches in the Studio CLI).

Also fixes the Linux Chat UI Tests "extra turn" timeout (run
25487410101 / job 74786523982). The send_and_wait predicate used
non-empty assistant bubble count vs a baseline. When gemma-3-270m
emitted an empty turn (legitimate model output), the empty bubble
counted toward total but NOT toward the non-empty baseline, and the
next turn's wait expected nonempty >= baseline + 1 forever -- never
satisfied. Refactor:

  * Snapshot TOTAL bubble count before send (proves new placeholder
    rendered, regardless of content).
  * Wait for Send-button-attached AND Stop-button-detached as the
    "previous turn finished" signal.
  * Treat empty bubbles as legitimate model output, not test failure.
  * Add page.on('response') listener for /v1/chat/completions and
    log status distribution + 4xx count after the 5-turn loop, so a
    flake is debuggable from the CI log without artifact spelunking.
2026-05-07 09:59:12 +00:00

157 lines
6.1 KiB
YAML

# SPDX-License-Identifier: AGPL-3.0-only
# Copyright 2026-present the Unsloth AI Inc. team. All rights reserved.
# Windows counterpart to studio-update-smoke.yml /
# studio-mac-update-smoke.yml. Verifies that on the FREE
# windows-latest runner:
#
# 1. install.ps1 --local --no-torch installs Studio AND auto-fetches
# the prebuilt llama.cpp Windows binary (llama-bNNNN-bin-win-cpu-
# x64 from ggml-org/llama.cpp). Hitting the source-build fallback
# is treated as an Unsloth bug -- Studio must always pick the
# prebuilt on Windows.
# 2. unsloth studio update --local is idempotent. Two consecutive
# runs both report "prebuilt up to date and validated", no
# source-build fallback. The CLI's _find_setup_script picks
# setup.ps1 on Windows automatically.
# 3. The installed Studio still boots and /api/health returns
# healthy after the update path.
name: Windows Studio Update CI
on:
pull_request:
paths:
- 'install.ps1'
- 'studio/setup.ps1'
- 'studio/setup.bat'
- 'studio/install_python_stack.py'
- 'studio/install_llama_prebuilt.py'
- 'studio/backend/requirements/**'
- 'unsloth_cli/commands/studio.py'
- 'pyproject.toml'
- '.github/workflows/studio-windows-update-smoke.yml'
push:
branches: [main, pip]
workflow_dispatch:
concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true
permissions:
contents: read
jobs:
update-idempotency:
name: Studio Updating Tests
runs-on: windows-latest
timeout-minutes: 30
defaults:
run:
shell: bash
steps:
- uses: actions/checkout@34e114876b0b11c390a56381ad16ebd13914f8d5 # v4.3.1
- uses: actions/setup-node@49933ea5288caeca8642d1e84afbd3f7d6820020 # v4.4.0
with:
node-version: '22'
cache: 'npm'
cache-dependency-path: studio/frontend/package-lock.json
- uses: actions/setup-python@a26af69be951a213d495a4c3e4e4022e16d87065 # v5.6.0
with:
python-version: '3.12'
# Don't cache pip: install.ps1 + setup.ps1 go through uv
# and never populate ~/.cache/pip; setup-python's post-step
# then fatal-errors with "Cache folder path is retrieved
# for pip but doesn't exist on disk".
- name: Install Studio (--local, --no-torch)
shell: pwsh
env:
GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}
run: |
New-Item -ItemType Directory -Force -Path logs | Out-Null
& ./install.ps1 --local --no-torch 2>&1 | Tee-Object -FilePath logs/install.log
- name: Assert install.ps1 used the Windows llama.cpp prebuilt
run: |
if grep -q "falling back to source build" logs/install.log; then
echo "::error::install.ps1 fell back to source-build llama.cpp on Windows. Studio must install the prebuilt llama-bNNNN-bin-win-cpu-x64 on Windows."
grep -E "llama-prebuilt|llama.cpp" logs/install.log | tail -60
exit 1
fi
if ! grep -qE "prebuilt installed and validated|prebuilt up to date and validated|bin-win-cpu-x64|bin-win-cuda-" logs/install.log; then
echo "::error::no Windows prebuilt llama.cpp marker in install.log."
grep -E "llama-prebuilt|llama.cpp" logs/install.log | tail -60
exit 1
fi
echo "install.ps1 installed the Windows prebuilt llama.cpp"
- name: First update should be a no-op (prebuilt already validated)
env:
GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}
run: |
set -o pipefail
unsloth studio update --local 2>&1 | tee logs/update.log
if grep -q "falling back to source build" logs/update.log; then
echo "::error::studio update fell back to source-build llama.cpp on Windows."
grep -E "llama-prebuilt|llama.cpp" logs/update.log | tail -60
exit 1
fi
if ! grep -qE "prebuilt up to date and validated|prebuilt installed and validated" logs/update.log; then
echo "::error::no prebuilt up-to-date marker in update.log."
grep -E "llama-prebuilt|llama.cpp" logs/update.log | tail -60
exit 1
fi
echo "update path took the prebuilt fast path"
- name: Second update must also be a no-op
env:
GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}
run: |
set -o pipefail
unsloth studio update --local 2>&1 | tee logs/update2.log
grep -q "falling back to source build" logs/update2.log && {
echo "::error::second update fell back to source build on Windows"
tail -60 logs/update2.log; exit 1; } || true
grep -qE "prebuilt up to date and validated|prebuilt installed and validated" logs/update2.log
echo "second update was clean"
- name: Boot Studio briefly to confirm the install is still usable
run: |
mkdir -p logs
UNSLOTH_API_ONLY=1 unsloth studio -H 127.0.0.1 -p 18891 \
> logs/studio.log 2>&1 &
PID=$!
HEALTHY=""
for i in $(seq 1 60); do
if curl -fs http://127.0.0.1:18891/api/health > /tmp/health.json; then
if python -c "import json,sys; d=json.load(open('/tmp/health.json')); sys.exit(0 if d.get('status')=='healthy' else 1)"; then
HEALTHY=1
break
fi
fi
sleep 1
done
if [ -z "$HEALTHY" ]; then
echo "Studio failed to come up after \`update\`"
tail -200 logs/studio.log
kill "$PID" 2>/dev/null || true
exit 1
fi
kill "$PID" 2>/dev/null || true
echo "post-update Studio /api/health OK"
- name: Upload update logs
if: always()
uses: actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02 # v4.6.2
with:
name: windows-studio-update-log
path: |
logs/install.log
logs/update.log
logs/update2.log
logs/studio.log
retention-days: 7