9ca7be82c4
Comment-only pass over the PR's own files. No executable line changes. - Dockerfile / Dockerfile.studio: drop the decorative stage banner rules, the stale "5)" / "6)" step numbering, and the entrypoint pre-flight list that restated (and had drifted from) entrypoint.sh's own accurate header. Cut the llama.cpp asset bullet list that repeats fetch_llama_prebuilt.py's docstring and the structlog rationale already spelled out at the install site. - entrypoint.sh / studio_launch.sh: fold the section banners into the explanation lines that follow them. - docker-publish.yml: remove the comment rule lines around the job headers. - validate_studio_features.py: same for the numbered section headers. - smoke_test.py: drop the stale "~125M params" note on a 1B model. - unsloth_branding.py, unsloth_nb_view.py, unsloth_nb_pip_magic.py, colabTitle.ts: remove comments that restate the adjacent line.
118 lines
5.3 KiB
Bash
118 lines
5.3 KiB
Bash
#!/usr/bin/env bash
|
|
# Default CMD of the full Unsloth image (Dockerfile.studio).
|
|
#
|
|
# Bootstraps the three services managed by supervisord:
|
|
# studio port 8000 first-boot admin password printed in `docker logs`
|
|
# jupyter port 8888 password from JUPYTER_PASSWORD, or a random one
|
|
# printed in `docker logs` when unset
|
|
# sshd port 22 key-only; enabled when PUBLIC_KEY / SSH_KEY is set
|
|
#
|
|
# Environment:
|
|
# JUPYTER_PORT Jupyter port inside the container (default 8888)
|
|
# JUPYTER_PASSWORD Jupyter login password (unset: generated and printed)
|
|
# PUBLIC_KEY/SSH_KEY OpenSSH public key for root login; sshd stays disabled
|
|
# when neither is set (nothing to authenticate with --
|
|
# password login is never enabled for root)
|
|
set -euo pipefail
|
|
|
|
export JUPYTER_PORT="${JUPYTER_PORT:-8888}"
|
|
export UNSLOTH_STUDIO_HOME="${UNSLOTH_STUDIO_HOME:-/opt/unsloth-studio}"
|
|
# Default off so supervisord's %(ENV_UNSLOTH_JUPYTER_CLOUDFLARE)s autostart gate
|
|
# resolves; set to 1 (docker run -e) to expose JupyterLab on a trycloudflare URL.
|
|
export UNSLOTH_JUPYTER_CLOUDFLARE="${UNSLOTH_JUPYTER_CLOUDFLARE:-0}"
|
|
|
|
# Make the runtime env visible to SSH login shells (which lack the `docker run -e`
|
|
# vars). Secrets are excluded on purpose -- they stay in process env, never on
|
|
# disk. shlex.quote() each value since this file is sourced by every login shell.
|
|
python - > /etc/profile.d/unsloth_env.sh <<'PY' || true
|
|
import os, re, shlex
|
|
keep = re.compile(r"^(HF_|CUDA_|NCCL_|JUPYTER_|UNSLOTH_|WANDB_|TRITON_)|^PATH$")
|
|
secret = re.compile(r"(_TOKEN|_API_KEY|_PASSWORD|_SECRET|_LICENSE)$")
|
|
for key, value in sorted(os.environ.items()):
|
|
if keep.search(key) and not secret.search(key):
|
|
print(f"export {key}={shlex.quote(value)}")
|
|
PY
|
|
|
|
# Hash the Jupyter password with jupyter's helper; never store plaintext. No fixed
|
|
# default: when JUPYTER_PASSWORD is unset, generate a random one and print it once.
|
|
JUPYTER_CONFIG_DIR=/root/.jupyter
|
|
JUPYTER_NOTE="password from JUPYTER_PASSWORD env"
|
|
if [[ -f "${JUPYTER_CONFIG_DIR}/jupyter_lab_config.py" ]]; then
|
|
JUPYTER_NOTE="existing jupyter config reused"
|
|
else
|
|
if [[ -z "${JUPYTER_PASSWORD:-}" ]]; then
|
|
JUPYTER_PASSWORD="$(python -c 'import secrets; print(secrets.token_urlsafe(12))')"
|
|
JUPYTER_NOTE="generated password: ${JUPYTER_PASSWORD}"
|
|
fi
|
|
export JUPYTER_PASSWORD
|
|
mkdir -p "${JUPYTER_CONFIG_DIR}"
|
|
HASH=$(python - <<PY
|
|
from jupyter_server.auth import passwd
|
|
import os
|
|
print(passwd(os.environ["JUPYTER_PASSWORD"]))
|
|
PY
|
|
)
|
|
cat > "${JUPYTER_CONFIG_DIR}/jupyter_lab_config.py" <<EOF
|
|
c.ServerApp.ip = "0.0.0.0"
|
|
c.ServerApp.open_browser = False
|
|
c.ServerApp.root_dir = "/workspace"
|
|
c.PasswordIdentityProvider.hashed_password = "${HASH}"
|
|
EOF
|
|
# Land in the categorized notebook view, but only when it's enabled AND under
|
|
# root_dir (expressible as /lab/tree). Mirror unsloth_sync_notebooks.sh's
|
|
# gating so a relocated/disabled/unsynced view never points at a missing dir.
|
|
_root_dir="/workspace"
|
|
_view_dir="${UNSLOTH_NOTEBOOKS_VIEW_DIR:-/workspace/Unsloth Notebooks}"
|
|
if [[ "${UNSLOTH_SKIP_NOTEBOOK_VIEW:-0}" != "1" \
|
|
&& "${UNSLOTH_SKIP_NOTEBOOK_SYNC:-0}" != "1" \
|
|
&& "${_view_dir}" == "${_root_dir}/"* ]]; then
|
|
_view_rel="${_view_dir#${_root_dir}/}"
|
|
# default_url must be set on BOTH ServerApp and LabApp (the lab app
|
|
# otherwise overrides ServerApp back to /lab). preferred_dir points the
|
|
# file browser at that folder; a literal space is URL-encoded to %20.
|
|
cat >> "${JUPYTER_CONFIG_DIR}/jupyter_lab_config.py" <<EOF
|
|
c.ServerApp.default_url = "/lab/tree/${_view_rel}"
|
|
c.LabApp.default_url = "/lab/tree/${_view_rel}"
|
|
c.ServerApp.preferred_dir = "${_view_dir}"
|
|
EOF
|
|
fi
|
|
fi
|
|
|
|
# sshd is enabled only when a public key is provided; root password login is never
|
|
# allowed. Cloud GPU platforms (e.g. runpod-style hosts) inject PUBLIC_KEY.
|
|
PUBLIC_SSH_KEY="${SSH_KEY:-${PUBLIC_KEY:-}}"
|
|
export UNSLOTH_ENABLE_SSHD=false
|
|
if [[ -n "${PUBLIC_SSH_KEY}" ]] && command -v sshd >/dev/null 2>&1; then
|
|
mkdir -p /root/.ssh && chmod 700 /root/.ssh
|
|
echo "${PUBLIC_SSH_KEY}" > /root/.ssh/authorized_keys
|
|
chmod 600 /root/.ssh/authorized_keys
|
|
ssh-keygen -A
|
|
mkdir -p /run/sshd
|
|
export UNSLOTH_ENABLE_SSHD=true
|
|
fi
|
|
|
|
mkdir -p /workspace
|
|
|
|
# This image ships under the GNU AGPLv3. Refuse to start if the Unsloth
|
|
# attribution (Help/About, splash, login, theme, AGPLv3 license + source links)
|
|
# is stripped or altered. The same checker runs as a jupyter_server extension and
|
|
# at build time. Bypass for local dev: UNSLOTH_SKIP_BRANDING_CHECK=1 (not resale).
|
|
if [[ "${UNSLOTH_SKIP_BRANDING_CHECK:-0}" != "1" ]]; then
|
|
if ! /opt/unsloth-venv/bin/python -m unsloth_branding --verify; then
|
|
echo "Refusing to start the container." >&2
|
|
exit 1
|
|
fi
|
|
fi
|
|
|
|
echo "Unsloth Studio -> http://localhost:8000 (first-boot password below)"
|
|
echo "JupyterLab -> http://localhost:${JUPYTER_PORT} (${JUPYTER_NOTE})"
|
|
if [[ "${UNSLOTH_JUPYTER_CLOUDFLARE}" == "1" ]]; then
|
|
echo "JupyterLab tunnel-> enabled; public trycloudflare URL appears below once it is up"
|
|
else
|
|
echo "JupyterLab tunnel-> off (set UNSLOTH_JUPYTER_CLOUDFLARE=1 for a public link)"
|
|
fi
|
|
if [[ "${UNSLOTH_ENABLE_SSHD}" == "true" ]]; then
|
|
echo "sshd -> port 22 (key-only)"
|
|
fi
|
|
|
|
exec supervisord -c /etc/supervisor/supervisord.conf
|