unsloth/docker
Daniel Han 3e6d37cad0 docker: install vLLM on the arm64 leg too and probe it in the confirm scripts
PyPI has shipped aarch64 abi3 wheels for every vLLM release since 0.17,
so the arm64 skip rested on a stale premise. With torch held at 2.10.0
the resolver lands on vllm 0.19.1 (the release pinning torch==2.10.0)
on both arches; verified by cross-resolving the exact index set for
aarch64-unknown-linux-gnu.

amd64 keeps fail-loud semantics. arm64 is fail-soft because the aarch64
wheels are newer and their GPU kernels get validated on Spark hardware
via docker_confirm.sh rather than in CI; on failure the fallback
uninstalls vllm and restores the numpy/numba floor so a partial install
cannot break import unsloth (numpy 2.2.6 ships a broken numpy.testing).

The install steps form an explicit && chain instead of a set -e
subshell: POSIX shells disable errexit inside condition contexts
(verified on dash), so a (set -e; ...) condition would mask failures.

Both confirm scripts gain a 5b vLLM phase: ok on import, bad if missing
on x86_64, warn on other arches where fast_inference=True is best-effort.
2026-06-12 09:09:26 +00:00
..
.dockerignore docker: whitelist new build-context files, add docker_confirm.ps1 2026-06-12 05:06:51 +00:00
build.sh Add Docker build for Blackwell that runs on any NVIDIA GPU host 2026-05-24 06:52:58 +00:00
docker_confirm.ps1 docker: install vLLM on the arm64 leg too and probe it in the confirm scripts 2026-06-12 09:09:26 +00:00
docker_confirm.sh docker: install vLLM on the arm64 leg too and probe it in the confirm scripts 2026-06-12 09:09:26 +00:00
Dockerfile docker: install vLLM on the arm64 leg too and probe it in the confirm scripts 2026-06-12 09:09:26 +00:00
Dockerfile.studio docker: second review pass fixes 2026-06-12 05:59:52 +00:00
entrypoint.sh docker: review fixes from the 8-reviewer pass and staging CI 2026-06-12 05:31:24 +00:00
fetch_llama_prebuilt.py docker: mirror the llama.cpp bake into build/bin so Studio setup reuses it 2026-06-12 05:12:16 +00:00
freeze.sh Add Docker build for Blackwell that runs on any NVIDIA GPU host 2026-05-24 06:52:58 +00:00
hf_pull.sh hf_{push,pull}.sh: use new hf CLI, fall back to deprecated huggingface-cli 2026-05-24 09:40:22 +00:00
hf_push.sh hf_{push,pull}.sh: use new hf CLI, fall back to deprecated huggingface-cli 2026-05-24 09:40:22 +00:00
run.sh docker: review fixes from the 8-reviewer pass and staging CI 2026-06-12 05:31:24 +00:00
setup_qemu.sh Add linux/arm64 (DGX Spark / Grace) support via QEMU at build time 2026-05-24 10:34:59 +00:00
smoke_test.py [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-06-12 04:35:41 +00:00
studio_launch.sh docker: second review pass fixes 2026-06-12 05:59:52 +00:00
supervisord.conf docker: review fixes from the 8-reviewer pass and staging CI 2026-06-12 05:31:24 +00:00
test_locally.sh docker: review fixes from the 8-reviewer pass and staging CI 2026-06-12 05:31:24 +00:00