unsloth/studio/backend
Daniel Han 39ee347a39 studio: prefer system ROCm over the bundled runtime on bare-metal Strix Halo
The gfx1151 llama.cpp prebuilt bundles a regressed TheRock ROCm runtime whose
libhsa-runtime64 segfaults at HIP init on bare-metal Strix Halo (unslothai#6276),
so every model / embedder load crashes (code -11) while a Vulkan build works.

Extend the existing WSL-only _wsl_system_rocm_lib_dirs (which already shadows a
bad bundled HIP with the system one) to also return the system ROCm lib dirs on
bare-metal Strix Halo (detected via /proc/cpuinfo) when a system HIP runtime is
present. The bundle still supplies libggml-hip / librocblas gfx1151 kernels; the
driver-matched system libamdhip64 / libhsa-runtime64 drive the GPU. Applied
identically to the serve-time and install-validation mirrors so a prebuilt that
validates runs the same. No-op without system ROCm or on any non-Strix arch;
UNSLOTH_LLAMA_NO_SYSTEM_ROCM=1 opts out. The complete fix is repinning the
bundled runtime to a good TheRock nightly in the llama.cpp prebuilt CI; this is
the in-repo mitigation.
2026-07-21 04:52:39 -07:00
..
assets Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
auth Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
core studio: prefer system ROCm over the bundled runtime on bare-metal Strix Halo 2026-07-21 04:52:39 -07:00
hub Feat/model picker per model config v2 (#7207) 2026-07-20 22:53:22 -07:00
loggers Studio: quiet noisy logs, log real progress, and speed up Windows/macOS dataset prep (#7087) 2026-07-15 06:49:52 -07:00
models Fix resume training crash recovery and MLX checkpoints (#6796) 2026-07-21 02:34:58 -07:00
picker Feat/model picker per model config v2 (#7207) 2026-07-20 22:53:22 -07:00
plugins Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
requirements Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
routes Fix resume training crash recovery and MLX checkpoints (#6796) 2026-07-21 02:34:58 -07:00
state Studio: shareable per-checkpoint preview links (#6486) 2026-06-24 06:31:53 -07:00
storage Fix resume training crash recovery and MLX checkpoints (#6796) 2026-07-21 02:34:58 -07:00
tests Studio: fix loading split GGUFs from the local HF cache (#7273) 2026-07-21 02:48:19 -07:00
utils Studio: fix loading split GGUFs from the local HF cache (#7273) 2026-07-21 02:48:19 -07:00
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
_platform_compat.py Reduce and tighten code comments and docstrings repo-wide (#6095) 2026-06-08 23:09:51 -07:00
cloudflare_tunnel.py Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
colab.py Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
main.py Feat/model picker per model config v2 (#7207) 2026-07-20 22:53:22 -07:00
mcp_server.py Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
run.py Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00
startup_banner.py Replace standalone Studio wording with Unsloth (#7221) 2026-07-19 00:47:04 -07:00