* Copy uv `-c`/`-r` paths to a space-free temp dir on macOS/Linux
uv 0.11.x truncates a constraints/requirements path passed via `-c`/`-r`
at the first space, so `unsloth studio` setup from a repo cloned under a
path containing a space (e.g. `/Users/me/Open Source/unsloth`) fails with:
error: File not found: `/Users/me/Open`
_uv_safe_path() already worked around this on Windows via the 8.3 short
path but returned the space-containing path unchanged on macOS/Linux,
which have no 8.3 equivalent. Extend it to copy the (small, flat)
constraints/requirements file into a space-free temp dir and hand uv the
copy; the temp dirs are removed at process exit. Falls back to the
original path on any error, so it is never worse than before.
Refs unslothai/unsloth#6503
* Route UV_OVERRIDE through _uv_safe_path and fix temp-dir leak (#6503)
The -c/-r fix did not cover UV_OVERRIDE, which uv also truncates at the first
space. On Apple Silicon the overrides file is handed to uv via UV_OVERRIDE at
install time (install_python_stack.py) and during the MLX self-heal
(utils.mlx_repair), so a repo under a path containing a space still broke every
uv call there. Move _uv_safe_path into backend.utils.uv_path_safety so both
sites share it, and route UV_OVERRIDE through it.
Also stop leaking the temp dir when shutil.copyfile fails after mkdtemp, and add
tests for the UV_OVERRIDE channel, the TMPDIR-with-space fallback, the atexit
cleanup, and the no-leak path.
---------
Co-authored-by: danielhanchen <danielhanchen@gmail.com>
This commit is contained in:
parent
d1529b1466
commit
9d53656614
5 changed files with 191 additions and 22 deletions
|
|
@ -36,6 +36,7 @@ from backend.utils.wheel_utils import (
|
|||
probe_torch_wheel_env,
|
||||
url_exists,
|
||||
)
|
||||
from backend.utils.uv_path_safety import uv_safe_path as _uv_safe_path
|
||||
|
||||
IS_WINDOWS = sys.platform == "win32"
|
||||
IS_MACOS = sys.platform == "darwin"
|
||||
|
|
@ -1374,25 +1375,7 @@ def _ensure_rocm_torch() -> None:
|
|||
)
|
||||
|
||||
|
||||
def _uv_safe_path(path: object) -> str:
|
||||
# uv 0.11.x: `-c <path with space>` truncates at the space; use 8.3 short form.
|
||||
s = str(path)
|
||||
if not IS_WINDOWS or " " not in s:
|
||||
return s
|
||||
try:
|
||||
import ctypes
|
||||
from ctypes import wintypes
|
||||
|
||||
get_short = ctypes.windll.kernel32.GetShortPathNameW
|
||||
get_short.argtypes = [wintypes.LPCWSTR, wintypes.LPWSTR, wintypes.DWORD]
|
||||
get_short.restype = wintypes.DWORD
|
||||
buf = ctypes.create_unicode_buffer(32768)
|
||||
rc = get_short(s, buf, 32768)
|
||||
if 0 < rc < 32768 and " " not in buf.value:
|
||||
return buf.value
|
||||
except Exception:
|
||||
pass
|
||||
return s
|
||||
# _uv_safe_path is imported from backend.utils.uv_path_safety (shared with mlx_repair).
|
||||
|
||||
|
||||
def _windows_hidden_subprocess_kwargs() -> dict[str, object]:
|
||||
|
|
@ -1481,9 +1464,10 @@ LOCAL_DD_UNSTRUCTURED_PLUGIN = (
|
|||
LOCAL_DD_GITHUB_PLUGIN = SCRIPT_DIR / "backend" / "plugins" / "data-designer-github-repo-seed"
|
||||
|
||||
# Apple Silicon: override mlx-vlm/mlx-lm's transformers pin (see overrides).
|
||||
# _uv_safe_path: uv truncates UV_OVERRIDE at the first space too (issue #6503).
|
||||
_MLX_OVERRIDES = SINGLE_ENV / "overrides-darwin-arm64.txt"
|
||||
if IS_MAC_ARM and _MLX_OVERRIDES.is_file():
|
||||
os.environ.setdefault("UV_OVERRIDE", str(_MLX_OVERRIDES))
|
||||
if IS_MAC_ARM and _MLX_OVERRIDES.is_file() and "UV_OVERRIDE" not in os.environ:
|
||||
os.environ["UV_OVERRIDE"] = _uv_safe_path(_MLX_OVERRIDES)
|
||||
|
||||
# -- Unicode-safe printing ---------------------------------------------
|
||||
# On Windows the console encoding may be a legacy code page (e.g. CP1252)
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue