f5c3346c9f
The catalog fit budget used gpu.memoryTotalGb, which sums VRAM across every GPU. That sum is right for the chat/llama.cpp path (tensor-split shards across cards) but wrong for the diffusion/video catalog: those backends place the whole pipeline on a single device (pipe.to or cpu offload, never device_map), so on a multi-GPU host the fit toggle and bare-group-click routing credited VRAM no single card has. On a 4x24 GB plus 128 GB RAM host the 114 GB Wan A14B bf16 group passed the toggle (0.7*96 + 0.7*128 budget) and a click would OOM, the exact load the toggle exists to prevent. Expose maxDeviceMemoryGb (largest single device) from use-gpu-info and use it for deviceBudget; the chat path keeps the sum. Single-GPU hosts are unchanged. |
||
|---|---|---|
| .. | ||
| backend | ||
| frontend | ||
| src-tauri | ||
| __init__.py | ||
| install_llama_prebuilt.py | ||
| install_node_prebuilt.py | ||
| install_python_stack.py | ||
| install_sd_cpp_prebuilt.py | ||
| LICENSE.AGPL-3.0 | ||
| node_prebuilt_pins.json | ||
| package-lock.json | ||
| package.json | ||
| setup.bat | ||
| setup.ps1 | ||
| setup.sh | ||
| Unsloth_Studio_Colab.ipynb | ||