8218c9bf42
The catalog fit budget used gpu.memoryTotalGb, which sums VRAM across every GPU. That sum is right for the chat/llama.cpp path (tensor-split shards across cards) but wrong for the diffusion/video catalog: those backends place the whole pipeline on a single device (pipe.to or cpu offload, never device_map), so on a multi-GPU host the fit toggle and bare-group-click routing credited VRAM no single card has. On a 4x24 GB plus 128 GB RAM host the 114 GB Wan A14B bf16 group passed the toggle (0.7*96 + 0.7*128 budget) and a click would OOM, the exact load the toggle exists to prevent. Expose maxDeviceMemoryGb (largest single device) from use-gpu-info and use it for deviceBudget; the chat path keeps the sum. Single-GPU hosts are unchanged. |
||
|---|---|---|
| .. | ||
| app | ||
| assets | ||
| components | ||
| config | ||
| features | ||
| hooks | ||
| i18n | ||
| lib | ||
| shared | ||
| stores | ||
| types | ||
| utils | ||
| asset-queries.d.ts | ||
| index.css | ||
| main.tsx | ||
| speech-recognition.d.ts | ||