8218c9bf42
The catalog fit budget used gpu.memoryTotalGb, which sums VRAM across every GPU. That sum is right for the chat/llama.cpp path (tensor-split shards across cards) but wrong for the diffusion/video catalog: those backends place the whole pipeline on a single device (pipe.to or cpu offload, never device_map), so on a multi-GPU host the fit toggle and bare-group-click routing credited VRAM no single card has. On a 4x24 GB plus 128 GB RAM host the 114 GB Wan A14B bf16 group passed the toggle (0.7*96 + 0.7*128 budget) and a click would OOM, the exact load the toggle exists to prevent. Expose maxDeviceMemoryGb (largest single device) from use-gpu-info and use it for deviceBudget; the chat path keeps the sum. Single-GPU hosts are unchanged. |
||
|---|---|---|
| .. | ||
| public | ||
| src | ||
| .gitignore | ||
| .gitkeep | ||
| .npmrc | ||
| biome.json | ||
| components.json | ||
| data-designer.openapi (1).yaml | ||
| eslint.config.js | ||
| index.html | ||
| package-lock.json | ||
| package.json | ||
| tsconfig.app.json | ||
| tsconfig.json | ||
| tsconfig.node.json | ||
| vite.config.ts | ||