4f00222c2e
For a narrow (fp8) Ideogram-4 base the planner reserves the family's known bf16 component total, but the reservation was gated on model_dense_mib being non-None. On a first-time load an empty blob cache (or a best-effort download probe that swallowed a transient HF error) leaves model_dense_mib None, so the guard skipped the reservation exactly when it was needed: the planner then read 'size unknown -> stay resident' and the ~54 GB pipeline OOMed a card that offload would have fit. family_bf16_components_gb is a network-free constant, so reserve it whenever the cache signal is absent (use it directly when None, else take the max). |
||
|---|---|---|
| .. | ||
| backend | ||
| frontend | ||
| src-tauri | ||
| __init__.py | ||
| install_llama_prebuilt.py | ||
| install_node_prebuilt.py | ||
| install_python_stack.py | ||
| install_sd_cpp_prebuilt.py | ||
| LICENSE.AGPL-3.0 | ||
| node_prebuilt_pins.json | ||
| package-lock.json | ||
| package.json | ||
| setup.bat | ||
| setup.ps1 | ||
| setup.sh | ||
| Unsloth_Studio_Colab.ipynb | ||