4f00222c2e
For a narrow (fp8) Ideogram-4 base the planner reserves the family's known bf16 component total, but the reservation was gated on model_dense_mib being non-None. On a first-time load an empty blob cache (or a best-effort download probe that swallowed a transient HF error) leaves model_dense_mib None, so the guard skipped the reservation exactly when it was needed: the planner then read 'size unknown -> stay resident' and the ~54 GB pipeline OOMed a card that offload would have fit. family_bf16_components_gb is a network-free constant, so reserve it whenever the cache signal is absent (use it directly when None, else take the max). |
||
|---|---|---|
| .. | ||
| assets | ||
| auth | ||
| core | ||
| hub | ||
| loggers | ||
| models | ||
| plugins | ||
| requirements | ||
| routes | ||
| state | ||
| storage | ||
| tests | ||
| utils | ||
| __init__.py | ||
| _platform_compat.py | ||
| cloudflare_tunnel.py | ||
| colab.py | ||
| main.py | ||
| run.py | ||
| startup_banner.py | ||