_dense_quant_prefetch_needed widened the prefetch to pull the base repo's transformer/ shards whenever a dense-quant candidate resolved, but balanced/low_vram (and the legacy cpu_offload flag) force load_pipeline onto offload unconditionally in plan_diffusion_memory, so its re-plan never flips to OFFLOAD_NONE and the dense build never runs. The offloaded GGUF path then never touches those shards, so the widened prefetch only wastes a multi-GB download, and a disk-full on that begin_load pull has no GGUF fallback (unlike the in-load_pipeline dense failure). Mirror plan_diffusion_memory's definite-offload gates so the prefetch stays scoped. |
||
|---|---|---|
| .. | ||
| data_recipe | ||
| export | ||
| inference | ||
| rag | ||
| training | ||
| __init__.py | ||
| _torchao_stub.py | ||
| import_guards.py | ||
| tool_healing.py | ||