Don't prefetch dense shards for a prequant load; surface resolved provenance

- _dense_quant_prefetch_needed widened the transformer/ prefetch to pull the base
  repo's full dense bf16 shards even when a prequant checkpoint is configured
  (candidate.prequant), contradicting its own docstring. That both defeats the
  prequant download savings and can hard-fail begin_load on a disk-full (no GGUF
  fallback there). Only widen for a real dense build (candidate is not None and
  not candidate.prequant).
- DiffusionStatusResponse declared no 'resolved' field, so Pydantic's default
  extra='ignore' silently dropped the per-control auto-policy provenance the
  backend records (build_resolved_record / state.resolved) -- the plumbing never
  reached any client. Declare the field so it round-trips.
This commit is contained in:
Daniel Han 2026-07-06 11:52:18 +00:00
commit 89e5f69d90
3 changed files with 41 additions and 5 deletions

View file

@ -456,7 +456,13 @@ class DiffusionBackend:
prequant_path = kwargs.get("transformer_prequant_path"),
logger = None,
)
return candidate is not None
# A prequant candidate loads from the small pre-quantized checkpoint (+ config /
# companions), NOT the base repo's full dense transformer/ shards, so widening the
# prefetch to pull those shards both defeats the prequant download savings and can
# hard-fail the load: the widened pull runs in begin_load, where a disk-full has no
# GGUF fallback (unlike the in-load_pipeline dense failure). Only widen for a real
# dense build.
return candidate is not None and not candidate.prequant
except Exception: # noqa: BLE001 — widening the prefetch is best-effort only
return False