Don't prefetch dense shards for a prequant load; surface resolved provenance
- _dense_quant_prefetch_needed widened the transformer/ prefetch to pull the base repo's full dense bf16 shards even when a prequant checkpoint is configured (candidate.prequant), contradicting its own docstring. That both defeats the prequant download savings and can hard-fail begin_load on a disk-full (no GGUF fallback there). Only widen for a real dense build (candidate is not None and not candidate.prequant). - DiffusionStatusResponse declared no 'resolved' field, so Pydantic's default extra='ignore' silently dropped the per-control auto-policy provenance the backend records (build_resolved_record / state.resolved) -- the plumbing never reached any client. Declare the field so it round-trips.
This commit is contained in:
parent
e6bd256ad6
commit
89e5f69d90
3 changed files with 41 additions and 5 deletions
|
|
@ -456,7 +456,13 @@ class DiffusionBackend:
|
|||
prequant_path = kwargs.get("transformer_prequant_path"),
|
||||
logger = None,
|
||||
)
|
||||
return candidate is not None
|
||||
# A prequant candidate loads from the small pre-quantized checkpoint (+ config /
|
||||
# companions), NOT the base repo's full dense transformer/ shards, so widening the
|
||||
# prefetch to pull those shards both defeats the prequant download savings and can
|
||||
# hard-fail the load: the widened pull runs in begin_load, where a disk-full has no
|
||||
# GGUF fallback (unlike the in-load_pipeline dense failure). Only widen for a real
|
||||
# dense build.
|
||||
return candidate is not None and not candidate.prequant
|
||||
except Exception: # noqa: BLE001 — widening the prefetch is best-effort only
|
||||
return False
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue