311d9da637
- _dense_quant_prefetch_needed widened the prefetch to pull the base repo's bf16 transformer/ shards whenever a dense-quant scheme could resolve, with no disk check. On the offload path that can fill the cache volume mid-download and hard-fail the load in a spot unload/cancel cannot preempt, instead of the disk guard falling back to running the GGUF as-is (the Dtype hint's documented disk fallback). Defer to resolve_dense_quant_candidate, the same disk-aware resolver load_pipeline re-plans against, so the prefetch widens only when the dense build would really run. - An explicit Speed=off (bit-exact) load with an unset dtype was promoted to auto-quant by the Dtype default, silently engaging int8/fp8 + compile and breaking the bit-exact request (an auto DEFAULT overriding an EXPLICIT control). Suppress the auto-dtype default when speed is explicitly off, in both load_pipeline and the prefetch. |
||
|---|---|---|
| .. | ||
| backend | ||
| frontend | ||
| src-tauri | ||
| __init__.py | ||
| install_llama_prebuilt.py | ||
| install_node_prebuilt.py | ||
| install_python_stack.py | ||
| install_sd_cpp_prebuilt.py | ||
| LICENSE.AGPL-3.0 | ||
| node_prebuilt_pins.json | ||
| package-lock.json | ||
| package.json | ||
| setup.bat | ||
| setup.ps1 | ||
| setup.sh | ||
| Unsloth_Studio_Colab.ipynb | ||