unsloth/studio
Daniel Han 4e23ebc902 Load hosted pre-quantized checkpoints on the video quant path
The video loader always materialised the dense DiT(s) inside from_pretrained
and quantised them in place, so an int8/fp8 A14B load paid a ~57 GB dense
download and a dense-bf16 VRAM transient every time. Mirror the image loader's
hosted-prequant shortcut:

- diffusion_prequant grows an expert dimension: prequant_repo_filename /
  prequant_filename / resolve_prequant_source take an expert attribute name, so
  one repo carries a dual-DiT pair per scheme (<Model>-<SCHEME>.pt plus
  <Model>-<SCHEME>-2.pt, legacy transformer_2_<scheme>.pt fallback), and
  load_prequantized_transformer meta-inits from the expert's config subfolder.
  A local path override never carries a pair, so an expert request under an
  override resolves None and the whole load falls back to dense.
- VideoFamily gains prequant_repos (+ variant table for parity with the image
  side); wired: Wan2.2-TI2V-5B and both A14B expert pairs at int8 + fp8, and
  HunyuanVideo-1.5 480p/720p at int8 only per the measured deny list. LTX stays
  unwired (no measured quant recipe).
- The pipeline build tries the shortcut first when the resolved plan is
  resident and every expert's checkpoint resolves; loaded experts ride into
  from_pretrained as component overrides and in-place quantise is skipped.
  All-or-none per pair: a partial load frees and goes dense (mixed-precision
  experts would corrupt the boundary handoff).
- An explicit wired scheme also lets the scoped pre-download skip the DiT
  weight shards (configs kept for the meta-init); if the shortcut then falls
  through, the build resolves from the hub id, gated on the same predicate so
  ordinary pre-downloaded snapshots are untouched.
- build_prequant_checkpoint.py accepts --subfolder and resolves video families.

New tests: expert filename/resolution conventions, family wiring incl. the
LTX/720p split, shortcut engagement, partial-pair dense fallback, unwired
family bypass, and the pre-download skip predicate.
2026-07-18 05:58:40 +00:00
..
backend Load hosted pre-quantized checkpoints on the video quant path 2026-07-18 05:58:40 +00:00
frontend Surface HiDream I1 in the image model catalog 2026-07-17 13:26:18 +00:00
src-tauri Speed up Studio startup path (#6899) 2026-07-07 18:08:07 -07:00
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
install_llama_prebuilt.py Studio: detect Windows Intel GPUs via the registry before WMI (#7064) 2026-07-10 17:59:04 -03:00
install_node_prebuilt.py Pin isolated Node.js installer to committed sha256 digests (#6625) 2026-06-24 05:47:58 -07:00
install_python_stack.py Studio: fix flash-attn and torchao install on Blackwell (sm_100+) GPUs (Closes #6961) (#6970) 2026-07-08 06:38:10 -07:00
install_sd_cpp_prebuilt.py Tighten comments and docstrings added by the image-generation fixes 2026-07-13 05:29:09 +00:00
LICENSE.AGPL-3.0 Add AGPL-3.0 license to studio folder 2026-03-09 19:36:25 +00:00
node_prebuilt_pins.json Pin isolated Node.js installer to committed sha256 digests (#6625) 2026-06-24 05:47:58 -07:00
package-lock.json ci: advisory lockfile supply-chain audit (no install-script changes) (#5604) 2026-05-19 05:56:56 -07:00
package.json ci: advisory lockfile supply-chain audit (no install-script changes) (#5604) 2026-05-19 05:56:56 -07:00
setup.bat Final cleanup 2026-03-12 18:28:04 +00:00
setup.ps1 Fix Windows installer torch index override (#6972) 2026-07-09 03:46:47 -07:00
setup.sh Studio: source CPU llama.cpp prebuilts from unslothai/llama.cpp (#6311) 2026-07-08 05:34:59 -07:00
Unsloth_Studio_Colab.ipynb Studio Colab: opt-in shareable Cloudflare tunnel link (#6684) 2026-06-26 00:56:23 -07:00