unsloth/studio/backend
Daniel Han 2bc6f6879a Wan: fp32 VAE decode, correct bf16-resident DiT sizes, TI2V /32 snap
Verified against diffusers 0.39 source + the HF configs/safetensors headers:
- The Wan VAE decodes in float32 (WanPipeline loads AutoencoderKLWan at torch.float32
  while the pipe runs bf16); the loader cast every component to bf16, degrading every
  clip. Add vae_force_fp32 (both Wan families) and pin pipe.vae back to fp32 after build.
- The Wan transformers ship FP32 on disk (safetensors headers are F32; A14B index =
  57.15 GB per expert = 14.3B x 4, TI2V = 20.0 GB = 5B x 4), so bf16_components_gb held
  the fp32 on-disk sums (114.3 / 20.0) instead of the documented bf16-resident sizes.
  Halve to 57.2 (two A14B experts) and 10.0 (TI2V), so the plan no longer over-budgets
  the DiTs ~2x and forces needless offload on an 80 GB GPU.
- TI2V-5B's VAE is 16x spatial (vae/config.json), so WanPipeline floors H/W to 16*2 = 32.
  Snap TI2V to /32 (was /16) so the recorded size matches the generated clip (a 720
  request was recorded but rendered at 704). A14B keeps /16 (Wan2.1 8x VAE).
2026-07-06 12:20:56 +00:00
..
assets Studio: require signed capability tokens for /p preview links (#6666) 2026-06-25 21:40:48 -07:00
auth Studio: opt-in OpenAI /v1 model auto-switch and idle keep-warm (#6392) 2026-07-01 06:42:23 -07:00
core Wan: fp32 VAE decode, correct bf16-resident DiT sizes, TI2V /32 snap 2026-07-06 12:20:56 +00:00
hub Fix Studio custom folders on Linux external drives (#6799) 2026-07-03 19:10:04 +01:00
loggers Studio: trim serving-log noise and surface llama-server engine stats (#6377) 2026-06-17 05:37:57 -07:00
models Merge branch 'video-tab' into video-wan 2026-07-05 02:19:39 +00:00
plugins Reduce and tighten code comments and docstrings repo-wide (#6095) 2026-06-08 23:09:51 -07:00
requirements Video inference engine: LTX-2 family registry, VideoBackend, MP4 gallery 2026-07-04 13:08:43 +00:00
routes Merge branch 'video-tab' into video-wan 2026-07-05 11:39:49 +00:00
state Studio: shareable per-checkpoint preview links (#6486) 2026-06-24 06:31:53 -07:00
storage Fix Studio custom folders on Linux external drives (#6799) 2026-07-03 19:10:04 +01:00
tests Wan: fp32 VAE decode, correct bf16-resident DiT sizes, TI2V /32 snap 2026-07-06 12:20:56 +00:00
utils Fix Studio custom folders on Linux external drives (#6799) 2026-07-03 19:10:04 +01:00
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
_platform_compat.py Reduce and tighten code comments and docstrings repo-wide (#6095) 2026-06-08 23:09:51 -07:00
cloudflare_tunnel.py Reap Studio child processes when the parent dies abnormally (#6425) 2026-06-18 05:51:22 -07:00
colab.py Studio Colab: opt-in shareable Cloudflare tunnel link (#6684) 2026-06-26 00:56:23 -07:00
main.py Video HTTP surface: /api/inference/video routes + request/response models 2026-07-04 13:17:01 +00:00
run.py studio: explicit Cloudflare tunnel notice and public-exposure warning at startup (#6515) 2026-06-30 17:47:48 +02:00
startup_banner.py Fix Windows Studio UTF-8 startup handling (#6614) 2026-07-01 13:47:33 +01:00