8933251a7e
Re-plan memory with the quant steady factor when the bf16 table forces offload a quantised DiT would not need, mirroring the image dense-quant path, and fall back to the bf16 plan when quant does not engage. Stream the second expert under group offload (model and sequential already hook every module). Fail the load cleanly when quant engages on only one expert instead of running mixed precision with quant reported off. Persist guidance_2 in the gallery recipe so A14B clips are reproducible. |
||
|---|---|---|
| .. | ||
| .gitkeep | ||
| __init__.py | ||
| auth.py | ||
| data_recipe.py | ||
| datasets.py | ||
| export.py | ||
| inference.py | ||
| mcp_servers.py | ||
| models.py | ||
| providers.py | ||
| responses.py | ||
| training.py | ||
| users.py | ||