1d193f58bb
After the upstream cascade generalised _apply_group_offload to stream every DiT it finds on the pipe (transformer AND transformer_2), apply_memory_plan's group tier already block-streams both A14B experts, and model/sequential offload hook every top-level module. The explicit per-expert pass this branch added is therefore redundant: on a real group-tier load it re-registers the group-offload hooks transformer_2 already carries, which diffusers rejects with a duplicate-hook ValueError. That was swallowed by the helper's try/except and surfaced as a misleading "second expert stays resident" warning even though the expert was in fact streamed. Remove the pass and document why MoE needs none. |
||
|---|---|---|
| .. | ||
| backend | ||
| frontend | ||
| src-tauri | ||
| __init__.py | ||
| install_llama_prebuilt.py | ||
| install_node_prebuilt.py | ||
| install_python_stack.py | ||
| install_sd_cpp_prebuilt.py | ||
| LICENSE.AGPL-3.0 | ||
| node_prebuilt_pins.json | ||
| package-lock.json | ||
| package.json | ||
| setup.bat | ||
| setup.ps1 | ||
| setup.sh | ||
| Unsloth_Studio_Colab.ipynb | ||