fd5f0a1331
Detect a DiffusionGemma GGUF (general.architecture=diffusion-gemma) and serve it through the diffusion runner instead of llama-server: launch the OpenAI-compat shim (unsloth_zoo.diffusion_studio.shim, or UNSLOTH_DG_SHIM) driving the on-device visual decoder, resolving the visual-server binary from DG_VISUAL_BIN or next to llama-server. Surface is_diffusion to the UI and auto-render the per-step denoising canvas artifact for DiffusionGemma (no toggle). install_llama_prebuilt + setup.sh/ps1 place the visual-server binary in the install tree best-effort. Other models unchanged. |
||
|---|---|---|
| .. | ||
| .gitkeep | ||
| __init__.py | ||
| auth.py | ||
| data_recipe.py | ||
| datasets.py | ||
| export.py | ||
| inference.py | ||
| mcp_servers.py | ||
| models.py | ||
| providers.py | ||
| responses.py | ||
| training.py | ||
| users.py | ||