8d804c9413* Studio: show an actionable message when the GGUF runtime is missing Selecting a GGUF model with no llama-server installed surfaced a generic "Invalid model" in the UI, because validate_model's catch-all discarded the real cause. Add LlamaServerNotFoundError (a RuntimeError subclass) raised by the GGUF preflight in ModelConfig.from_identifier, and catch it in the validate route so users get an actionable message: run `unsloth studio setup` to download the prebuilt llama.cpp runtime. Other validation failures keep the safe generic message. Adds a regression test. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Studio: also map missing GGUF runtime to a 400 in load_model validate_model already surfaces the actionable 'install the runtime' message for LlamaServerNotFoundError; load_model fell through to the generic 500 'Failed to load model'. Catch it there too so a GGUF load without llama-server gives the same install hint instead of a 500. * Trim comments for PR #6327 * Studio: fix stale validate test after #6398 and surface missing GGUF runtime on /load - test_other_runtime_errors_do_not_get_gguf_message: after merging #6398, validate_model surfaces a RuntimeError's own message, so a plain RuntimeError no longer returns "Invalid model". Assert it does not receive the GGUF install message instead (the prior assertion was stale after the main merge). - Raise LlamaServerNotFoundError (not a plain RuntimeError) at the backend load-time missing-binary branch, after diffusion routing, so /load returns the actionable 400 like remote validation, instead of a generic 500. - Share LLAMA_SERVER_NOT_FOUND_DETAIL between the from_identifier preflight and the load-time raise so the message stays in sync. - Add a propagation regression test for the non-tensor load path. * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| assets | ||
| auth | ||
| core | ||
| hub | ||
| loggers | ||
| models | ||
| plugins | ||
| requirements | ||
| routes | ||
| state | ||
| storage | ||
| tests | ||
| utils | ||
| __init__.py | ||
| _platform_compat.py | ||
| cloudflare_tunnel.py | ||
| colab.py | ||
| main.py | ||
| run.py | ||
| startup_banner.py | ||