852755cc92
Reset _supports_reasoning, _supports_tools, _chat_template, and _context_length at the top of _read_gguf_metadata so flags from a previously loaded model do not carry over. Without this, loading a reasoning model (eg Qwen3.5-4B) then switching to a non-reasoning model (eg Qwen3-4B-Instruct-2507) would keep supports_reasoning=True from the first model, causing the UI to show "Thought for 0 seconds" and passing --chat-template-kwargs enable_thinking to a model whose chat template does not support it. Also update the default helper GGUF from Qwen3-4B-Instruct-2507-GGUF to Qwen3.5-4B-GGUF to match the frontend fallback auto-load model. |
||
|---|---|---|
| .. | ||
| assets | ||
| auth | ||
| core | ||
| loggers | ||
| models | ||
| plugins | ||
| requirements | ||
| routes | ||
| state | ||
| tests | ||
| utils | ||
| __init__.py | ||
| colab.py | ||
| main.py | ||
| run.py | ||