852755cc92
Reset _supports_reasoning, _supports_tools, _chat_template, and _context_length at the top of _read_gguf_metadata so flags from a previously loaded model do not carry over. Without this, loading a reasoning model (eg Qwen3.5-4B) then switching to a non-reasoning model (eg Qwen3-4B-Instruct-2507) would keep supports_reasoning=True from the first model, causing the UI to show "Thought for 0 seconds" and passing --chat-template-kwargs enable_thinking to a model whose chat template does not support it. Also update the default helper GGUF from Qwen3-4B-Instruct-2507-GGUF to Qwen3.5-4B-GGUF to match the frontend fallback auto-load model. |
||
|---|---|---|
| .. | ||
| datasets | ||
| hardware | ||
| inference | ||
| models | ||
| paths | ||
| .gitkeep | ||
| __init__.py | ||
| cache_cleanup.py | ||
| transformers_version.py | ||
| utils.py | ||