Roland Tannous ef1cd3ac98 Use llama-server -hf mode, add GGUF variant selector, fix vision detection ... Replace Python-side GGUF download with llama-server's native -hf flag for HuggingFace repos. Add frontend variant picker so users can choose quantization (Q4_K_M, Q8_0, BF16, etc.) with file sizes. Fix vision detection via mmproj files instead of hardcoding is_vision=False.		2026-02-24 19:03:06 +04:00
..
__init__.py	Add GGUF model inference via llama-server backend	2026-02-24 17:40:05 +04:00
inference.py	feat: clear unsloth_compiled_cache on startup, shutdown, and between model loads	2026-02-23 07:26:22 +00:00
llama_cpp.py	Use llama-server -hf mode, add GGUF variant selector, fix vision detection	2026-02-24 19:03:06 +04:00