3 commits

Author	SHA1	Message	Date
Roland Tannous	ef1cd3ac98	Use llama-server -hf mode, add GGUF variant selector, fix vision detection ... Replace Python-side GGUF download with llama-server's native -hf flag for HuggingFace repos. Add frontend variant picker so users can choose quantization (Q4_K_M, Q8_0, BF16, etc.) with file sizes. Fix vision detection via mmproj files instead of hardcoding is_vision=False.	2026-02-24 19:03:06 +04:00
Roland Tannous	08aeeaee4b	Fix llama-server: build in-tree, fix path resolution, add LD_LIBRARY_PATH	2026-02-24 18:19:29 +04:00
Roland Tannous	a40ebb1aab	Add GGUF model inference via llama-server backend	2026-02-24 17:40:05 +04:00