unsloth/studio
Roland Tannous 0e7c8a2e5e Switch GGUF backend from /v1/completions to /v1/chat/completions
Fixes two bugs:
1. Chat template tags (<|im_start|>, <|im_end|>) leaking into output
   because /v1/completions treated them as literal text
2. Image hallucination because image_b64 was never passed to llama-server

Now llama-server handles chat templates natively and receives images
as OpenAI-format multimodal content parts for vision models.
2026-02-24 19:21:01 +04:00
..
backend Switch GGUF backend from /v1/completions to /v1/chat/completions 2026-02-24 19:21:01 +04:00
frontend Use llama-server -hf mode, add GGUF variant selector, fix vision detection 2026-02-24 19:03:06 +04:00
tests fix: auto-detect LoRA adapters for both local and remote HF models in ModelConfig 2026-02-13 20:54:40 +00:00