unsloth/studio/backend/utils
Roland Tannous ef1cd3ac98 Use llama-server -hf mode, add GGUF variant selector, fix vision detection
Replace Python-side GGUF download with llama-server's native -hf flag for
HuggingFace repos. Add frontend variant picker so users can choose
quantization (Q4_K_M, Q8_0, BF16, etc.) with file sizes. Fix vision
detection via mmproj files instead of hardcoding is_vision=False.
2026-02-24 19:03:06 +04:00
..
datasets Cap dataset.map num_proc on multi-GPU machines to prevent fork deadlocks 2026-02-23 14:25:31 +00:00
hardware Cap dataset.map num_proc on multi-GPU machines to prevent fork deadlocks 2026-02-23 14:25:31 +00:00
inference added the inference fetching from model mappers 2026-02-15 02:48:53 -07:00
models Use llama-server -hf mode, add GGUF variant selector, fix vision detection 2026-02-24 19:03:06 +04:00
paths fix lora: outputs path local 2026-02-15 16:58:24 +01:00
.gitkeep root studio folder 2026-02-02 09:13:49 +00:00
cache_cleanup.py feat: clear unsloth_compiled_cache on startup, shutdown, and between model loads 2026-02-23 07:26:22 +00:00
utils.py replace torch MPS with MLX 2026-02-11 16:04:35 +00:00