Manan17
168957a87a
Aggregating sharded models, showing fit/oom for quantizations
2026-02-27 08:23:15 +00:00
Manan17
2fea4cadd3
Passes metadata to get model size
2026-02-27 07:38:55 +00:00
Roland Tannous
ed18f9b9dd
Flatten GGUF subdirs in export and fix metadata lookup in scanner
2026-02-26 11:35:04 +04:00
Roland Tannous
c21cf2ffcf
Add GGUF tag for exported models in chat page selector
2026-02-25 19:01:47 +04:00
Roland Tannous
01082b84e5
Merge branch 'nightly' into feat/gguf-llama-cpp-inference
2026-02-25 16:06:03 +04:00
Roland Tannous
ef1cd3ac98
Use llama-server -hf mode, add GGUF variant selector, fix vision detection
...
Replace Python-side GGUF download with llama-server's native -hf flag for
HuggingFace repos. Add frontend variant picker so users can choose
quantization (Q4_K_M, Q8_0, BF16, etc.) with file sizes. Fix vision
detection via mmproj files instead of hardcoding is_vision=False.
2026-02-24 19:03:06 +04:00
Roland Tannous
4e88092452
Preflight llama-server check before downloading remote GGUF files
2026-02-24 18:02:43 +04:00
Roland Tannous
a900eb9ad7
Fix GGUF detection for HuggingFace repo IDs (not just local paths)
2026-02-24 17:49:09 +04:00
Roland Tannous
a40ebb1aab
Add GGUF model inference via llama-server backend
2026-02-24 17:40:05 +04:00
Manan17
4be677e45d
Adding exported model for chat
2026-02-24 01:17:09 +00:00
Manan17
56869c63bd
Passing use_auth = True and also having different checks which is missed by the is_vision function
2026-02-19 02:55:46 +00:00
Manan17
c7b7ecab4f
Adding metadata for checkpoints
2026-02-16 23:46:17 +00:00
Roland Tannous
fd49c56481
feat: include training loss per checkpoint in /api/models/checkpoints response
2026-02-16 09:50:28 +00:00
Roland Tannous
f0298edeb8
refactor: move checkpoint scanning to utils/models and /checkpoints endpoint to models router
2026-02-16 09:32:11 +00:00
Roland Tannous
8ce96df66f
fix: auto-detect LoRA adapters for both local and remote HF models in ModelConfig
2026-02-13 20:54:40 +00:00
sshah229
82be5b237f
fixed the script directory
2026-02-12 21:55:36 -07:00
Roland Tannous
b4ec0389f0
refactor/inference-api-routes-part-1
2026-02-03 16:57:57 +00:00
Roland Tannous
c07b81c083
fix: add utils/models directory that was ignored by gitignore
2026-02-02 19:52:34 +00:00
