Roland Tannous
c06adc3878
Flatten GGUF subdirs in export and fix metadata lookup in scanner
2026-02-26 11:35:04 +04:00
Roland Tannous
b91b979bf8
Add GGUF tag for exported models in chat page selector
2026-02-25 19:01:47 +04:00
Roland Tannous
efaa0bacfb
Merge branch 'nightly' into feat/gguf-llama-cpp-inference
2026-02-25 16:06:03 +04:00
Roland Tannous
3ee4f1359a
Use llama-server -hf mode, add GGUF variant selector, fix vision detection
...
Replace Python-side GGUF download with llama-server's native -hf flag for
HuggingFace repos. Add frontend variant picker so users can choose
quantization (Q4_K_M, Q8_0, BF16, etc.) with file sizes. Fix vision
detection via mmproj files instead of hardcoding is_vision=False.
2026-02-24 19:03:06 +04:00
Roland Tannous
4a82e704aa
Preflight llama-server check before downloading remote GGUF files
2026-02-24 18:02:43 +04:00
Roland Tannous
c635d4f49c
Fix GGUF detection for HuggingFace repo IDs (not just local paths)
2026-02-24 17:49:09 +04:00
Roland Tannous
2f985ccbb5
Add GGUF model inference via llama-server backend
2026-02-24 17:40:05 +04:00
Manan17
1071c137f4
Adding exported model for chat
2026-02-24 01:17:09 +00:00
Manan17
2755cf922d
Passing use_auth = True and also having different checks which is missed by the is_vision function
2026-02-19 02:55:46 +00:00
Manan17
8f1db03c15
Adding metadata for checkpoints
2026-02-16 23:46:17 +00:00
Roland Tannous
1109839d2c
feat: include training loss per checkpoint in /api/models/checkpoints response
2026-02-16 09:50:28 +00:00
Roland Tannous
8a239dc83e
refactor: move checkpoint scanning to utils/models and /checkpoints endpoint to models router
2026-02-16 09:32:11 +00:00
Roland Tannous
5652591d03
fix: auto-detect LoRA adapters for both local and remote HF models in ModelConfig
2026-02-13 20:54:40 +00:00
sshah229
ae0b809adf
fixed the script directory
2026-02-12 21:55:36 -07:00
Roland Tannous
c17ba10f96
refactor/inference-api-routes-part-1
2026-02-03 16:57:57 +00:00
Roland Tannous
e390ca1092
fix: add utils/models directory that was ignored by gitignore
2026-02-02 19:52:34 +00:00
