Manan17
9e89f31bc7
revamping up the code and adding inference
2026-03-01 02:30:31 +00:00
Roland Tannous
b91b979bf8
Add GGUF tag for exported models in chat page selector
2026-02-25 19:01:47 +04:00
Roland Tannous
efaa0bacfb
Merge branch 'nightly' into feat/gguf-llama-cpp-inference
2026-02-25 16:06:03 +04:00
Roland Tannous
3ee4f1359a
Use llama-server -hf mode, add GGUF variant selector, fix vision detection
...
Replace Python-side GGUF download with llama-server's native -hf flag for
HuggingFace repos. Add frontend variant picker so users can choose
quantization (Q4_K_M, Q8_0, BF16, etc.) with file sizes. Fix vision
detection via mmproj files instead of hardcoding is_vision=False.
2026-02-24 19:03:06 +04:00
Roland Tannous
2f985ccbb5
Add GGUF model inference via llama-server backend
2026-02-24 17:40:05 +04:00
Manan17
1071c137f4
Adding exported model for chat
2026-02-24 01:17:09 +00:00
Shine1i
a2cf89214e
feat: add schemas for local model discovery and listing
2026-02-17 21:53:42 +01:00
Manan17
8f1db03c15
Adding metadata for checkpoints
2026-02-16 23:46:17 +00:00
Roland Tannous
1109839d2c
feat: include training loss per checkpoint in /api/models/checkpoints response
2026-02-16 09:50:28 +00:00
Roland Tannous
8a239dc83e
refactor: move checkpoint scanning to utils/models and /checkpoints endpoint to models router
2026-02-16 09:32:11 +00:00
sshah229
6e5cd50c34
fixed the errors- renamed jwt to authentication, used raw jwt, and removed search route
2026-02-07 03:14:30 -07:00
Roland Tannous
d7d3a5a9a5
update pydantic models for Models and Training routes
2026-02-02 20:00:04 +00:00
Roland Tannous
3463311bca
fix: restore models directory files deleted during restructure
2026-02-02 19:36:30 +00:00
