Roland Tannous
47654cb91c
Final cleanup
2026-03-12 18:28:04 +00:00
Roland Tannous
a2baf80511
Update license headers
2026-03-12 17:23:10 +00:00
Shine1i
4a8a96b1af
chat seq slider
2026-03-11 01:41:25 +01:00
Roland Tannous
d882678fe4
Add AGPL-3.0 SPDX headers to all source files
2026-03-09 20:17:45 +00:00
Roland Tannous
91dd7fc762
merge nightly, resolve conflict in use-chat-model-runtime
2026-03-09 13:19:17 +00:00
Roland Tannous
254f10e37a
Merge pull request #328 from unslothai/fix/chat-unloading-model
...
fixed model unload before load without validation
2026-03-09 04:40:05 +04:00
samit
86e94b5844
exposed trust_remote_code through the UI
2026-03-08 16:28:56 -07:00
Samit
5f902af456
fixed model unload before load
2026-03-06 22:01:27 -08:00
Manan17
c48437848d
revamping up the code and adding inference
2026-03-01 02:30:31 +00:00
Manan17
168957a87a
Aggregating sharded models, showing fit/oom for quantizations
2026-02-27 08:23:15 +00:00
Roland Tannous
ef1cd3ac98
Use llama-server -hf mode, add GGUF variant selector, fix vision detection
...
Replace Python-side GGUF download with llama-server's native -hf flag for
HuggingFace repos. Add frontend variant picker so users can choose
quantization (Q4_K_M, Q8_0, BF16, etc.) with file sizes. Fix vision
detection via mmproj files instead of hardcoding is_vision=False.
2026-02-24 19:03:06 +04:00
Roland Tannous
a40ebb1aab
Add GGUF model inference via llama-server backend
2026-02-24 17:40:05 +04:00
Shine1i
0db7da96cc
feat: support disabling top-k sampling with -1 and standardize normalization logic
...
- Updated top-k parameter range to accept -1 in models and frontend.
- Added utility to normalize top-k for backend compatibility.
2026-02-16 21:33:24 +01:00
Roland Tannous
909955767b
feat: add min_p sampling parameter to /chat/completions generation pipeline
2026-02-16 06:33:17 +00:00
sshah229
9e50e167d9
added the inference fetching from model mappers
2026-02-15 02:48:53 -07:00
Roland Tannous
f67ee58347
feat(inference): add use_adapter field for per-request adapter toggling in compare mode
2026-02-14 14:52:13 +00:00
Roland Tannous
9de38cb773
feat(inference): accept OpenAI multimodal content parts (image_url) in /chat/completions
2026-02-14 09:06:25 +00:00
Roland Tannous
8403190cdd
feat: add OpenAI-compatible POST /chat/completions endpoint with streaming and non-streaming support
2026-02-12 19:00:05 +00:00
Roland Tannous
7ee4381936
move inline pydantic models - fix existing models routes integration
2026-02-11 12:39:58 +00:00
