Manan17
80b704d7b7
Audio_VLM bug fix
2026-03-08 19:14:07 +00:00
Roland Tannous
1435dbaf59
merge nightly into audio branch (mock test)
2026-03-08 10:23:44 +00:00
Roland Tannous
f7a3092cbd
fix: correct project root depth in model_config.py vision check
2026-03-07 08:15:29 +00:00
Roland Tannous
b5cfd0952c
fix: use subprocess with transformers 5.x for vision detection
...
Models like GLM-4.7-Flash have architectures (glm4_moe_lite) that
AutoConfig in the main process (transformers 4.57.x) can't recognize.
Instead of a raw config.json workaround, run the AutoConfig check in
a subprocess with .venv_t5/ activated — same pattern as training and
inference workers. This is more robust and consistent.
2026-03-06 04:51:23 +00:00
Roland Tannous
e5c7a18f72
fix: handle unrecognized model architectures in vision detection
...
AutoConfig.from_pretrained() fails for models needing transformers 5.x
(e.g. glm4_moe_lite) when running with 4.57.x. Add a raw config.json
fallback that bypasses AutoConfig's architecture registry — fetches
config.json directly from local path or HuggingFace Hub and checks
for vision indicators without needing the architecture to be registered.
2026-03-06 04:46:51 +00:00
Manan17
a5825f8d44
dynamic detection of audio models and fixing autoencoder issues
2026-03-04 10:44:44 +00:00
Roland Tannous
87f2b2a9db
Merge branch 'nightly' into feature/support-for-audio-models
2026-03-02 15:55:25 +04:00
Roland Tannous
ff93c97024
fix: support mmproj for local vision GGUF models + fix Windows pipe deadlock
2026-03-01 12:58:38 +00:00
Manan17
c636fd5a42
code cleanup
2026-03-01 08:04:38 +00:00
Manan17
c48437848d
revamping up the code and adding inference
2026-03-01 02:30:31 +00:00
Manan17
ac27edde35
merging with nightly
2026-03-01 02:27:45 +00:00
Manan17
168957a87a
Aggregating sharded models, showing fit/oom for quantizations
2026-02-27 08:23:15 +00:00
Manan17
2fea4cadd3
Passes metadata to get model size
2026-02-27 07:38:55 +00:00
Roland Tannous
ed18f9b9dd
Flatten GGUF subdirs in export and fix metadata lookup in scanner
2026-02-26 11:35:04 +04:00
Roland Tannous
c21cf2ffcf
Add GGUF tag for exported models in chat page selector
2026-02-25 19:01:47 +04:00
Roland Tannous
01082b84e5
Merge branch 'nightly' into feat/gguf-llama-cpp-inference
2026-02-25 16:06:03 +04:00
Roland Tannous
ef1cd3ac98
Use llama-server -hf mode, add GGUF variant selector, fix vision detection
...
Replace Python-side GGUF download with llama-server's native -hf flag for
HuggingFace repos. Add frontend variant picker so users can choose
quantization (Q4_K_M, Q8_0, BF16, etc.) with file sizes. Fix vision
detection via mmproj files instead of hardcoding is_vision=False.
2026-02-24 19:03:06 +04:00
Roland Tannous
4e88092452
Preflight llama-server check before downloading remote GGUF files
2026-02-24 18:02:43 +04:00
Roland Tannous
a900eb9ad7
Fix GGUF detection for HuggingFace repo IDs (not just local paths)
2026-02-24 17:49:09 +04:00
Roland Tannous
a40ebb1aab
Add GGUF model inference via llama-server backend
2026-02-24 17:40:05 +04:00
Manan17
4be677e45d
Adding exported model for chat
2026-02-24 01:17:09 +00:00
Manan17
56869c63bd
Passing use_auth = True and also having different checks which is missed by the is_vision function
2026-02-19 02:55:46 +00:00
Manan17
c7b7ecab4f
Adding metadata for checkpoints
2026-02-16 23:46:17 +00:00
Roland Tannous
fd49c56481
feat: include training loss per checkpoint in /api/models/checkpoints response
2026-02-16 09:50:28 +00:00
Roland Tannous
f0298edeb8
refactor: move checkpoint scanning to utils/models and /checkpoints endpoint to models router
2026-02-16 09:32:11 +00:00
Roland Tannous
8ce96df66f
fix: auto-detect LoRA adapters for both local and remote HF models in ModelConfig
2026-02-13 20:54:40 +00:00
sshah229
82be5b237f
fixed the script directory
2026-02-12 21:55:36 -07:00
Roland Tannous
b4ec0389f0
refactor/inference-api-routes-part-1
2026-02-03 16:57:57 +00:00
Roland Tannous
c07b81c083
fix: add utils/models directory that was ignored by gitignore
2026-02-02 19:52:34 +00:00
