Commit graph

40 commits

Author SHA1 Message Date
Daniel Han
f20c7ca54d Friendlier unsupported model errors, show estimated download size
1. Backend: When a model fails with "No config file found" or similar
   unsupported-model errors, wrap the message with "This model is not
   supported yet. Try a different model." instead of showing the raw
   Unsloth exception.

2. Frontend: Compute estimated download size from the HF search API's
   safetensors.parameters dtype breakdown (BF16=2B/param, I32=4B/param,
   F32=4B/param, etc.) and show it in the model picker instead of just
   the param count. For example, Kimi-K2.5 now shows "~554 GB" instead
   of "171B" (which was misleading since 171B params != 171GB download).
2026-03-16 02:46:56 -07:00
Daniel Han
5bb783850a studio: GGUF OOM accounts for CPU offload via --fit (GPU + system RAM)
Updated GGUF fit classification to match llama-server's --fit behavior:

- fits:  model <= 70% of total GPU memory (all GPUs)
- tight: model > 70% GPU but <= 70% GPU + 70% available system RAM
         (llama-server uses --fit to offload layers to CPU)
- OOM:   model exceeds both GPU and system RAM budgets

useGpuInfo now also returns systemRamAvailableGb from /api/system so the
frontend can compute the combined GPU+RAM budget.
2026-03-15 05:24:06 -07:00
Daniel Han
ea45370ab8 studio: use total multi-GPU VRAM for OOM checks, recommend smallest when all OOM
Two fixes for GGUF variant dropdown:

1. useGpuInfo now sums memory across all GPU devices instead of only
   reading devices[0]. This matches llama-server's multi-GPU allocation
   where models can be split across GPUs.

2. When the backend-recommended variant (e.g. UD-Q4_K_XL) exceeds total
   GPU VRAM, the frontend picks the largest variant that fits instead.
   If all variants are OOM, it recommends the smallest one (most likely
   to work with --fit).
2026-03-15 05:24:06 -07:00
Roland Tannous
a2baf80511 Update license headers 2026-03-12 17:23:10 +00:00
Manan17
9523e5c1f9 fixing embedding model search 2026-03-10 21:12:24 +00:00
imagineer99
3de197ac31 rename: tts model type to audio for broader category support 2026-03-10 13:28:49 +00:00
imagineer99
8cba556bea feat: curated dataset shortlists and model type plumbing 2026-03-10 12:00:09 +00:00
Roland Tannous
d882678fe4 Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
Shine1i
a2dde15367 merge nightly 2026-03-09 00:32:33 +01:00
Manan17
821ba4936f Fixing dataset split issues 2026-03-06 01:13:55 +00:00
Shine1i
b277308b7e merge: nightly into feature/data-reciper-enchansments 2026-03-05 14:51:08 +01:00
Shine1i
e30fc87187 refactor(studio): add local data-recipe dataset selection + training wiring 2026-03-05 12:25:51 +01:00
Roland Tannous
43bf599b33 Remove overly broad .py check from dataset error normalization 2026-03-04 06:13:47 +00:00
imagineer99
a0f4566173 fix: sanitize dataset script errors and persist training start error 2026-03-03 20:15:23 +00:00
imagineer99
49c319c2f7 fix: only apply HF task filter for empty model search queries 2026-02-27 11:31:53 +00:00
Roland Tannous
609ae4809a Merge pull request #229 from unslothai/feat/dataset-list-sorting
Feat: Sort and filter dataset search results by model type relevance
2026-02-26 10:40:02 +04:00
imagineer99
852dff564e feat: added datasets of size 5M and 10M to pretraining size category 2026-02-26 06:32:45 +00:00
imagineer99
6e535ed0eb fix: filter OCR datasets from non-vision hub results 2026-02-26 06:27:52 +00:00
Roland Tannous
a8b5b7ed58 Fix GGUF models missing from chat page model search
GGUF was in the global EXCLUDED_TAGS set which filtered it from all
consumers of useHfModelSearch, including the chat page. Move GGUF
exclusion to an opt-in excludeGguf option so only training and
onboarding pages filter out GGUF models.
2026-02-25 16:21:08 +04:00
imagineer99
dbf5acf486 feat: filter pretraining datasets from search results 2026-02-25 03:00:40 +00:00
imagineer99
71d698d182 feat: sort and filter dataset search results by model type relevance 2026-02-23 16:22:45 +00:00
Roland Tannous
75f3e5e2a1 feat: dual-query HF model search to surface all unsloth size variants first 2026-02-22 08:20:25 +00:00
imagineer99
c815fc045d feat: sort unsloth models first in HF search dropdowns 2026-02-22 01:45:51 +00:00
samit
f4a888cddb Added VRAM fit indicator to recoomended models 2026-02-20 23:55:10 -08:00
samit
035f765130 added hf token validation 2026-02-19 21:05:27 -08:00
Roland Tannous
883ae7ff8c feat(onboarding): replace hardcoded system info with live /api/system/hardware data 2026-02-16 12:26:49 +00:00
Roland Tannous
a0ebd9183a feat: add live GPU monitor with nvidia-smi polling during training 2026-02-16 11:47:43 +00:00
Wasim Yousef Said
a9ec5d894c Merge pull request #98 from unslothai/feat/dataset-config-splits
feat: check dataset configs and splits before hitting check-format
2026-02-15 12:17:22 -08:00
Shine1i
51218702c2 cfg->subset 2026-02-15 21:09:45 +01:00
Shine1i
ef9e5ffc33 fix hf cfg/split ui 2026-02-15 20:53:59 +01:00
imagineer99
f285b5379a feat: VRAM-based model filtering in frontend 2026-02-15 19:12:28 +00:00
imagineer99
eb2ba90a03 feat: check dataset configs and splits before hitting check-format 2026-02-15 18:30:54 +00:00
Shine1i
b0062535a7 feat: add image previews in dataset dialog, enable popularity sorting in model search, refine training config serialization 2026-02-13 13:17:20 +01:00
shine1i
a48bb53e14 cleanup 2026-02-04 13:28:39 +01:00
shine1i
6abe1d6e35 refactor: streamline combobox logic, improve search handling, and remove unused elements across model and dataset sections 2026-02-02 14:06:34 +01:00
shine1i
99bea160b3 refactor: simplify model and dataset combobox logic, remove curated items, and streamline search handling across components 2026-02-02 13:16:08 +01:00
shine1i
af3e8c20ee refactor: format and clean up imports, hooks, and UI components for consistent structure and readability across models and datasets sections 2026-02-02 12:51:04 +01:00
shine1i
e705230499 feat: add Hugging Face search integration for datasets and models, extend infinite scroll support, and improve UI components with animations and tooltips 2026-02-02 12:45:41 +01:00
shine1i
e9857dab0f feat: replace config summary with model export feature, including export methods, quantization options, and new UI components 2026-02-02 11:08:31 +01:00
Roland Tannous
8b80c71fe1 add studio root folder 2026-02-02 09:14:35 +00:00