Shine1i
b08b606b21
feat(studio): studio storage roots path utilities
2026-03-09 23:48:31 +00:00
Roland Tannous
a0f03d3080
Add AGPL-3.0 SPDX headers to all source files
2026-03-09 20:17:45 +00:00
Roland Tannous
3745e06776
store uploaded datasets under assets/datasets/uploads instead of ~/.cache
2026-03-09 17:06:36 +00:00
Roland Tannous
8d81c991f8
switch dataset upload from base64 JSON to multipart/form-data with streamed writes
2026-03-09 13:55:45 +00:00
Roland Tannous
ee6d5c124d
normalize uploaded filename extension to lowercase for consistent downstream checks
2026-03-09 13:35:55 +00:00
Manan17
0cc5fe3de8
remove file size limit
2026-03-09 07:04:02 +00:00
Manan17
b430e23c0e
dataset upload
2026-03-09 05:50:18 +00:00
Shine1i
4aa171b079
feat(recipe-studio, datasets): improve dataset handling and update metadata logic
2026-03-09 02:47:32 +01:00
Shine1i
d951e5aef0
merge nightly
2026-03-09 00:32:33 +01:00
Shine1i
6fc829e3ef
merge: nightly into feature/data-reciper-enchansments
2026-03-05 14:51:08 +01:00
Shine1i
f988202290
refactor(studio): add local data-recipe dataset selection + training wiring
2026-03-05 12:25:51 +01:00
Manan17
8203637d89
resolved merge conflicts
2026-03-05 07:59:43 +00:00
Roland Tannous
e04b9d53d6
feat: parallel URL image probe with time estimate and progress reporting
...
- Add 200-sample parallel probe using ThreadPoolExecutor + safe_num_proc
to estimate download speed and failure rate before full conversion
- Abort with clear error if >=30% of probe images fail to download
- Show estimated download time in the training overlay modal
- Parallel batch conversion for URL-based datasets (vs sequential for local)
- Add warning field to /check-format response for URL-based image datasets
- Display URL warning in dataset preview dialog (amber banner)
- Thread progress_callback from trainer through format_and_template_dataset
to convert_to_vlm_format for real-time status updates
2026-03-04 23:40:38 +00:00
Manan17
6fd1dd2c0a
variable changes and some cleanup
2026-03-03 09:35:11 +00:00
Manan17
90332924de
Changes with audio training
2026-03-01 02:27:45 +00:00
samit
2714789381
added auth to dataset endpopints
2026-02-28 01:17:43 -08:00
Manan17
07cf1110ce
adding custom mapping according to the chat templates
2026-02-24 21:15:56 +00:00
Roland Tannous
11b3029dc6
Simplify dataset check to 2-tier, improve multimodal detection, auto-set trainOnCompletions, recheck dataset on reload
2026-02-19 11:25:54 +00:00
Roland Tannous
4d0c6d20b3
fix: fix: stream HF datasets in check-format endpoint to avoid full downloads; add info logging to model config endpoints
2026-02-17 22:53:29 +00:00
Roland Tannous
90c3561adb
feat: add eval split auto-detection, eval_steps hyperparam, and eval_loss chart integration
2026-02-16 13:38:54 +00:00
Roland Tannous
38cb5c9496
feat: thread dataset subset/split params from API routes through to load_dataset calls
2026-02-16 03:56:22 +00:00
Roland Tannous
4e4fc367b6
fix: auto-detect multimodal datasets in /check-format without requiring is_vlm flag
2026-02-13 17:29:39 +00:00
Shine1i
0ebfb5be76
feat: add support for serialized previews in dataset API and improve training initialization logging
2026-02-13 13:47:17 +01:00
Roland Tannous
a2c7f1b1b8
return raw preview samples on format detection failure for manual column mapping
2026-02-12 15:39:56 +00:00
Roland Tannous
f780b0db43
feat(datasets): check-format to return preview samples
2026-02-12 11:25:47 +00:00
Roland Tannous
996b16f9ee
Add datasets check-format endpoint
2026-02-03 20:42:25 +00:00
