ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
803 commits 391 branches 58 tags 304 MiB
Commit graph

803 commits

This branch
This branch
All branches
Author SHA1 Message Date
Shine1i
552eb06bed feat(data-recipes, validators): add OXC validator runtime and integration with recipe studio 2026-03-05 19:48:26 +01:00
Shine1i
b277308b7e merge: nightly into feature/data-reciper-enchansments 2026-03-05 14:51:08 +01:00
Shine1i
9a5cea201a feat(recipe-studio): runtime edge handling with template refs and reversed edge support 2026-03-05 14:46:48 +01:00
Shine1i
889b3f78a8 refactor(studio): replace inputValue with searchQuery for improved clarity, add input reason tracking, and streamline dataset filtering logic 2026-03-05 14:06:17 +01:00
Shine1i
cc74d01df7 feat(recipe-studio): improve tab switch fit logic with animation and delay support 2026-03-05 13:29:38 +01:00
Shine1i
a66b1678e8 feat(recipe-studio): normalize and slugify run_name, update job naming logic 2026-03-05 12:25:51 +01:00
Shine1i
e30fc87187 refactor(studio): add local data-recipe dataset selection + training wiring 2026-03-05 12:25:51 +01:00
Shine1i
85d92281f3 feat(data-recipes, recipe-studio): refactor and enhance recipe templates with updated model configurations, structure changes, and added validation logic 2026-03-05 12:14:01 +01:00
Shine1i
bffda3a479 feat(recipe-studio): persist advanced collapsible states across components and sessions 2026-03-05 11:56:40 +01:00
Shine1i
9062755e8f feat(data-recipes, recipe-studio): recipies changes, image context selector 2026-03-05 11:46:42 +01:00
Shine1i
337cb4de8d feat(data-recipes): update recipe templates 2026-03-05 11:29:20 +01:00
Roland Tannous
4e9c248fa8 Merge pull request #314 from unslothai/fix/vlm-dataset-conversion-error-handling-local 
Fix VLM training abort on URL-based dataset conversion failure
 2026-03-05 10:10:58 +04:00
Roland Tannous
c171573a8f fix: check for http(s) prefix instead of bare string type for URL detection 2026-03-05 06:10:10 +00:00
Roland Tannous
657cdaa151 fix: remove benchmark scripts from git tracking 
These are standalone benchmark scripts that were force-added despite being
gitignored. They have no test functions and run network calls at module
level, which breaks pytest collection in CI.
 2026-03-05 06:06:47 +00:00
imagineer99
69299c168c feat(data-recipes): add OCR learning recipe template 2026-03-05 00:58:29 +00:00
Roland Tannous
8218cb651e Merge pull request #313 from unslothai/feature/index-range-dataset-slicing 
Fix: clear dataset slice state on file upload
 2026-03-05 03:48:10 +04:00
Roland Tannous
352fe023a5 fix: clear dataset slice state when switching to uploaded file 
Prevents stale slice values from silently truncating uploaded datasets.
 2026-03-04 23:42:23 +00:00
Roland Tannous
9ca45826d4 feat: parallel URL image probe with time estimate and progress reporting 
- Add 200-sample parallel probe using ThreadPoolExecutor + safe_num_proc
  to estimate download speed and failure rate before full conversion
- Abort with clear error if >=30% of probe images fail to download
- Show estimated download time in the training overlay modal
- Parallel batch conversion for URL-based datasets (vs sequential for local)
- Add warning field to /check-format response for URL-based image datasets
- Display URL warning in dataset preview dialog (amber banner)
- Thread progress_callback from trainer through format_and_template_dataset
  to convert_to_vlm_format for real-time status updates
 2026-03-04 23:40:38 +00:00
Roland Tannous
195c1a3ce3 test: add parallel download benchmark with ThreadPoolExecutor 2026-03-04 23:29:43 +00:00
Roland Tannous
f59eaad212 feat: add tqdm progress bar to VLM conversion and download benchmark test 2026-03-04 23:29:43 +00:00
Roland Tannous
50885a7aa3 fix: add early probe to fail fast on datasets with too many broken image URLs 2026-03-04 23:29:43 +00:00
Roland Tannous
fdc23f4a43 fix: use fsspec for URL image downloads with per-sample error handling 2026-03-04 23:29:43 +00:00
Roland Tannous
8039eebcd5 test: add URL image loading comparison script 2026-03-04 23:29:43 +00:00
Roland Tannous
2b704221f7 fix: abort training pipeline on dataset conversion failure 2026-03-04 23:29:43 +00:00
Roland Tannous
929c3e9e1e fix: cast URL image columns to HF Image() type in VLM conversion 2026-03-04 23:29:43 +00:00
Roland Tannous
f55153249d Merge pull request #312 from unslothai/feature/index-range-dataset-slicing 
Add index range dataset slicing to Studio training page
 2026-03-05 03:25:21 +04:00
Roland Tannous
40f2dc517f fix: remove unnecessary tooltip copy from train split start 2026-03-04 23:24:09 +00:00
Roland Tannous
8199e0d2c0 refactor: move train split slice controls back to Advanced section 
Place Train Split Start / End inputs inside the Advanced collapsible
with descriptive tooltips clarifying they slice the training split.
Revert the selectors component to its original eval-split-only layout.
 2026-03-04 23:24:09 +00:00
Roland Tannous
5f0559926c refactor: move index range fields next to eval split in 3-col grid 
Place Slice Start and Slice End inputs alongside the Eval Split
selector in a single row (grid-cols-3) so the dataset card stays
compact. Remove the duplicate controls from the Advanced section.
 2026-03-04 23:24:09 +00:00
Roland Tannous
a80188848d feat: add index range dataset slicing to studio training page 
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
 2026-03-04 23:24:09 +00:00
Roland Tannous
505487f66a Merge pull request #311 from unslothai/revert-310-feature/index-range-dataset-slicing 
Revert "Add index range dataset slicing to Studio training page"
 2026-03-05 03:23:31 +04:00
Roland Tannous
91783c0fb2 Revert "Add index range dataset slicing to Studio training page" 2026-03-05 03:21:07 +04:00
Roland Tannous
9f9d480e63 Merge pull request #310 from unslothai/feature/index-range-dataset-slicing 
Add index range dataset slicing to Studio training page
 2026-03-05 03:20:31 +04:00
Roland Tannous
42ee6fe443 fix: remove unnecessary tooltip copy from train split start 2026-03-04 23:15:49 +00:00
Roland Tannous
7f8c0867d5 refactor: move train split slice controls back to Advanced section 
Place Train Split Start / End inputs inside the Advanced collapsible
with descriptive tooltips clarifying they slice the training split.
Revert the selectors component to its original eval-split-only layout.
 2026-03-04 23:07:36 +00:00
Roland Tannous
07bbe7bae5 refactor: move index range fields next to eval split in 3-col grid 
Place Slice Start and Slice End inputs alongside the Eval Split
selector in a single row (grid-cols-3) so the dataset card stays
compact. Remove the duplicate controls from the Advanced section.
 2026-03-04 22:35:17 +00:00
Roland Tannous
11ebea6a4b feat: add index range dataset slicing to studio training page 
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
 2026-03-04 21:48:40 +00:00
Roland Tannous
880633e42b test: add parallel download benchmark with ThreadPoolExecutor 2026-03-04 14:30:11 +00:00
Roland Tannous
e4ec16296e feat: add tqdm progress bar to VLM conversion and download benchmark test 2026-03-04 13:30:27 +00:00
Roland Tannous
5ee9479e37 fix: add early probe to fail fast on datasets with too many broken image URLs 2026-03-04 08:05:40 +00:00
Roland Tannous
722744cf04 fix: use fsspec for URL image downloads with per-sample error handling 2026-03-04 07:50:55 +00:00
Roland Tannous
6ba669c8eb test: add URL image loading comparison script 2026-03-04 07:39:35 +00:00
Roland Tannous
645d7d357a fix: abort training pipeline on dataset conversion failure 2026-03-04 06:42:48 +00:00
Roland Tannous
34fb9ec973 fix: cast URL image columns to HF Image() type in VLM conversion 2026-03-04 06:42:37 +00:00
Roland Tannous
2575b9e37d Merge pull request #305 from unslothai/fix/dropdown-layout-shift 
Prevent select dropdowns from shifting layout when opened
 2026-03-04 10:19:27 +04:00
Roland Tannous
12a4350a61 Merge pull request #306 from unslothai/fix/hf-dataset-error-message 
Sanitize dataset script errors and persist training start error
 2026-03-04 10:14:26 +04:00
Roland Tannous
43bf599b33 Remove overly broad .py check from dataset error normalization 2026-03-04 06:13:47 +00:00
Roland Tannous
2d7d3cd27e Merge pull request #287 from unslothai/fix/duplicate-def-inference 
Deleted duplicate definitions for load_for_eval, load_adapter, and load_model_simple in core Inference
 2026-03-04 10:06:04 +04:00
Roland Tannous
46550ecf24 Merge pull request #289 from unslothai/fix/datasets-auth 
Added auth to dataset endpoints
 2026-03-04 08:21:42 +04:00
Shine1i
29299d73b8 merge: nightly into feature/data-reciper-enchansments 
resolve setup.sh conflict by keeping nightly installer flow and preserving local data-designer plugin install via install_python_stack.py
 2026-03-03 22:21:04 +01:00