ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
766 commits 391 branches 58 tags 304 MiB
Commit graph

766 commits

This branch
This branch
All branches
Author SHA1 Message Date
Roland Tannous
9ca45826d4 feat: parallel URL image probe with time estimate and progress reporting 
- Add 200-sample parallel probe using ThreadPoolExecutor + safe_num_proc
  to estimate download speed and failure rate before full conversion
- Abort with clear error if >=30% of probe images fail to download
- Show estimated download time in the training overlay modal
- Parallel batch conversion for URL-based datasets (vs sequential for local)
- Add warning field to /check-format response for URL-based image datasets
- Display URL warning in dataset preview dialog (amber banner)
- Thread progress_callback from trainer through format_and_template_dataset
  to convert_to_vlm_format for real-time status updates
 2026-03-04 23:40:38 +00:00
Roland Tannous
195c1a3ce3 test: add parallel download benchmark with ThreadPoolExecutor 2026-03-04 23:29:43 +00:00
Roland Tannous
f59eaad212 feat: add tqdm progress bar to VLM conversion and download benchmark test 2026-03-04 23:29:43 +00:00
Roland Tannous
50885a7aa3 fix: add early probe to fail fast on datasets with too many broken image URLs 2026-03-04 23:29:43 +00:00
Roland Tannous
fdc23f4a43 fix: use fsspec for URL image downloads with per-sample error handling 2026-03-04 23:29:43 +00:00
Roland Tannous
8039eebcd5 test: add URL image loading comparison script 2026-03-04 23:29:43 +00:00
Roland Tannous
2b704221f7 fix: abort training pipeline on dataset conversion failure 2026-03-04 23:29:43 +00:00
Roland Tannous
929c3e9e1e fix: cast URL image columns to HF Image() type in VLM conversion 2026-03-04 23:29:43 +00:00
Roland Tannous
f55153249d Merge pull request #312 from unslothai/feature/index-range-dataset-slicing 
Add index range dataset slicing to Studio training page
 2026-03-05 03:25:21 +04:00
Roland Tannous
40f2dc517f fix: remove unnecessary tooltip copy from train split start 2026-03-04 23:24:09 +00:00
Roland Tannous
8199e0d2c0 refactor: move train split slice controls back to Advanced section 
Place Train Split Start / End inputs inside the Advanced collapsible
with descriptive tooltips clarifying they slice the training split.
Revert the selectors component to its original eval-split-only layout.
 2026-03-04 23:24:09 +00:00
Roland Tannous
5f0559926c refactor: move index range fields next to eval split in 3-col grid 
Place Slice Start and Slice End inputs alongside the Eval Split
selector in a single row (grid-cols-3) so the dataset card stays
compact. Remove the duplicate controls from the Advanced section.
 2026-03-04 23:24:09 +00:00
Roland Tannous
a80188848d feat: add index range dataset slicing to studio training page 
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
 2026-03-04 23:24:09 +00:00
Roland Tannous
505487f66a Merge pull request #311 from unslothai/revert-310-feature/index-range-dataset-slicing 
Revert "Add index range dataset slicing to Studio training page"
 2026-03-05 03:23:31 +04:00
Roland Tannous
91783c0fb2 Revert "Add index range dataset slicing to Studio training page" 2026-03-05 03:21:07 +04:00
Roland Tannous
9f9d480e63 Merge pull request #310 from unslothai/feature/index-range-dataset-slicing 
Add index range dataset slicing to Studio training page
 2026-03-05 03:20:31 +04:00
Roland Tannous
42ee6fe443 fix: remove unnecessary tooltip copy from train split start 2026-03-04 23:15:49 +00:00
Roland Tannous
7f8c0867d5 refactor: move train split slice controls back to Advanced section 
Place Train Split Start / End inputs inside the Advanced collapsible
with descriptive tooltips clarifying they slice the training split.
Revert the selectors component to its original eval-split-only layout.
 2026-03-04 23:07:36 +00:00
Roland Tannous
07bbe7bae5 refactor: move index range fields next to eval split in 3-col grid 
Place Slice Start and Slice End inputs alongside the Eval Split
selector in a single row (grid-cols-3) so the dataset card stays
compact. Remove the duplicate controls from the Advanced section.
 2026-03-04 22:35:17 +00:00
Roland Tannous
11ebea6a4b feat: add index range dataset slicing to studio training page 
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
 2026-03-04 21:48:40 +00:00
Roland Tannous
880633e42b test: add parallel download benchmark with ThreadPoolExecutor 2026-03-04 14:30:11 +00:00
Roland Tannous
e4ec16296e feat: add tqdm progress bar to VLM conversion and download benchmark test 2026-03-04 13:30:27 +00:00
Roland Tannous
5ee9479e37 fix: add early probe to fail fast on datasets with too many broken image URLs 2026-03-04 08:05:40 +00:00
Roland Tannous
722744cf04 fix: use fsspec for URL image downloads with per-sample error handling 2026-03-04 07:50:55 +00:00
Roland Tannous
6ba669c8eb test: add URL image loading comparison script 2026-03-04 07:39:35 +00:00
Roland Tannous
645d7d357a fix: abort training pipeline on dataset conversion failure 2026-03-04 06:42:48 +00:00
Roland Tannous
34fb9ec973 fix: cast URL image columns to HF Image() type in VLM conversion 2026-03-04 06:42:37 +00:00
Roland Tannous
2575b9e37d Merge pull request #305 from unslothai/fix/dropdown-layout-shift 
Prevent select dropdowns from shifting layout when opened
 2026-03-04 10:19:27 +04:00
Roland Tannous
12a4350a61 Merge pull request #306 from unslothai/fix/hf-dataset-error-message 
Sanitize dataset script errors and persist training start error
 2026-03-04 10:14:26 +04:00
Roland Tannous
43bf599b33 Remove overly broad .py check from dataset error normalization 2026-03-04 06:13:47 +00:00
Roland Tannous
2d7d3cd27e Merge pull request #287 from unslothai/fix/duplicate-def-inference 
Deleted duplicate definitions for load_for_eval, load_adapter, and load_model_simple in core Inference
 2026-03-04 10:06:04 +04:00
Roland Tannous
46550ecf24 Merge pull request #289 from unslothai/fix/datasets-auth 
Added auth to dataset endpoints
 2026-03-04 08:21:42 +04:00
imagineer99
a0f4566173 fix: sanitize dataset script errors and persist training start error 2026-03-03 20:15:23 +00:00
Roland Tannous
50b88bfb34 Updated README 2026-03-03 18:42:35 +00:00
imagineer99
84bb57f208 fix: prevent select scroll-lock margin from shifting layout 2026-03-03 18:37:46 +00:00
Roland Tannous
4ddf59f781 Merge pull request #296 from unslothai/feature/windows-native-support 
PR: Windows Native Support + llama.cpp Build Migration
 2026-03-03 22:23:35 +04:00
Roland Tannous
7bc235bed2 Merge branch 'nightly' into feature/windows-native-support 2026-03-03 22:23:18 +04:00
Roland Tannous
58b00db5cb chore: add cross-platform Python installer with updated unsloth patch URLs 2026-03-03 17:31:59 +00:00
Roland Tannous
a4d2853fbc fix: align llama-server binary discovery with upstream unsloth-zoo paths 2026-03-03 17:03:01 +00:00
Roland Tannous
bded396923 Merge pull request #297 from unslothai/fix/fix-pip-issues 
fix: make pip check non-fatal and install jedi for Colab compatibility
 2026-03-03 13:35:29 +04:00
Roland Tannous
f190d5a16d fix: make pip check non-fatal and install jedi for Colab compatibility 2026-03-03 09:34:35 +00:00
Roland Tannous
c64e50b46f Patch unsloth-zoo llama_cpp.py and unsloth save.py from windows-support branch 2026-03-02 10:45:09 +00:00
Roland Tannous
e280e457d1 Move llama.cpp clone/build from in-tree to ~/.unsloth/llama.cpp 
- setup.sh: builds at ~/.unsloth/llama.cpp instead of ./llama.cpp
- setup.ps1: builds at %USERPROFILE%/.unsloth/llama.cpp
- inference llama_cpp.py: searches ~/.unsloth/ first, in-tree as legacy
- export.py: updated comments (unsloth-zoo handles path natively)
 2026-03-02 04:04:41 +00:00
Wasim Yousef Said
dc7976c534 Merge pull request #294 from unslothai/fix/navbar-center-tabs-shift 
Prevent navbar tab shift when navigating across pages
 2026-03-01 15:42:19 +01:00
Wasim Yousef Said
2df2d671ce Merge pull request #290 from unslothai/fix/model-dropdown-visual-consistency 
Standard OOM/TIGHT model status indicators across model dropdowns
 2026-03-01 15:41:39 +01:00
Roland Tannous
674cc67d78 Tighten Python bounds to >= 3.11, < 3.14 (matching setup.sh), only auto-install if missing 2026-03-01 13:05:10 +00:00
Roland Tannous
d5644d2d0d Add Python 3.12 prerequisite check with auto-install via winget 2026-03-01 13:05:10 +00:00
Roland Tannous
0267ba0a18 Auto-enable Windows Long Paths via UAC elevation during setup 2026-03-01 13:05:10 +00:00
Roland Tannous
6536bfb33b Remove unused CMP0194 cmake policy (eliminates cmake warning) 2026-03-01 13:05:10 +00:00
Roland Tannous
453f423d22 Simplify: use winget OpenSSL.Dev instead of vcpkg for HTTPS support 2026-03-01 13:05:10 +00:00