ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
789 commits 391 branches 58 tags 304 MiB
Commit graph

546 commits

Author SHA1 Message Date
Roland Tannous
878f8f3924 fix: remove UnslothTrainer/get_trainer from core __init__ exports 2026-03-05 15:57:07 +00:00
Roland Tannous
f8bd4303f7 feat: subprocess-based training for transformers version switching 2026-03-05 15:40:32 +00:00
Roland Tannous
81b4928e99 Merge nightly into feature/transformers-v5-support 2026-03-05 06:49:44 +00:00
Roland Tannous
4e9c248fa8 Merge pull request #314 from unslothai/fix/vlm-dataset-conversion-error-handling-local 
Fix VLM training abort on URL-based dataset conversion failure
 2026-03-05 10:10:58 +04:00
Roland Tannous
c171573a8f fix: check for http(s) prefix instead of bare string type for URL detection 2026-03-05 06:10:10 +00:00
Roland Tannous
657cdaa151 fix: remove benchmark scripts from git tracking 
These are standalone benchmark scripts that were force-added despite being
gitignored. They have no test functions and run network calls at module
level, which breaks pytest collection in CI.
 2026-03-05 06:06:47 +00:00
Roland Tannous
352fe023a5 fix: clear dataset slice state when switching to uploaded file 
Prevents stale slice values from silently truncating uploaded datasets.
 2026-03-04 23:42:23 +00:00
Roland Tannous
9ca45826d4 feat: parallel URL image probe with time estimate and progress reporting 
- Add 200-sample parallel probe using ThreadPoolExecutor + safe_num_proc
  to estimate download speed and failure rate before full conversion
- Abort with clear error if >=30% of probe images fail to download
- Show estimated download time in the training overlay modal
- Parallel batch conversion for URL-based datasets (vs sequential for local)
- Add warning field to /check-format response for URL-based image datasets
- Display URL warning in dataset preview dialog (amber banner)
- Thread progress_callback from trainer through format_and_template_dataset
  to convert_to_vlm_format for real-time status updates
 2026-03-04 23:40:38 +00:00
Roland Tannous
195c1a3ce3 test: add parallel download benchmark with ThreadPoolExecutor 2026-03-04 23:29:43 +00:00
Roland Tannous
f59eaad212 feat: add tqdm progress bar to VLM conversion and download benchmark test 2026-03-04 23:29:43 +00:00
Roland Tannous
50885a7aa3 fix: add early probe to fail fast on datasets with too many broken image URLs 2026-03-04 23:29:43 +00:00
Roland Tannous
fdc23f4a43 fix: use fsspec for URL image downloads with per-sample error handling 2026-03-04 23:29:43 +00:00
Roland Tannous
8039eebcd5 test: add URL image loading comparison script 2026-03-04 23:29:43 +00:00
Roland Tannous
2b704221f7 fix: abort training pipeline on dataset conversion failure 2026-03-04 23:29:43 +00:00
Roland Tannous
929c3e9e1e fix: cast URL image columns to HF Image() type in VLM conversion 2026-03-04 23:29:43 +00:00
Roland Tannous
40f2dc517f fix: remove unnecessary tooltip copy from train split start 2026-03-04 23:24:09 +00:00
Roland Tannous
8199e0d2c0 refactor: move train split slice controls back to Advanced section 
Place Train Split Start / End inputs inside the Advanced collapsible
with descriptive tooltips clarifying they slice the training split.
Revert the selectors component to its original eval-split-only layout.
 2026-03-04 23:24:09 +00:00
Roland Tannous
5f0559926c refactor: move index range fields next to eval split in 3-col grid 
Place Slice Start and Slice End inputs alongside the Eval Split
selector in a single row (grid-cols-3) so the dataset card stays
compact. Remove the duplicate controls from the Advanced section.
 2026-03-04 23:24:09 +00:00
Roland Tannous
a80188848d feat: add index range dataset slicing to studio training page 
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
 2026-03-04 23:24:09 +00:00
Roland Tannous
91783c0fb2 Revert "Add index range dataset slicing to Studio training page" 2026-03-05 03:21:07 +04:00
Roland Tannous
9f9d480e63 Merge pull request #310 from unslothai/feature/index-range-dataset-slicing 
Add index range dataset slicing to Studio training page
 2026-03-05 03:20:31 +04:00
Roland Tannous
42ee6fe443 fix: remove unnecessary tooltip copy from train split start 2026-03-04 23:15:49 +00:00
Roland Tannous
7f8c0867d5 refactor: move train split slice controls back to Advanced section 
Place Train Split Start / End inputs inside the Advanced collapsible
with descriptive tooltips clarifying they slice the training split.
Revert the selectors component to its original eval-split-only layout.
 2026-03-04 23:07:36 +00:00
Roland Tannous
07bbe7bae5 refactor: move index range fields next to eval split in 3-col grid 
Place Slice Start and Slice End inputs alongside the Eval Split
selector in a single row (grid-cols-3) so the dataset card stays
compact. Remove the duplicate controls from the Advanced section.
 2026-03-04 22:35:17 +00:00
Roland Tannous
11ebea6a4b feat: add index range dataset slicing to studio training page 
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
 2026-03-04 21:48:40 +00:00
Roland Tannous
880633e42b test: add parallel download benchmark with ThreadPoolExecutor 2026-03-04 14:30:11 +00:00
Roland Tannous
e4ec16296e feat: add tqdm progress bar to VLM conversion and download benchmark test 2026-03-04 13:30:27 +00:00
Roland Tannous
5ee9479e37 fix: add early probe to fail fast on datasets with too many broken image URLs 2026-03-04 08:05:40 +00:00
Roland Tannous
722744cf04 fix: use fsspec for URL image downloads with per-sample error handling 2026-03-04 07:50:55 +00:00
Roland Tannous
6ba669c8eb test: add URL image loading comparison script 2026-03-04 07:39:35 +00:00
Roland Tannous
645d7d357a fix: abort training pipeline on dataset conversion failure 2026-03-04 06:42:48 +00:00
Roland Tannous
34fb9ec973 fix: cast URL image columns to HF Image() type in VLM conversion 2026-03-04 06:42:37 +00:00
Roland Tannous
2575b9e37d Merge pull request #305 from unslothai/fix/dropdown-layout-shift 
Prevent select dropdowns from shifting layout when opened
 2026-03-04 10:19:27 +04:00
Roland Tannous
12a4350a61 Merge pull request #306 from unslothai/fix/hf-dataset-error-message 
Sanitize dataset script errors and persist training start error
 2026-03-04 10:14:26 +04:00
Roland Tannous
43bf599b33 Remove overly broad .py check from dataset error normalization 2026-03-04 06:13:47 +00:00
Roland Tannous
2d7d3cd27e Merge pull request #287 from unslothai/fix/duplicate-def-inference 
Deleted duplicate definitions for load_for_eval, load_adapter, and load_model_simple in core Inference
 2026-03-04 10:06:04 +04:00
Roland Tannous
46550ecf24 Merge pull request #289 from unslothai/fix/datasets-auth 
Added auth to dataset endpoints
 2026-03-04 08:21:42 +04:00
imagineer99
a0f4566173 fix: sanitize dataset script errors and persist training start error 2026-03-03 20:15:23 +00:00
imagineer99
84bb57f208 fix: prevent select scroll-lock margin from shifting layout 2026-03-03 18:37:46 +00:00
Roland Tannous
7bc235bed2 Merge branch 'nightly' into feature/windows-native-support 2026-03-03 22:23:18 +04:00
Roland Tannous
a4d2853fbc fix: align llama-server binary discovery with upstream unsloth-zoo paths 2026-03-03 17:03:01 +00:00
Roland Tannous
e280e457d1 Move llama.cpp clone/build from in-tree to ~/.unsloth/llama.cpp 
- setup.sh: builds at ~/.unsloth/llama.cpp instead of ./llama.cpp
- setup.ps1: builds at %USERPROFILE%/.unsloth/llama.cpp
- inference llama_cpp.py: searches ~/.unsloth/ first, in-tree as legacy
- export.py: updated comments (unsloth-zoo handles path natively)
 2026-03-02 04:04:41 +00:00
Wasim Yousef Said
dc7976c534 Merge pull request #294 from unslothai/fix/navbar-center-tabs-shift 
Prevent navbar tab shift when navigating across pages
 2026-03-01 15:42:19 +01:00
Wasim Yousef Said
2df2d671ce Merge pull request #290 from unslothai/fix/model-dropdown-visual-consistency 
Standard OOM/TIGHT model status indicators across model dropdowns
 2026-03-01 15:41:39 +01:00
Roland Tannous
6e5a3d1744 Download GGUF via huggingface_hub instead of llama-server -hf (fixes HTTPS not supported on Windows) 2026-03-01 13:05:10 +00:00
Roland Tannous
12867f701b Auto-add CUDA DLLs to PATH when launching llama-server on Windows 2026-03-01 13:05:10 +00:00
Roland Tannous
3521de7040 Build llama.cpp in-tree, auto-detect driver CUDA version for compatible toolkit 2026-03-01 13:05:10 +00:00
Roland Tannous
f036a70681 Fix llama-server binary lookup for Windows (.exe, Release dir, ~/.unsloth) 2026-03-01 13:05:10 +00:00
Roland Tannous
7e021886c8 Force num_proc=1 on Windows to avoid slow spawn overhead 2026-03-01 13:05:10 +00:00
Roland Tannous
ff93c97024 fix: support mmproj for local vision GGUF models + fix Windows pipe deadlock 2026-03-01 12:58:38 +00:00