Shine1i
552eb06bed
feat(data-recipes, validators): add OXC validator runtime and integration with recipe studio
2026-03-05 19:48:26 +01:00
Roland Tannous
4eabc74f34
feat: subprocess-based inference for transformers version switching
...
Inference now runs in a persistent subprocess, solving the same
transformers version-switching problem that was fixed for training.
The subprocess stays alive between requests (model in GPU memory)
and is only restarted when switching transformers versions.
New files:
- core/inference/worker.py: subprocess entry point with command loop
- core/inference/orchestrator.py: parent-side proxy with same API
Modified:
- core/inference/__init__.py: exports orchestrator as default backend
- routes/inference.py: removed in-process ensure_transformers_version()
2026-03-05 17:47:57 +00:00
Roland Tannous
842c05e75a
fix: lazy imports in core/__init__ to prevent subprocess importing ML libs early
2026-03-05 16:56:45 +00:00
Roland Tannous
878f8f3924
fix: remove UnslothTrainer/get_trainer from core __init__ exports
2026-03-05 15:57:07 +00:00
Roland Tannous
f8bd4303f7
feat: subprocess-based training for transformers version switching
2026-03-05 15:40:32 +00:00
Shine1i
b277308b7e
merge: nightly into feature/data-reciper-enchansments
2026-03-05 14:51:08 +01:00
Shine1i
a66b1678e8
feat(recipe-studio): normalize and slugify run_name, update job naming logic
2026-03-05 12:25:51 +01:00
Shine1i
e30fc87187
refactor(studio): add local data-recipe dataset selection + training wiring
2026-03-05 12:25:51 +01:00
Manan17
79cc850a50
remove tracked OuteTTS embedded repo reference
2026-03-05 08:44:23 +00:00
Manan17
9909111982
resolved merge conflicts
2026-03-05 07:59:43 +00:00
Manan17
c723f8d4da
fix SNAC training crash on variable-length sequences with DataCollatorForSeq2Seq
2026-03-05 07:04:53 +00:00
Roland Tannous
81b4928e99
Merge nightly into feature/transformers-v5-support
2026-03-05 06:49:44 +00:00
Roland Tannous
9ca45826d4
feat: parallel URL image probe with time estimate and progress reporting
...
- Add 200-sample parallel probe using ThreadPoolExecutor + safe_num_proc
to estimate download speed and failure rate before full conversion
- Abort with clear error if >=30% of probe images fail to download
- Show estimated download time in the training overlay modal
- Parallel batch conversion for URL-based datasets (vs sequential for local)
- Add warning field to /check-format response for URL-based image datasets
- Display URL warning in dataset preview dialog (amber banner)
- Thread progress_callback from trainer through format_and_template_dataset
to convert_to_vlm_format for real-time status updates
2026-03-04 23:40:38 +00:00
Roland Tannous
2b704221f7
fix: abort training pipeline on dataset conversion failure
2026-03-04 23:29:43 +00:00
Roland Tannous
a80188848d
feat: add index range dataset slicing to studio training page
...
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
2026-03-04 23:24:09 +00:00
Roland Tannous
91783c0fb2
Revert "Add index range dataset slicing to Studio training page"
2026-03-05 03:21:07 +04:00
Roland Tannous
9f9d480e63
Merge pull request #310 from unslothai/feature/index-range-dataset-slicing
...
Add index range dataset slicing to Studio training page
2026-03-05 03:20:31 +04:00
Roland Tannous
11ebea6a4b
feat: add index range dataset slicing to studio training page
...
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
2026-03-04 21:48:40 +00:00
Manan17
a5825f8d44
dynamic detection of audio models and fixing autoencoder issues
2026-03-04 10:44:44 +00:00
Roland Tannous
645d7d357a
fix: abort training pipeline on dataset conversion failure
2026-03-04 06:42:48 +00:00
Roland Tannous
2d7d3cd27e
Merge pull request #287 from unslothai/fix/duplicate-def-inference
...
Deleted duplicate definitions for load_for_eval, load_adapter, and load_model_simple in core Inference
2026-03-04 10:06:04 +04:00
Shine1i
29299d73b8
merge: nightly into feature/data-reciper-enchansments
...
resolve setup.sh conflict by keeping nightly installer flow and preserving local data-designer plugin install via install_python_stack.py
2026-03-03 22:21:04 +01:00
Roland Tannous
a4d2853fbc
fix: align llama-server binary discovery with upstream unsloth-zoo paths
2026-03-03 17:03:01 +00:00
Shine1i
c88cce8185
refactor(seed): package unstructured seed reader as local Data Designer plugin
2026-03-03 11:22:04 +01:00
Shine1i
95dd202ab3
merge nightly into feature/data-reciper-enchansments
2026-03-03 11:14:18 +01:00
Shine1i
bdc825298d
feat(seed): backend unstructured seed reader + server-side chunking, remove client chunk splitter
2026-03-03 11:11:26 +01:00
Manan17
f04c684d8a
variable changes and some cleanup
2026-03-03 09:35:11 +00:00
Roland Tannous
87f2b2a9db
Merge branch 'nightly' into feature/support-for-audio-models
2026-03-02 15:55:25 +04:00
Roland Tannous
e280e457d1
Move llama.cpp clone/build from in-tree to ~/.unsloth/llama.cpp
...
- setup.sh: builds at ~/.unsloth/llama.cpp instead of ./llama.cpp
- setup.ps1: builds at %USERPROFILE%/.unsloth/llama.cpp
- inference llama_cpp.py: searches ~/.unsloth/ first, in-tree as legacy
- export.py: updated comments (unsloth-zoo handles path natively)
2026-03-02 04:04:41 +00:00
Roland Tannous
6e5a3d1744
Download GGUF via huggingface_hub instead of llama-server -hf (fixes HTTPS not supported on Windows)
2026-03-01 13:05:10 +00:00
Roland Tannous
12867f701b
Auto-add CUDA DLLs to PATH when launching llama-server on Windows
2026-03-01 13:05:10 +00:00
Roland Tannous
3521de7040
Build llama.cpp in-tree, auto-detect driver CUDA version for compatible toolkit
2026-03-01 13:05:10 +00:00
Roland Tannous
f036a70681
Fix llama-server binary lookup for Windows (.exe, Release dir, ~/.unsloth)
2026-03-01 13:05:10 +00:00
Roland Tannous
ff93c97024
fix: support mmproj for local vision GGUF models + fix Windows pipe deadlock
2026-03-01 12:58:38 +00:00
Shine1i
891739a56a
feat(recipe-studio): add LLM trace modes and reasoning content extraction support
2026-03-01 12:01:48 +01:00
Shine1i
b7ee065ffd
refactor(recipe-studio): add image preview support for dataset and LLM configurations p2
2026-03-01 11:21:10 +01:00
Shine1i
c3c65cded8
feat(recipe-studio): add image preview support for dataset and LLM configurations p1
2026-03-01 10:57:51 +01:00
Manan17
c636fd5a42
code cleanup
2026-03-01 08:04:38 +00:00
Manan17
c48437848d
revamping up the code and adding inference
2026-03-01 02:30:31 +00:00
Manan17
ab2ac39017
Changes with audio training
2026-03-01 02:27:45 +00:00
Manan17
ac27edde35
merging with nightly
2026-03-01 02:27:45 +00:00
samit
862b4100d2
deleted duplicate definitions
2026-02-27 06:00:28 -08:00
Manan17
168957a87a
Aggregating sharded models, showing fit/oom for quantizations
2026-02-27 08:23:15 +00:00
Shine1i
b7edf4e3cd
refactor(recipe-studio): simplify runtime graph flow + guard stale active execution lock p2
2026-02-26 15:37:48 +01:00
Shine1i
8a996afbfb
feat(recipe-studio): add live execution graph state (active flows, node status, editor lock) p1
2026-02-26 15:27:46 +01:00
Shine1i
00a869f837
refactor(data-recipe): centralize json+stage constants, tighten parser/errors, sync seed ui
2026-02-26 14:06:53 +01:00
Roland Tannous
ed18f9b9dd
Flatten GGUF subdirs in export and fix metadata lookup in scanner
2026-02-26 11:35:04 +04:00
Roland Tannous
90f012a444
Write export metadata for GGUF exports to fix Unknown base model
2026-02-26 11:24:32 +04:00
Roland Tannous
bfb1403032
Relocate GGUF exports into exports/ directory
2026-02-25 18:54:39 +04:00
Roland Tannous
01082b84e5
Merge branch 'nightly' into feat/gguf-llama-cpp-inference
2026-02-25 16:06:03 +04:00
