Shine1i
b08b606b21
feat(studio): studio storage roots path utilities
2026-03-09 23:48:31 +00:00
Roland Tannous
a0f03d3080
Add AGPL-3.0 SPDX headers to all source files
2026-03-09 20:17:45 +00:00
Roland Tannous
65d3539bac
Merge pull request #342 from unslothai/local-dataset
...
dataset upload
2026-03-09 21:22:23 +04:00
Roland Tannous
a8992279b6
fix: split dataset 80/20 when eval split matches train split
2026-03-09 16:36:44 +00:00
Roland Tannous
07ba02d610
include all candidate files when scanning a directory, not just the first
2026-03-09 13:52:45 +00:00
Roland Tannous
dcedc4df56
merge nightly, resolve conflict in use-chat-model-runtime
2026-03-09 13:19:17 +00:00
Manan17
b430e23c0e
dataset upload
2026-03-09 05:50:18 +00:00
Shine1i
4aa171b079
feat(recipe-studio, datasets): improve dataset handling and update metadata logic
2026-03-09 02:47:32 +01:00
Shine1i
d951e5aef0
merge nightly
2026-03-09 00:32:33 +01:00
samit
6aa50d353f
exposed trust_remote_code through the UI
2026-03-08 16:28:56 -07:00
Roland Tannous
7db2c90cc6
merge nightly into audio branch (mock test)
2026-03-08 10:23:44 +00:00
Manan17
2ce36df03c
check fir gated repo
2026-03-07 21:32:50 +00:00
Roland Tannous
9543fa0d1c
fix: scope dataloader_num_workers=0 to Windows + transformers 5.x only
2026-03-07 17:55:59 +00:00
Roland Tannous
dcebfe718a
fix: prevent training hang on Windows by adding triton-windows support
2026-03-07 17:53:36 +00:00
Roland Tannous
c882a3d2f7
fix: propagate PYTHONPATH to child subprocesses, revert tokenizer patching
2026-03-07 11:28:24 +00:00
Roland Tannous
42bd976a2f
fix: patch TokenizersBackend by model name - Qwen3.5→Qwen2Tokenizer, GLM→PreTrainedTokenizer
2026-03-07 10:29:59 +00:00
Roland Tannous
44e9b838ae
fix: patch Qwen3.5 broken tokenizer_class TokenizersBackend across all backends
2026-03-07 09:43:25 +00:00
Shine1i
6fc829e3ef
merge: nightly into feature/data-reciper-enchansments
2026-03-05 14:51:08 +01:00
Shine1i
f988202290
refactor(studio): add local data-recipe dataset selection + training wiring
2026-03-05 12:25:51 +01:00
Manan17
8203637d89
resolved merge conflicts
2026-03-05 07:59:43 +00:00
Manan17
2fa933640e
fix SNAC training crash on variable-length sequences with DataCollatorForSeq2Seq
2026-03-05 07:04:53 +00:00
Roland Tannous
f57664e268
Merge nightly into feature/transformers-v5-support
2026-03-05 06:49:44 +00:00
Roland Tannous
e04b9d53d6
feat: parallel URL image probe with time estimate and progress reporting
...
- Add 200-sample parallel probe using ThreadPoolExecutor + safe_num_proc
to estimate download speed and failure rate before full conversion
- Abort with clear error if >=30% of probe images fail to download
- Show estimated download time in the training overlay modal
- Parallel batch conversion for URL-based datasets (vs sequential for local)
- Add warning field to /check-format response for URL-based image datasets
- Display URL warning in dataset preview dialog (amber banner)
- Thread progress_callback from trainer through format_and_template_dataset
to convert_to_vlm_format for real-time status updates
2026-03-04 23:40:38 +00:00
Roland Tannous
b376c54c21
fix: abort training pipeline on dataset conversion failure
2026-03-04 23:29:43 +00:00
Roland Tannous
64889cd5fc
feat: add index range dataset slicing to studio training page
...
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
2026-03-04 23:24:09 +00:00
Roland Tannous
9333f99dd3
Revert "Add index range dataset slicing to Studio training page"
2026-03-05 03:21:07 +04:00
Roland Tannous
02b17ec6d9
feat: add index range dataset slicing to studio training page
...
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
2026-03-04 21:48:40 +00:00
Manan17
ee23628b0c
dynamic detection of audio models and fixing autoencoder issues
2026-03-04 10:44:44 +00:00
Roland Tannous
c6d82a6fad
fix: abort training pipeline on dataset conversion failure
2026-03-04 06:42:48 +00:00
Manan17
6fd1dd2c0a
variable changes and some cleanup
2026-03-03 09:35:11 +00:00
Manan17
8cdeb006b6
code cleanup
2026-03-01 08:04:38 +00:00
Manan17
9e89f31bc7
revamping up the code and adding inference
2026-03-01 02:30:31 +00:00
Manan17
90332924de
Changes with audio training
2026-03-01 02:27:45 +00:00
Manan17
2c5621dd8c
merging with nightly
2026-03-01 02:27:45 +00:00
Roland Tannous
efaa0bacfb
Merge branch 'nightly' into feat/gguf-llama-cpp-inference
2026-02-25 16:06:03 +04:00
Roland Tannous
d9434fee4a
fix: use raw github URL for vision.py patch + add VLM processor diagnostic logging
2026-02-25 10:29:05 +00:00
Roland Tannous
a661784d41
Merge pull request #232 from unslothai/fix/disable-eval-by-default
...
# fix/disable eval by default
2026-02-24 13:35:11 +04:00
Roland Tannous
a15082acfe
skip eval split and HF split detection when eval_steps is disabled
2026-02-24 09:26:54 +00:00
Leo Borcherding
86388a0242
fix: disable eval by default, set eval_steps to 0.0
...
- Changed default eval_steps from 0.01 to 0.0 across backend and frontend
- Fixed UI to allow eval_steps=0 (removed min=0.001 constraint)
- Added conditional eval logic with helpful console messages
- Updated tooltip to explain how to disable evaluation
- Tested: confirmed eval disabled by default with eval_steps=0.0
2026-02-23 13:07:47 -06:00
Roland Tannous
834013aae5
Cap dataset.map num_proc on multi-GPU machines to prevent fork deadlocks
2026-02-23 14:25:31 +00:00
Roland Tannous
fbc934c231
Merge branch 'nightly' into feature/transformers-v5-support
2026-02-23 13:32:51 +00:00
Roland Tannous
d94f842158
fix: error on >30% sample drop after train_on_responses_only instead of silent DataLoader crash
2026-02-23 12:21:06 +00:00
Roland Tannous
036d85c9e4
Merge nightly into feature/transformers-v5-support
2026-02-23 07:40:28 +00:00
Roland Tannous
198433363a
feat: clear unsloth_compiled_cache on startup, shutdown, and between model loads
2026-02-23 07:26:22 +00:00
Roland Tannous
778762eb28
Patch adapter_config.json with unsloth_training_method and auto-detect load_in_4bit for LoRA inference
2026-02-22 20:27:52 +00:00
Roland Tannous
e666442b6e
fix: pass full Processor as processing_class for VLM SFTTrainer
2026-02-22 14:11:12 +00:00
Manan17
bd0cee8c15
Setting it to total cpu_count // 4
2026-02-20 06:32:01 +00:00
Roland Tannous
c876b38780
reduce dataset_num_proc to 1/4 of cpu_count
2026-02-18 20:53:32 +00:00
Roland Tannous
23214c41c0
fix: unwrap ProcessorMixin to raw tokenizer for text-only SFTTrainer on VLM-architecture models
2026-02-18 19:13:20 +00:00
Roland Tannous
9840864662
Merge remote-tracking branch 'origin/nightly' into fix/dataset-mapping-vlm-text-datasets
2026-02-18 18:11:45 +04:00
