Commit graph

463 commits

Author SHA1 Message Date
Shine1i
d1fbf272b0 feat: add recipe execution stores, hooks, and logic for managing preview and full executions 2026-02-20 14:38:05 +01:00
Shine1i
40550df3c1 refactor: simplify execution view by removing unused state and redundant logic 2026-02-20 14:19:52 +01:00
Shine1i
c95bd3d75d feat: refine execution view with enhanced summary and insights
- Removed unused model usage properties (`total`, `tps`, `requestsSuccess`, etc.) for cleaner data handling.
- Added new metrics: total input/output tokens, null rate, and low uniqueness flags.
- Improved UI for execution summary cards with consolidated insights and model usage tables.
- Introduced detailed analysis for dataset columns, including dropped columns and LLM column counts.
- Optimized rendering logic to reduce clutter and enhance user experience.
2026-02-20 14:05:43 +01:00
Shine1i
394dc24048 feat: enhance execution log tracking, progress updates, and data visualization
- Added `log_lines` field to track and display runtime logs for executions.
- Enhanced progress tracking with terminal-like log outputs and live log scrolling.
- Introduced detailed "model usage" and "dropped columns" analysis in `ExecutionsView`.
- Optimized UI components for displaying dataset metrics, including input/output token averages.
2026-02-20 13:51:19 +01:00
Shine1i
415312a637 feat: improve dataset column visibility and cell expansion in ExecutionsView
- Added column visibility toggles using a dropdown menu for greater customization.
- Introduced expandable table cells for long values with "expand/collapse" functionality.
- Ensured hidden columns reset on execution change, providing a consistent user experience.
2026-02-20 13:04:57 +01:00
Shine1i
0891f19eea feat: enhance progress tracking for execution jobs
- Added logic to calculate and manage column-level progress for job executions.
- Introduced `progress_columns_total` and `_column_done` fields for more granular progress updates.
- Improved overall progress computation by considering total columns and individual progress per column.
2026-02-20 12:52:45 +01:00
Shine1i
f84454ecb8 feat: refactor and extend recipe execution logic
- Extracted shared execution utilities into `execution-helpers.ts` for reusability across features.
- Replaced deprecated `/preview` endpoint and its logic with unified job execution handling.
- Consolidated job execution flows ("Preview" and "Full Run") into shared `runJobExecution` logic.
- Enhanced execution progress tracking with support for column-level progress reporting.
- Added support for handling execution job events and improved error reporting from the backend.
- Updated backend to better manage dataset access errors and provide more informative error messages.
- Cleaned up redundant code in `use-recipe-studio-actions` and streamlined execution APIs.
2026-02-20 12:47:51 +01:00
Shine1i
8edd8ba95b feat: add dataset pagination support for recipe executions
- Introduced backend changes to handle dataset pagination with limit, offset, and total row support.
- Updated frontend execution view with dataset pagination controls, including "Next" and "Prev" buttons.
- Extended recipe execution logic to manage dataset pagination details like page number, page size, and total records.
2026-02-20 12:12:02 +01:00
Shine1i
d703059f0d feat: add support for full recipe executions with detailed progress and analysis
- Introduced "Full Run" support in execution logic, including progress tracking, cancellation, and job status updates.
- Extended backend to manage full execution jobs, handle dataset previews, and return detailed analysis and artifacts.
- Updated frontend components to support full runs, with execution sorting, live updates, and detailed execution views.
- Enhanced `ExecutionsView` with progress indicators, status filtering, and dataset preview capabilities.
- Added IndexedDB schema migration to track additional execution metadata.
2026-02-20 12:05:42 +01:00
Shine1i
ac776c5aad feat: introduce execution tracking and analysis for recipe preview
- Added `ExecutionsView` with execution history tracking, live updates, and detailed data analysis.
- Implemented IndexedDB support via Dexie to persist execution records locally.
- Enhanced backend preview logic to return execution analysis and artifacts.
- Updated studio header with view toggling between "Editor" and "Executions."
2026-02-20 11:34:25 +01:00
Shine1i
3dd1566b85 refactor: remove Jinja autocomplete components and simplify variable handling
- Deleted `jinja-ref-autocomplete` components and related hooks.
- Replaced custom Jinja variable autocomplete with standard `Textarea` and `Input` components.
- Streamlined variable handling logic by replacing `getAvailableRefItems` with `getAvailableVariables`.
- Removed unused state (`flowMoving`) and redundant logic tied to Jinja-specific functionality.
2026-02-20 10:36:51 +01:00
Wasim Yousef Said
a5ad6ff12f Merge branch 'nightly' into feature/canvas-lab 2026-02-20 01:23:44 -08:00
Roland Tannous
fc8259df4a Merge pull request #173 from unslothai/fix/hf-token-model-hiding
added hf token validation
2026-02-20 13:19:31 +04:00
Roland Tannous
ef9579e7c2 Merge pull request #175 from unslothai/fix/changing-num-proc-for-filtering
Fix/changing num proc for filtering
2026-02-20 10:39:11 +04:00
Roland Tannous
be2d44fa3e Merge pull request #171 from unslothai/fix/compare-mode-race-and-adapter-toggle
Fixing compare feature
2026-02-20 10:38:56 +04:00
Manan17
bd0cee8c15 Setting it to total cpu_count // 4 2026-02-20 06:32:01 +00:00
samit
6a2309a8fd added hf token validation 2026-02-19 21:05:27 -08:00
Manan17
444ece6b07 Fixing compare feature 2026-02-19 20:15:44 +00:00
Roland Tannous
1eca824513 Merge pull request #169 from unslothai/feature/backwards-compatibility-unsloth-ui-command
Add `unsloth-ui` alias for backwards compatibility
2026-02-19 22:44:41 +04:00
Roland Tannous
1bb79defd0 add unsloth-ui shell alias for backwards compatibility alongside unsloth-studio 2026-02-19 18:41:10 +00:00
Roland Tannous
3c3f69ec71 Merge pull request #168 from unslothai/fix/cli-studio-command-update
Update `studio` CLI command to use new FastAPI backend
2026-02-19 22:17:37 +04:00
Roland Tannous
3dc8f8844f rename cli studio command to use new FastAPI backend and add unsloth-ui alias for backwards compatibility 2026-02-19 17:59:22 +00:00
Roland Tannous
aab2fe8805 Merge pull request #167 from unslothai/fix/train_on_completions-dataset-check-improvements
Simplify dataset check to 2-tier, improve multimodal detection, auto-set trainOnCompletions, recheck dataset on reload
2026-02-19 15:35:50 +04:00
Roland Tannous
11b3029dc6 Simplify dataset check to 2-tier, improve multimodal detection, auto-set trainOnCompletions, recheck dataset on reload 2026-02-19 11:25:54 +00:00
Roland Tannous
1722b6383e Auto-set trainOnCompletions based on vision/multimodal state, default all model configs to true, and re-fetch model defaults on page reload 2026-02-19 06:40:40 +00:00
Roland Tannous
58753151ef change train_on_completions to true 2026-02-19 06:02:16 +00:00
Roland Tannous
9368c8cf9e Revert "Setting default for the train on responses only"
This reverts commit f6e4908acf.
2026-02-19 09:55:21 +04:00
Roland Tannous
33dca2a52b Merge pull request #163 from unslothai/fix/add-vision-and-dataset-to-local
Fix/add vision and dataset to local
2026-02-19 09:46:54 +04:00
Roland Tannous
f4ac333ec9 Merge pull request #161 from unslothai/fix/vision-model-detection
Fixing Vision model detection
2026-02-19 09:43:30 +04:00
Manan17
5d8aa1de8e Adding vision and multimodal dataset to the localstorage 2026-02-19 05:06:41 +00:00
Manan17
f6e4908acf Setting default for the train on responses only 2026-02-19 02:59:48 +00:00
Manan17
2755cf922d Passing use_auth = True and also having different checks which is missed by the is_vision function 2026-02-19 02:55:46 +00:00
Roland Tannous
0ff1e498ad Merge pull request #159 from unslothai/fix/reduce_dataset_num_proc_25_pct
Fix/reduce dataset num proc 25 pct
2026-02-19 00:55:02 +04:00
Roland Tannous
c876b38780 reduce dataset_num_proc to 1/4 of cpu_count 2026-02-18 20:53:32 +00:00
Roland Tannous
648b29ac9b Merge pull request #155 from unslothai/fix/sft-tokenizer-unwrap-for-vlm-text
fix: Unwrap ProcessorMixin to raw tokenizer for text-only SFTTrainer on VLM-architecture models
2026-02-18 23:19:57 +04:00
Roland Tannous
4cdd2a37c6 fix: unwrap ProcessorMixin to raw tokenizer for text-only SFTTrainer on VLM-architecture models 2026-02-18 19:16:45 +00:00
Roland Tannous
23214c41c0 fix: unwrap ProcessorMixin to raw tokenizer for text-only SFTTrainer on VLM-architecture models 2026-02-18 19:13:20 +00:00
Roland Tannous
7ee9f5dc5d Merge pull request #154 from unslothai/feature/colab-notebook
Add Google Colab Support for Unsloth Studio
2026-02-18 23:02:22 +04:00
Roland Tannous
9840864662 Merge remote-tracking branch 'origin/nightly' into fix/dataset-mapping-vlm-text-datasets 2026-02-18 18:11:45 +04:00
Roland Tannous
ad638118b9 Merge remote-tracking branch 'origin/nightly' into feature/colab-notebook 2026-02-18 17:41:07 +04:00
Roland Tannous
5319e1a3e6 Merge branch 'fix/sm_120-flex-attention-temp-disable' into nightly
renamed UNSLOTH_FLASH_ATTENTION to UNSLOTH_ENABLE_FLASH_ATTENTION to match actual environment variable in
unsloht
2026-02-18 09:24:52 +00:00
Roland Tannous
ae040cf681 renamed UNSLOTH_FLEX_ATTENTION to UNSLOTH_ENABLE_FLEX_ATTENTION 2026-02-18 09:21:53 +00:00
Roland Tannous
f9ff4b95d7 Merge pull request #152 from unslothai/fix/sm_120-flex-attention-temp-disable
Disable flex attention on Blackwell+ GPUs (sm_120+) at startup
2026-02-18 13:00:43 +04:00
Roland Tannous
e3f4a9eb32 Disable flex attention on Blackwell+ GPUs (sm_120+) at startup 2026-02-18 08:58:25 +00:00
Roland Tannous
e44a8517ac Merge pull request #151 from unslothai/fix/trainer-hang-resource-cleanup
Fix/trainer hang resource cleanup
2026-02-18 12:39:40 +04:00
Roland Tannous
29b25169c0 Scale dataset num_proc dynamically to cpu_count//3 instead of hardcap 8 2026-02-18 08:38:53 +00:00
Manan17
949e57c334 fixing the hangup of training after multiple back to back training processes 2026-02-18 08:18:13 +00:00
Manan17
db0fa1a270 Dividing the total cpu_count // 3 2026-02-18 07:59:57 +00:00
Roland Tannous
c616697b22 Merge pull request #148 from unslothai/fix/linear
linear fix
2026-02-18 11:10:16 +04:00
Manan17
c832c903b4 fix the linear path on backend 2026-02-18 07:08:32 +00:00