ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
372 commits 391 branches 58 tags 304 MiB
Commit graph

117 commits

Author SHA1 Message Date
Roland Tannous
23214c41c0 fix: unwrap ProcessorMixin to raw tokenizer for text-only SFTTrainer on VLM-architecture models 2026-02-18 19:13:20 +00:00
Roland Tannous
9840864662 Merge remote-tracking branch 'origin/nightly' into fix/dataset-mapping-vlm-text-datasets 2026-02-18 18:11:45 +04:00
Roland Tannous
ae040cf681 renamed UNSLOTH_FLEX_ATTENTION to UNSLOTH_ENABLE_FLEX_ATTENTION 2026-02-18 09:21:53 +00:00
Roland Tannous
e3f4a9eb32 Disable flex attention on Blackwell+ GPUs (sm_120+) at startup 2026-02-18 08:58:25 +00:00
Roland Tannous
29b25169c0 Scale dataset num_proc dynamically to cpu_count//3 instead of hardcap 8 2026-02-18 08:38:53 +00:00
Manan17
949e57c334 fixing the hangup of training after multiple back to back training processes 2026-02-18 08:18:13 +00:00
Manan17
db0fa1a270 Dividing the total cpu_count // 3 2026-02-18 07:59:57 +00:00
Roland Tannous
c616697b22 Merge pull request #148 from unslothai/fix/linear 
linear fix
 2026-02-18 11:10:16 +04:00
Manan17
c832c903b4 fix the linear path on backend 2026-02-18 07:08:32 +00:00
Roland Tannous
38e577ef26 Merge pull request #145 from unslothai/fix/check-format-sample 
fix: stream HF datasets in check-format endpoint to avoid full d…
 2026-02-18 10:49:17 +04:00
Roland Tannous
9d737559a5 debug statements 2026-02-18 00:37:09 +00:00
Roland Tannous
d94a1e0289 fix: normalize target_modules [all-linear] list to string for Unsloth/PEFT compatibility 2026-02-18 00:32:21 +00:00
Roland Tannous
f0613f5d07 fix: defensively rename VLM chat column to match model's forward() signature 2026-02-17 23:49:13 +00:00
Roland Tannous
c0f210bc2a fix: cap dataset.map() num_proc to 8 to prevent CUDA fork deadlocks 2026-02-17 23:12:45 +00:00
Roland Tannous
4d0c6d20b3 fix: fix: stream HF datasets in check-format endpoint to avoid full downloads; add info logging to model config endpoints 2026-02-17 22:53:29 +00:00
Shine1i
b31461790f feat: enhance training stop and reset flow with detailed checks 2026-02-17 23:32:22 +01:00
Wasim Yousef Said
8fbc80f66a Merge pull request #143 from unslothai/feature/local-models 
feat: add schemas for local model discovery and listing
 2026-02-17 13:10:04 -08:00
Shine1i
a2cf89214e feat: add schemas for local model discovery and listing 2026-02-17 21:53:42 +01:00
Roland Tannous
c5558312c8 fix: skip sudo check on WSL during GGUF export to prevent password prompt hang 2026-02-17 19:30:02 +00:00
Roland Tannous
bcd9416ffb move requirements/ to studio/backend/ and update paths in setup.sh 2026-02-17 19:02:25 +00:00
Roland Tannous
028408e432 chore: override model defaults to use max_steps=30, save_steps=30, num_epochs=0 for testing 2026-02-17 18:46:23 +00:00
Roland Tannous
2cc3f03fbe Merge pull request #136 from unslothai/setup/update-setup-sh-dependencies 
setup.sh: Replace inline pip installs with pinned requirements files
 2026-02-17 22:04:03 +04:00
Shine1i
f47c424be3 feat: integrate gradient norm tracking in training runtime and metrics 
- Enhanced chart logic to filter and visualize finite gradient norm values.
 2026-02-17 18:26:59 +01:00
Roland Tannous
5dd93579c2 add full dependency chain for unsloth + unsloth-extras 2026-02-17 14:21:18 +00:00
Manan17
8f1db03c15 Adding metadata for checkpoints 2026-02-16 23:46:17 +00:00
Wasim Yousef Said
16f79a73de Merge pull request #124 from unslothai/feature/bug-fixes 
feat: support disabling top-k sampling with -1 and standardize normalization
 2026-02-16 13:21:12 -08:00
Roland Tannous
108ec254cb Merge branch 'nightly' into feature/eval-split-auto-detection 2026-02-17 01:11:30 +04:00
Shine1i
4be6eefed3 feat: support disabling top-k sampling with -1 and standardize normalization logic 
- Updated top-k parameter range to accept -1 in models and frontend.
- Added utility to normalize top-k for backend compatibility.
 2026-02-16 21:33:24 +01:00
Roland Tannous
18879a521b feat: auto-detect model+dataset compatibility to select VLM vs LLM training path 2026-02-16 19:18:49 +00:00
Roland Tannous
ed6d4b2fb6 feat: apply default chat template for base models without tokenizer chat_template 2026-02-16 15:56:06 +00:00
Roland Tannous
3b117189c5 feat: add eval_enabled flag and format-first-then-split for eval dataset 2026-02-16 14:13:55 +00:00
Roland Tannous
5962bec41a feat: add eval split auto-detection, eval_steps hyperparam, and eval_loss chart integration 2026-02-16 13:51:10 +00:00
Roland Tannous
90c3561adb feat: add eval split auto-detection, eval_steps hyperparam, and eval_loss chart integration 2026-02-16 13:38:54 +00:00
Roland Tannous
d49506b7b1 feat: add live GPU monitor with nvidia-smi polling during training 2026-02-16 11:47:43 +00:00
Roland Tannous
f3aa353540 feat: add GET /api/system/hardware endpoint for GPU info and package versions 2026-02-16 10:29:21 +00:00
Roland Tannous
1109839d2c feat: include training loss per checkpoint in /api/models/checkpoints response 2026-02-16 09:50:28 +00:00
Roland Tannous
8a239dc83e refactor: move checkpoint scanning to utils/models and /checkpoints endpoint to models router 2026-02-16 09:32:11 +00:00
Roland Tannous
be584ccfa7 Merge pull request #97 from unslothai/fix/progress-metics 
Resolved the progress metrics
 2026-02-16 11:55:01 +04:00
sshah229
5bf2472af9 modified the num_tokens logic 2026-02-16 00:38:40 -07:00
Roland Tannous
6b839a1481 feat: add min_p sampling parameter to /chat/completions generation pipeline 2026-02-16 06:33:17 +00:00
Manan17
eae183504e Fixing the get checkpoint api 2026-02-16 04:47:28 +00:00
Roland Tannous
38cb5c9496 feat: thread dataset subset/split params from API routes through to load_dataset calls 2026-02-16 03:56:22 +00:00
Shine1i
f6397bf1ac feat: add cancelation support for chat generation and streaming tasks 2026-02-15 18:23:27 +01:00
Shine1i
78c7b6d7ba fix lora: outputs path local 2026-02-15 16:58:24 +01:00
Roland Tannous
79ee9f6f2d Merge pull request #96 from unslothai/feature/inference-yaml-ordered 
Added the inference defaults for models
 2026-02-15 17:43:31 +04:00
sshah229
7fd55ce14f resolved the prgress metrics 2026-02-15 05:35:32 -07:00
sshah229
2483b98985 added the inference fetching from model mappers 2026-02-15 02:48:53 -07:00
Manan17
e672458821 Adding save-steps to the SFTConfig 2026-02-15 09:37:54 +00:00
sshah229
e6bd0a20bb added default inference config for default.yaml 2026-02-15 02:13:24 -07:00
sshah229
a105e60d30 added default inference config from unsloth notebooks 2026-02-15 02:13:24 -07:00