Roland Tannous
02b17ec6d9
feat: add index range dataset slicing to studio training page
...
Add Start/End index inputs under Advanced in the dataset card,
allowing users to slice a dataset by row range before training.
Wired end-to-end: frontend store, API payload, backend Pydantic
model, and trainer dataset loading (inclusive on both ends).
2026-03-04 21:48:40 +00:00
Roland Tannous
cc11f066b1
feat: add tqdm progress bar to VLM conversion and download benchmark test
2026-03-04 13:30:27 +00:00
Roland Tannous
7804a4db2e
fix: add early probe to fail fast on datasets with too many broken image URLs
2026-03-04 08:05:40 +00:00
Roland Tannous
9cbd3d44a7
fix: use fsspec for URL image downloads with per-sample error handling
2026-03-04 07:50:55 +00:00
Roland Tannous
c6d82a6fad
fix: abort training pipeline on dataset conversion failure
2026-03-04 06:42:48 +00:00
Roland Tannous
3c4bf80cc2
fix: cast URL image columns to HF Image() type in VLM conversion
2026-03-04 06:42:37 +00:00
Roland Tannous
e8dfa8446d
Merge pull request #289 from unslothai/fix/datasets-auth
...
Added auth to dataset endpoints
2026-03-04 08:21:42 +04:00
Roland Tannous
5f98d232d0
fix: align llama-server binary discovery with upstream unsloth-zoo paths
2026-03-03 17:03:01 +00:00
Roland Tannous
e7619a1291
Move llama.cpp clone/build from in-tree to ~/.unsloth/llama.cpp
...
- setup.sh: builds at ~/.unsloth/llama.cpp instead of ./llama.cpp
- setup.ps1: builds at %USERPROFILE%/.unsloth/llama.cpp
- inference llama_cpp.py: searches ~/.unsloth/ first, in-tree as legacy
- export.py: updated comments (unsloth-zoo handles path natively)
2026-03-02 04:04:41 +00:00
Roland Tannous
70d1567fe3
Download GGUF via huggingface_hub instead of llama-server -hf (fixes HTTPS not supported on Windows)
2026-03-01 13:05:10 +00:00
Roland Tannous
0430d22cc2
Auto-add CUDA DLLs to PATH when launching llama-server on Windows
2026-03-01 13:05:10 +00:00
Roland Tannous
afa1344452
Build llama.cpp in-tree, auto-detect driver CUDA version for compatible toolkit
2026-03-01 13:05:10 +00:00
Roland Tannous
af90c9c3d2
Fix llama-server binary lookup for Windows (.exe, Release dir, ~/.unsloth)
2026-03-01 13:05:10 +00:00
Roland Tannous
c297d7aa84
Force num_proc=1 on Windows to avoid slow spawn overhead
2026-03-01 13:05:10 +00:00
Roland Tannous
986bef4f99
fix: support mmproj for local vision GGUF models + fix Windows pipe deadlock
2026-03-01 12:58:38 +00:00
samit
2714789381
added auth to dataset endpopints
2026-02-28 01:17:43 -08:00
Roland Tannous
d6922f5e83
Merge pull request #282 from unslothai/fix/inference-auth
...
Added auth to inference endpoints
2026-02-27 13:18:38 +04:00
Manan17
b4311cca82
Aggregating sharded models, showing fit/oom for quantizations
2026-02-27 08:23:15 +00:00
samit
6a9969d67b
added auth to inference endpoints
2026-02-27 00:20:36 -08:00
Manan17
4bd5213c05
Passes metadata to get model size
2026-02-27 07:38:55 +00:00
Shine1i
46046cd118
refactor(data-recipe): centralize json+stage constants, tighten parser/errors, sync seed ui
2026-02-26 14:06:53 +01:00
Shine1i
3a7c7bcdf5
refactor(data-recipe): split recipe backend routes for readability (seed/validate/jobs)
2026-02-26 14:05:32 +01:00
Roland Tannous
8944d79c61
Merge pull request #270 from unslothai/fix/gguf-export-relocation
...
Fix GGUF exports saving to wrong directory and missing from chat model selector
2026-02-26 11:48:15 +04:00
Roland Tannous
c06adc3878
Flatten GGUF subdirs in export and fix metadata lookup in scanner
2026-02-26 11:35:04 +04:00
Roland Tannous
a715bca52f
Write export metadata for GGUF exports to fix Unknown base model
2026-02-26 11:24:32 +04:00
Roland Tannous
c3a0e9e7ad
Merge pull request #245 from unslothai/fix/datetime-utc-python39-compatibility
...
fix: replace datetime.UTC with timezone.utc for Python 3.9+ compatibility
2026-02-26 10:37:01 +04:00
Roland Tannous
b91b979bf8
Add GGUF tag for exported models in chat page selector
2026-02-25 19:01:47 +04:00
Roland Tannous
f0176c7f0c
Relocate GGUF exports into exports/ directory
2026-02-25 18:54:39 +04:00
Roland Tannous
efaa0bacfb
Merge branch 'nightly' into feat/gguf-llama-cpp-inference
2026-02-25 16:06:03 +04:00
Roland Tannous
52738383f9
Remove UNSLOTH_ENABLE_LOGGING from export pipeline
2026-02-25 16:00:24 +04:00
Roland Tannous
4809b8283a
Merge pull request #259 from unslothai/feat/dataset-subsets-split
...
Feat/dataset subsets split
2026-02-25 15:27:12 +04:00
Roland Tannous
e52010635b
Merge pull request #246 from unslothai/fix/dataset-custom-mapping-heuristic
...
adding custom mapping according to the chat templates
2026-02-25 15:26:36 +04:00
Roland Tannous
d9434fee4a
fix: use raw github URL for vision.py patch + add VLM processor diagnostic logging
2026-02-25 10:29:05 +00:00
Manan17
5ce88f9aa1
fixing the chatml None error
2026-02-25 10:23:13 +00:00
Shine1i
e52e8a6d51
fix recipe output path, remove tracked root datasets
2026-02-25 11:19:10 +01:00
Manan17
202dd082b7
My changes for dataset
2026-02-25 08:15:44 +00:00
Manan17
611febd2e3
adding custom mapping according to the chat templates
2026-02-25 07:56:30 +00:00
Roland Tannous
2e06a00934
fix: replace FileResponse with Response for index.html to prevent Content-Length mismatch and add path traversal guard
2026-02-25 01:05:04 +00:00
Roland Tannous
9e280eb105
Fix GGUF export cwd confusion: remove os.chdir, use absolute paths
...
Remove os.chdir(save_directory) from export.py which was causing all of
unsloth-zoo's relative-path internals (check_llama_cpp, use_local_gguf,
_download_convert_hf_to_gguf) to resolve against the export directory
instead of the repo root. This caused llama.cpp to be cloned inside each
export dir and destroyed the repo root's llama-server build on cleanup.
Now passes absolute paths to save_pretrained_gguf so unsloth resolves
llama.cpp from the repo root where setup.sh already built it.
Also builds llama-quantize in setup.sh (needed by unsloth-zoo's export
pipeline) and symlinks it to llama.cpp root for check_llama_cpp().
2026-02-25 03:30:54 +04:00
Manan17
07cf1110ce
adding custom mapping according to the chat templates
2026-02-24 21:15:56 +00:00
Leo Borcherding
d05ebc7499
fix: replace datetime.UTC with timezone.utc for Python 3.9+ compatibility
...
- Replace datetime.UTC with datetime.timezone.utc in authentication.py and storage.py
- Fixes ImportError on Python versions < 3.11
- timezone.utc works on Python 3.9+
Resolves #237
2026-02-24 14:37:00 -06:00
Roland Tannous
2ebeba8588
Switch GGUF backend from /v1/completions to /v1/chat/completions
...
Fixes two bugs:
1. Chat template tags (<|im_start|>, <|im_end|>) leaking into output
because /v1/completions treated them as literal text
2. Image hallucination because image_b64 was never passed to llama-server
Now llama-server handles chat templates natively and receives images
as OpenAI-format multimodal content parts for vision models.
2026-02-24 19:21:01 +04:00
Roland Tannous
3ee4f1359a
Use llama-server -hf mode, add GGUF variant selector, fix vision detection
...
Replace Python-side GGUF download with llama-server's native -hf flag for
HuggingFace repos. Add frontend variant picker so users can choose
quantization (Q4_K_M, Q8_0, BF16, etc.) with file sizes. Fix vision
detection via mmproj files instead of hardcoding is_vision=False.
2026-02-24 19:03:06 +04:00
Roland Tannous
5b7555cd3f
Fix llama-server: build in-tree, fix path resolution, add LD_LIBRARY_PATH
2026-02-24 18:19:29 +04:00
Roland Tannous
4a82e704aa
Preflight llama-server check before downloading remote GGUF files
2026-02-24 18:02:43 +04:00
Roland Tannous
c635d4f49c
Fix GGUF detection for HuggingFace repo IDs (not just local paths)
2026-02-24 17:49:09 +04:00
Roland Tannous
2f985ccbb5
Add GGUF model inference via llama-server backend
2026-02-24 17:40:05 +04:00
Roland Tannous
a09823c2eb
Merge branch 'nightly' into feature/canvas-lab
2026-02-24 10:08:13 +00:00
Roland Tannous
f8486672f6
Merge pull request #241 from unslothai/feature/adding-exported-models-for-chat
...
Adding exported model for chat
2026-02-24 13:55:45 +04:00
Roland Tannous
a661784d41
Merge pull request #232 from unslothai/fix/disable-eval-by-default
...
# fix/disable eval by default
2026-02-24 13:35:11 +04:00
