Roland Tannous
|
23214c41c0
|
fix: unwrap ProcessorMixin to raw tokenizer for text-only SFTTrainer on VLM-architecture models
|
2026-02-18 19:13:20 +00:00 |
|
Roland Tannous
|
9840864662
|
Merge remote-tracking branch 'origin/nightly' into fix/dataset-mapping-vlm-text-datasets
|
2026-02-18 18:11:45 +04:00 |
|
Roland Tannous
|
29b25169c0
|
Scale dataset num_proc dynamically to cpu_count//3 instead of hardcap 8
|
2026-02-18 08:38:53 +00:00 |
|
Roland Tannous
|
f0613f5d07
|
fix: defensively rename VLM chat column to match model's forward() signature
|
2026-02-17 23:49:13 +00:00 |
|
Roland Tannous
|
c0f210bc2a
|
fix: cap dataset.map() num_proc to 8 to prevent CUDA fork deadlocks
|
2026-02-17 23:12:45 +00:00 |
|
Roland Tannous
|
ed6d4b2fb6
|
feat: apply default chat template for base models without tokenizer chat_template
|
2026-02-16 15:56:06 +00:00 |
|
Roland Tannous
|
4e4fc367b6
|
fix: auto-detect multimodal datasets in /check-format without requiring is_vlm flag
|
2026-02-13 17:29:39 +00:00 |
|
Roland Tannous
|
528d2e27f0
|
authentication refactor - added setup token and token refresh mechanism
|
2026-02-11 12:09:47 +00:00 |
|
Roland Tannous
|
996b16f9ee
|
Add datasets check-format endpoint
|
2026-02-03 20:42:25 +00:00 |
|
Roland Tannous
|
4d89dd302c
|
fix custom_format_mapping flow for manual column mapping
|
2026-02-03 18:42:07 +00:00 |
|
Roland Tannous
|
fa3724b82c
|
Add Flag for Dataset Detection
|
2026-02-03 18:21:05 +00:00 |
|
Roland Tannous
|
842b2b3186
|
remove duplicates from dataset_utils.py
|
2026-02-03 18:03:01 +00:00 |
|
Roland Tannous
|
47ead076cf
|
Refactor [dataset_utils.py](cci:7://file:///home/support/new-ui-prototype/studio/backend/utils/datasets/dataset_utils.py:0:0-0:0) into focused modules
|
2026-02-03 14:38:02 +00:00 |
|
Roland Tannous
|
75d8dcc824
|
root studio folder
|
2026-02-02 09:13:49 +00:00 |
|