Roland Tannous
|
cc11f066b1
|
feat: add tqdm progress bar to VLM conversion and download benchmark test
|
2026-03-04 13:30:27 +00:00 |
|
Roland Tannous
|
7804a4db2e
|
fix: add early probe to fail fast on datasets with too many broken image URLs
|
2026-03-04 08:05:40 +00:00 |
|
Roland Tannous
|
9cbd3d44a7
|
fix: use fsspec for URL image downloads with per-sample error handling
|
2026-03-04 07:50:55 +00:00 |
|
Roland Tannous
|
3c4bf80cc2
|
fix: cast URL image columns to HF Image() type in VLM conversion
|
2026-03-04 06:42:37 +00:00 |
|
Roland Tannous
|
834013aae5
|
Cap dataset.map num_proc on multi-GPU machines to prevent fork deadlocks
|
2026-02-23 14:25:31 +00:00 |
|
Roland Tannous
|
29b25169c0
|
Scale dataset num_proc dynamically to cpu_count//3 instead of hardcap 8
|
2026-02-18 08:38:53 +00:00 |
|
Roland Tannous
|
c0f210bc2a
|
fix: cap dataset.map() num_proc to 8 to prevent CUDA fork deadlocks
|
2026-02-17 23:12:45 +00:00 |
|
Roland Tannous
|
47ead076cf
|
Refactor [dataset_utils.py](cci:7://file:///home/support/new-ui-prototype/studio/backend/utils/datasets/dataset_utils.py:0:0-0:0) into focused modules
|
2026-02-03 14:38:02 +00:00 |
|