Add granular status updates through the full preprocessing pipeline: - "Downloading dataset: Open-Orca/OpenOrca..." before HF download - "Downloaded Open-Orca/OpenOrca (4,233,923 rows)" after download - "Formatting dataset (4,233,923 rows)..." before format step - "Applying chat template to chatml_conversations (4,233,923 rows)..." - "Dataset ready (4,233,923 samples, chatml_conversations format)" Shows detected format name and row counts at each stage so users can see progress through large dataset preprocessing instead of a static "Loading and formatting dataset..." for minutes. |
||
|---|---|---|
| .. | ||
| assets | ||
| auth | ||
| core | ||
| loggers | ||
| models | ||
| plugins | ||
| requirements | ||
| routes | ||
| state | ||
| tests | ||
| utils | ||
| __init__.py | ||
| colab.py | ||
| main.py | ||
| run.py | ||