f7ca361c5c
Uses Qwen2.5-3B-Instruct Q8_0 via LlamaCppBackend to complement heuristic-based dataset detection when heuristics are uncertain. - New llm_assist.py: VLM instruction generation, column classification, and user-friendly warning generation for dataset issues - Pre-cache helper GGUF on FastAPI startup (background thread) - Reorder training pipeline: dataset processing runs BEFORE model load to avoid VRAM contention (detect → dataset → model → train) - Add pre_detect_and_load_tokenizer() for lightweight detection - LLM warnings on VLM conversion failures (broken URLs, missing images) - LLM column classification fallback when heuristics return unknown - Graceful degradation: all paths unchanged when helper unavailable |
||
|---|---|---|
| .. | ||
| datasets | ||
| hardware | ||
| inference | ||
| models | ||
| paths | ||
| .gitkeep | ||
| cache_cleanup.py | ||
| transformers_version.py | ||
| utils.py | ||