unsloth/studio/backend/utils
Roland Tannous 5a086353ab feat: add embedding model training support
Add end-to-end embedding/sentence-transformer training pipeline using
FastSentenceTransformer, SentenceTransformerTrainer, and
MultipleNegativesRankingLoss with BatchSamplers.NO_DUPLICATES.

Backend:
- Add is_embedding_model() detection via HF tags + pipeline_tag
- Add /check-embedding/ API route and EmbeddingCheckResponse
- Extend derive_model_type() to return "embeddings"
- Add _run_embedding_training() in worker.py with progress callbacks,
  stop handling, LoRA (task_type=FEATURE_EXTRACTION), and model saving
- Add is_embedding field to TrainingStartRequest and ModelDetails
- Add YAML configs for 5 models: all-MiniLM-L6-v2, bge-m3,
  embeddinggemma-300m, gte-modernbert-base, Qwen3-Embedding-0.6B

Frontend:
- Wire isEmbeddingModel flag through store, API types, and mappers
- Force packing=false, train_on_completions=false, warmup_ratio=0.03
- Hide packing and train_on_completions checkboxes for embedding models
- Auto-set modelType to "embeddings" from backend model_type response
2026-03-10 18:10:09 +00:00
..
datasets fix: fall back to auto-detection when user VLM mapping fails 2026-03-10 01:42:25 +00:00
hardware Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
inference Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
models feat: add embedding model training support 2026-03-10 18:10:09 +00:00
paths Revert "Merge pull request #347 from unslothai/feature/studio-storage-roots" 2026-03-10 01:52:47 +00:00
.gitkeep root studio folder 2026-02-02 09:13:49 +00:00
cache_cleanup.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
transformers_version.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00
utils.py Add AGPL-3.0 SPDX headers to all source files 2026-03-09 20:17:45 +00:00