unsloth/studio/backend
Daniel Han 34d24bcf97 Studio RAG trim: remove late-chunking strategy
Late chunking (the Jina single-pass technique) is a non-default embedding
path (chunking_strategy defaults to 'standard'). It adds a second full-document
forward pass with windowed token pooling for a marginal long-document gain that
the standard per-chunk encoder already covers at R@5 = 1.0 on the gold set.

- remove late_chunk_encode / _windowed_late_chunk_encode / _pool_spans /
  _encode_tokens from embeddings.py (205 lines)
- remove the chunking_strategy == 'late' branch and _run_late_chunking from
  ingestion.py (75 lines); 'late' now degrades to standard chunking

42 RAG tests pass.
2026-05-31 14:18:03 +00:00
..
assets Add Qwen3.6 inference defaults for Studio (#5065) 2026-04-16 11:42:42 -07:00
auth [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-05-25 06:39:01 +00:00
core Studio RAG trim: remove late-chunking strategy 2026-05-31 14:18:03 +00:00
loggers Studio: stop truncating long log lines as suspected base64 (#5335) 2026-05-08 13:07:18 +04:00
models Merge remote-tracking branch 'origin/main' into feature/rag 2026-05-28 00:38:58 +03:00
plugins fix(gh_client): fail fast on 401/403 auth errors instead of retrying forever (#5325) (#5329) 2026-05-08 21:57:41 +04:00
requirements Studio: point OpenEnv dep at huggingface/ org (repo moved) 2026-05-28 20:34:57 +04:00
routes Studio RAG trim: remove cross-encoder reranker 2026-05-31 14:14:52 +00:00
state unsloth run: add --enable-tools/--disable-tools server-side tool policy (#5277) 2026-05-05 12:45:15 +04:00
storage Studio: fix RAG correctness bugs 2026-05-31 09:56:23 +00:00
tests Studio: remove dead RAG code (AST-confirmed) 2026-05-31 09:35:39 +00:00
utils Studio RAG trim: remove cross-encoder reranker 2026-05-31 14:14:52 +00:00
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
_platform_compat.py Fix Studio crash on Anaconda/conda-forge Python (#4484) 2026-03-22 05:36:55 -07:00
colab.py Fix/studio colab proxy and iframe - Unsloth Studio not loading in Colab (iframe "refused to connect" and wrong URL) (#5844) 2026-05-28 23:54:48 -07:00
main.py [pre-commit.ci] auto fixes from pre-commit.com hooks 2026-05-31 13:31:20 +00:00
run.py Fix/studio colab proxy and iframe - Unsloth Studio not loading in Colab (iframe "refused to connect" and wrong URL) (#5844) 2026-05-28 23:54:48 -07:00
startup_banner.py Studio: stop hint, Uvicorn log rename, reachability check + Mac UI CI retry hardening (#5503) 2026-05-17 07:44:06 -07:00