unsloth/studio/backend/core/inference
Roland Tannous 4656e63374 studio: add external provider support for chat inference
Adds the ability to connect to OpenAI, Mistral, Google, Cohere, Together,
Fireworks, and Perplexity from the Studio chat interface.

- Provider configs stored in SQLite (no API keys persisted)
- RSA-2048 key pair generated at startup for client-side key encryption
- httpx proxy client streams SSE responses in OpenAI-compatible format
- New /api/providers routes: registry, CRUD, test, models
- /v1/chat/completions routes to external provider when provider fields present
- Integration test suite covering CRUD, connection, model listing, and inference
- Frontend spec doc with full API contract
2026-03-29 18:12:45 +00:00
..
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
audio_codecs.py studio: per-model inference defaults, GGUF slider fix, reasoning toggle (#4325) 2026-03-16 06:37:55 -07:00
defaults.py studio: web search, KV cache dtype, training progress, inference fixes 2026-03-17 00:30:01 -07:00
external_provider.py studio: add external provider support for chat inference 2026-03-29 18:12:45 +00:00
inference.py fix: system prompt ignored in unsloth inference (#4528) 2026-03-24 04:01:33 -07:00
key_exchange.py studio: add external provider support for chat inference 2026-03-29 18:12:45 +00:00
llama_cpp.py Fix HF cache default and show LM Studio models in chat/inference (#4653) 2026-03-27 06:59:27 -07:00
orchestrator.py feat(studio): infinite scroll for recommended models list (#4414) 2026-03-18 03:17:01 -07:00
providers.py studio: add external provider support for chat inference 2026-03-29 18:12:45 +00:00
tools.py Fix studio chat crash on Mac: vendor check_signal_escape_patterns (#4431) 2026-03-18 09:10:13 -07:00
worker.py Fix inference failing for transformers 5.x models (trust_remote_code) (#4652) 2026-03-27 04:51:30 -07:00