unsloth/studio/backend/core/inference
Daniel Han afed5fb791 Merge main into PR #5711: resolve Gemini-provider conflicts
Conflicts came from #5720 (native Gemini provider). All resolved
keeping both branches' functionality:

- provider-capabilities.ts: gemini bucket now uses #5720's narrow
  capability shape (temperature/topP/topK/presencePenalty true) plus
  the 27 extended-sampler fields from this PR (all false on gemini
  since Google's API doesn't accept them). stop=true added so the new
  generationConfig.stopSequences forwarding lights up the UI.
- chat-adapter.ts: kept all 27-field forwarding from this PR; used
  the tighter comments from main.
- routes/inference.py: pass both this PR's sampling kwargs
  (frequency_penalty/seed/stop/service_tier/parallel_tool_calls) and
  main's tools/tool_choice through to stream_chat_completion.
- external_provider.py: same. Every dispatcher (anthropic/openai/
  gemini) now takes both branches' new args. Added stop forwarding to
  _stream_gemini as generationConfig.stopSequences (capped at 5 per
  native API docs); updated test_gemini_stop_sequences_capped_to_5
  to assert the native shape instead of the OAI-compat shape.

256/256 backend tests pass (test_sampling_params_routing 65 +
anthropic/openai/gemini integration suites 191); frontend type-check
plus vite build clean.
2026-05-27 13:29:28 +00:00
..
__init__.py Final cleanup 2026-03-12 18:28:04 +00:00
_html_to_md.py fix: studio web search SSL failures and empty page content (#4754) 2026-04-01 06:12:02 -07:00
anthropic_compat.py Apply parallel_tool_calls cap to Anthropic passthrough + safetensors path (PR #5711) 2026-05-24 18:46:07 +00:00
audio_codecs.py Add native GGUF intake to Studio (#5246) 2026-05-04 11:46:18 +02:00
chat_template_helpers.py Studio: tools, thinking blocks, code execution and web search for safetensors (#5520) 2026-05-19 06:30:17 -07:00
defaults.py studio: engage draft-mtp on vision MTP GGUFs (drop incorrect vision gate) (#5560) 2026-05-18 08:42:55 -07:00
external_provider.py Merge main into PR #5711: resolve Gemini-provider conflicts 2026-05-27 13:29:28 +00:00
inference.py Studio: tools, thinking blocks, code execution and web search for safetensors (#5520) 2026-05-19 06:30:17 -07:00
key_exchange.py studio: API external provider support for chat (OpenAI, Mistral, Gemini, Cohere, Anthropic, OpenRouter, DeepSeek, custom providers) (#4706) 2026-05-14 16:13:59 +04:00
llama_cpp.py Tighten comments across PR 5711 (no behaviour change) 2026-05-27 11:14:45 +00:00
llama_server_args.py Studio: expose --parallel / -np flag on unsloth studio run (#5737) 2026-05-26 23:13:45 -07:00
mlx_inference.py Studio: tools, thinking blocks, code execution and web search for safetensors (#5520) 2026-05-19 06:30:17 -07:00
orchestrator.py Apply parallel_tool_calls cap to Anthropic passthrough + safetensors path (PR #5711) 2026-05-24 18:46:07 +00:00
pricing.py Studio: pricing follow-up to #5690 (longest-prefix match + chat-style usage keys) (#5722) 2026-05-25 23:39:58 -07:00
providers.py Merge main into PR #5711: resolve Gemini-provider conflicts 2026-05-27 13:29:28 +00:00
safetensors_agentic.py Apply parallel_tool_calls cap to Anthropic passthrough + safetensors path (PR #5711) 2026-05-24 18:46:07 +00:00
tool_call_parser.py Revert "studio: tool calling for Llama-3, Mistral, Gemma 4 on safetensors + MLX (#5615)" (#5619) 2026-05-19 07:26:39 -07:00
tools.py Studio: add Gemini provider with web_search, code_execution, prompt caching, and Nano Banana image generation (#5720) 2026-05-27 06:01:24 -07:00
worker.py Studio: tools, thinking blocks, code execution and web search for safetensors (#5520) 2026-05-19 06:30:17 -07:00