ceos/unsloth
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

studio/backend: drop top_p from Anthropic body when thinking is enabled

Browse source 
PR 5412 added body['top_p'] = max(0.95, min(top_p, 1.0)) inside the
thinking branch of _stream_anthropic, but Anthropic returns 400 on
extended/adaptive thinking when both temperature and top_p are set:

  invalid_request_error: temperature and top_p cannot both be
  specified for this model. Please use only one.

(Observed on Claude Opus 4.6.) The contract for thinking-enabled
requests is temperature=1 with neither top_p nor top_k allowed.

Replace the body['top_p'] = ... line with body.pop('top_p', None).
Defensive pop rather than a bare delete: the base body construction
above does not currently set top_p, but a future edit that adds it
would silently reintroduce the regression.
This commit is contained in:
Roland Tannous 2026-05-14 10:59:39 +04:00
commit 89d8b58fa2
1 changed files with 7 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

10
studio/backend/core/inference/external_provider.py
View file

@ -349,10 +349,14 @@ class ExternalProviderClient:
if effort and effort != "none":
# Anthropic rejects top_k whenever thinking is enabled.
body.pop("top_k", None)
# Anthropic requires temperature=1 whenever thinking is enabled.
# Anthropic requires temperature=1 whenever thinking is enabled,
# AND forbids top_p in the same request: setting both produces
# "temperature and top_p cannot both be specified for this
# model. Please use only one."
# The base body never sets top_p, but pop defensively in case
# an upstream edit ever adds it before this branch runs.
body["temperature"] = 1
# Anthropic thinking supports top_p in the 0.95..1.0 range.
body["top_p"] = max(0.95, min(float(top_p), 1.0))
body.pop("top_p", None)
if _ANTHROPIC_ADAPTIVE_THINKING.match(model):
body["thinking"] = {"type": "adaptive"}
body["output_config"] = {"effort": effort}