fastmcp/tests/server/transforms/test_visibility.py
Jeremiah Lowin 3a9717e6be
Publish docs for v3.2.0 (#3713)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Jeremiah Lowin <jlowin@users.noreply.github.com>
Co-authored-by: Marvin Context Protocol <41898282+Marvin Context Protocol@users.noreply.github.com>
Co-authored-by: voidborne-d <voidborne-d@users.noreply.github.com>
Co-authored-by: marvin-context-protocol[bot] <225465937+marvin-context-protocol[bot]@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: d 🔹 <258577966+voidborne-d@users.noreply.github.com>
Co-authored-by: Jeremiah Lowin <153965+jlowin@users.noreply.github.com>
Co-authored-by: nightcityblade <nightcityblade@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: Bill Easton <strawgate@users.noreply.github.com>
Co-authored-by: Sumanshu Nankana <sumanshunankana@gmail.com>
Co-authored-by: Eric Robinson <ericrobinson@indeed.com>
Co-authored-by: Martim Santos <martimfasantos@gmail.com>
Co-authored-by: d 🔹 <liusway405@gmail.com>
Co-authored-by: Matthieu B <66959271+mtthidoteu@users.noreply.github.com>
Co-authored-by: Sascha Buehrle <47737812+saschabuehrle@users.noreply.github.com>
Co-authored-by: Hakancan <142545736+hkc5@users.noreply.github.com>
Co-authored-by: nightcityblade <jackchen@haloailabs.com>
Co-authored-by: Matt Hallowell <17804673+mhallo@users.noreply.github.com>
Co-authored-by: nate nowack <thrast36@gmail.com>
Co-authored-by: Bill Easton <williamseaston@gmail.com>
Co-authored-by: Marcus Shu <46469249+shulkx@users.noreply.github.com>
Co-authored-by: Rushabh Doshi <radoshi@gmail.com>
Co-authored-by: AIKAWA Shigechika <shige@aikawa.jp>
Co-authored-by: Jeremy Simon <simonjer805@gmail.com>
Co-authored-by: Miguel Miranda Dias <7780875+pandego@users.noreply.github.com>
Co-authored-by: Anthony James Padavano <padavano.anthony@gmail.com>
Co-authored-by: Mostafa Kamal <hiremostafa@gmail.com>
Fix auto-close MRE script posting comment without closing (#3386)
Fix WorkOS token scope verification bypass 🤖 Generated with Codex (#3407)
Fix initialize McpError fallthrough 🤖 Generated with Codex (#3413)
Fix transform arg collisions with passthrough params (#3431)
Fix get_* returning None when latest version is disabled (#3439)
Fix get_* returning None when latest version is disabled (#3421)
Fix server lifespan overlap teardown (#3415)
Fix $ref output schema object detection regression (#3420)
resolved annotations (#3429)
Fix async partial callables rejected by iscoroutinefunction (#3438)
Fix async partial callables rejected by iscoroutinefunction (#3423)
fix: add version to components (#3458)
fix: use intent-based flag for OIDC scope patch in load_access_token (#3465)
Fixes #3461
fix: normalize Google scope shorthands and surface valid_scopes (#3477)
fix: resolve ty 0.0.23 type-checking errors and bump pin (#3481)
fix: shield lifespan teardown from cancellation (#3480)
fix: forward custom_route endpoints from mounted servers (#3462)
fix updates _get_additional_http_routes() to traverse providers,
Fixes #3457
fix: remove hardcoded version from CLI help text (#3456)
fix: monty 0.0.8 compatibility, drop external_functions from constructor (#3468)
fix: task test teardown hanging 5s per test (#3499)
Closes #3498
fix: validate workspace path is a directory before cursor install (#3440)
Fixes #3426
fix: handle re.error from malformed URI templates in build_regex (#3501)
fix: reject empty/OIDC-only required_scopes in AzureProvider (#3503)
fix: restrict $ref resolution to local refs only (SSRF/LFI) (#3502)
fix warnings and timeouts (#3504)
close upgrade check issue when build passes (#3505)
Closes #3484
fix: URL-encode path params to prevent SSRF/path traversal (GHSA-vv7q-7jx5-f767) (#3507)
fix: prevent path traversal in skill download (#3493)
fix: prefer IdP-granted scopes over client-requested scopes in OAuthProxy (#3492)
fix: remove unrelated transform and http.py changes from PR scope
fix: remove forced follow_redirects from httpx_client_factory calls (#3496)
fix: stop passing follow_redirects to httpx_client_factory
fix: restore follow_redirects=True for custom httpx client factories
Closes #3509
fix: CSRF double-submit cookie check in consent flow (#3519)
fix: validate server names in install commands (#3522)
fix: use raw strings for regex in pytest.raises match (#3523)
fix: reject refresh tokens used as Bearer access tokens (#3524)
fix: route ResourcesAsTools/PromptsAsTools through server middleware (#3495)
fix: resolve Pyright "Module is not callable" on @tool, @resource, @prompt decorators (#3540)
fix: filter warnings by message in KEY_PREFIX test (#3549)
fix: suppress output schema for ToolResult subclass annotations (#3548)
fix: increase sleep duration in proxy cache tests (#3567)
fix: store absolute token expiry to prevent stale expires_in on reload (#3572)
fix: preserve tool properties named 'title' during schema compression (#3582)
Fix loopback redirect URI port matching per RFC 8252 §7.3 (#3589)
Fix app tool routing: visibility check and middleware propagation (#3591)
Fix query parameter serialization to respect OpenAPI explode/style settings (#3595)
Fix dev apps form: union types, textarea support, JSON parsing (#3597)
fix(google): replace deprecated /oauth2/v1/tokeninfo with /oauth2/v3/userinfo (#3603)
fix: resolve EntraOBOToken dependency injection through MultiAuth (#3609)
fix(docs): correct misleading stateless_http header (#3622)
fix: filesystem provider import machinery (#3626)
Closes #3625 (issues 2, 3, 6)
fix: recover StdioTransport after subprocess exits (#3630)
fix(server): preserve mounted tool task metadata (#3632)
fix: scope deprecation warning filter to FastMCPDeprecationWarning (#3649)
fix imports, add PrefabAppConfig (#3650)
fix: resolve CurrentFastMCP/ctx.fastmcp to child server in mounted background tasks (#3651)
Fix blocking docs issues: chart imports, Select API, Rx consistency (#3652)
closed by default (#3657)
Fix prompt caching middleware missing wrap/unwrap round-trip (#3666)
fix: serialize object query params per OpenAPI style/explode rules (#3662)
Fixes #2857
fix: HTTP request headers not accessible in background task workers (#3631)
fix: restore HTTP headers in worker execution path for background tasks (#3681)
fix: strip discriminator after dereferencing schemas (#3682)
fix: remove stale ty:ignore directives for ty 0.0.26 (#3684)
Fix docs gaps in app provider pages (#3690)
fix: dev apps log panel UX improvements (#3698)
fix dev server empty string args (#3700)
2026-03-30 16:48:30 -04:00

275 lines
11 KiB
Python

"""Tests for Visibility transform."""
import pytest
from fastmcp.server.transforms.visibility import Visibility, is_enabled
from fastmcp.tools.base import Tool
from fastmcp.utilities.versions import VersionSpec
class TestMatching:
"""Test component matching logic."""
def test_empty_criteria_matches_nothing(self):
"""Empty criteria is a safe default - matches nothing."""
t = Visibility(False)
assert t._matches(Tool(name="anything", parameters={})) is False
def test_match_all_matches_everything(self):
"""match_all=True matches all components."""
t = Visibility(False, match_all=True)
assert t._matches(Tool(name="anything", parameters={})) is True
def test_match_by_name(self):
"""Matches component by name."""
t = Visibility(False, names={"foo"})
assert t._matches(Tool(name="foo", parameters={})) is True
assert t._matches(Tool(name="bar", parameters={})) is False
def test_match_by_version(self):
"""Matches component by version."""
t = Visibility(False, version=VersionSpec(eq="v1"))
assert t._matches(Tool(name="foo", version="v1", parameters={})) is True
assert t._matches(Tool(name="foo", version="v2", parameters={})) is False
def test_match_by_version_spec_exact(self):
"""VersionSpec(eq="v1") matches v1 only."""
t = Visibility(False, version=VersionSpec(eq="v1"))
assert t._matches(Tool(name="foo", version="v1", parameters={})) is True
assert t._matches(Tool(name="foo", version="v2", parameters={})) is False
assert t._matches(Tool(name="foo", version="v0", parameters={})) is False
def test_match_by_version_spec_gte(self):
"""VersionSpec(gte="v2") matches v2, v3, but not v1."""
t = Visibility(False, version=VersionSpec(gte="v2"))
assert t._matches(Tool(name="foo", version="v1", parameters={})) is False
assert t._matches(Tool(name="foo", version="v2", parameters={})) is True
assert t._matches(Tool(name="foo", version="v3", parameters={})) is True
def test_match_by_version_spec_range(self):
"""VersionSpec(gte="v1", lt="v3") matches v1, v2, but not v3."""
t = Visibility(False, version=VersionSpec(gte="v1", lt="v3"))
assert t._matches(Tool(name="foo", version="v0", parameters={})) is False
assert t._matches(Tool(name="foo", version="v1", parameters={})) is True
assert t._matches(Tool(name="foo", version="v2", parameters={})) is True
assert t._matches(Tool(name="foo", version="v3", parameters={})) is False
assert t._matches(Tool(name="foo", version="v4", parameters={})) is False
def test_unversioned_does_not_match_version_spec(self):
"""Unversioned components (version=None) don't match a VersionSpec."""
t = Visibility(False, version=VersionSpec(eq="v1"))
assert t._matches(Tool(name="foo", parameters={})) is False
t2 = Visibility(False, version=VersionSpec(gte="v1"))
assert t2._matches(Tool(name="foo", parameters={})) is False
def test_match_by_tag(self):
"""Matches if component has any of the specified tags."""
t = Visibility(False, tags=set({"internal", "deprecated"}))
assert t._matches(Tool(name="foo", parameters={}, tags={"internal"})) is True
assert t._matches(Tool(name="foo", parameters={}, tags={"public"})) is False
def test_match_by_component_type(self):
"""Only matches specified component types."""
t = Visibility(False, names={"foo"}, components={"prompt"})
# Tool has key "tool:foo@", not "prompt:foo@"
assert t._matches(Tool(name="foo", parameters={})) is False
def test_all_criteria_must_match(self):
"""Multiple criteria use AND logic - all must match."""
t = Visibility(
False,
names={"foo"},
version=VersionSpec(eq="v1"),
tags=set({"internal"}),
)
# All match
assert (
t._matches(Tool(name="foo", version="v1", parameters={}, tags={"internal"}))
is True
)
# Version doesn't match
assert (
t._matches(Tool(name="foo", version="v2", parameters={}, tags={"internal"}))
is False
)
class TestMarking:
"""Test visibility state marking."""
def test_disable_marks_as_disabled(self):
"""Visibility(False, ...) marks matching components as disabled."""
tool = Tool(name="foo", parameters={})
marked = Visibility(False, names={"foo"})._mark_component(tool)
assert is_enabled(marked) is False
def test_enable_marks_as_enabled(self):
"""Visibility(True, ...) marks matching components as enabled."""
tool = Tool(name="foo", parameters={})
marked = Visibility(True, names={"foo"})._mark_component(tool)
assert is_enabled(marked) is True
assert marked.meta is not None
assert marked.meta["fastmcp"]["_internal"]["visibility"] is True
def test_non_matching_unchanged(self):
"""Non-matching components are not modified."""
tool = Tool(name="bar", parameters={})
result = Visibility(False, names={"foo"})._mark_component(tool)
# No _internal key added
assert result.meta is None or "_internal" not in result.meta.get("fastmcp", {})
assert is_enabled(result) is True
def test_returns_copy_for_matching(self):
"""Marking returns a copy to avoid mutating shared provider objects."""
tool = Tool(name="foo", parameters={})
result = Visibility(False, names={"foo"})._mark_component(tool)
assert result is not tool
assert is_enabled(result) is False
# Original is untouched
assert is_enabled(tool) is True
def test_disable_all(self):
"""match_all=True disables all components."""
tool = Tool(name="anything", parameters={})
marked = Visibility(False, match_all=True)._mark_component(tool)
assert is_enabled(marked) is False
class TestOverride:
"""Test that later marks override earlier ones."""
def test_enable_overrides_disable(self):
"""An enable after disable results in enabled."""
tool = Tool(name="foo", parameters={})
marked = Visibility(False, names={"foo"})._mark_component(tool)
assert is_enabled(marked) is False
marked = Visibility(True, names={"foo"})._mark_component(marked)
assert is_enabled(marked) is True
def test_disable_overrides_enable(self):
"""A disable after enable results in disabled."""
tool = Tool(name="foo", parameters={})
marked = Visibility(True, names={"foo"})._mark_component(tool)
assert is_enabled(marked) is True
marked = Visibility(False, names={"foo"})._mark_component(marked)
assert is_enabled(marked) is False
class TestHelperFunctions:
"""Test is_enabled helper."""
def test_unmarked_is_enabled(self):
"""Components without marks are enabled by default."""
tool = Tool(name="foo", parameters={})
assert is_enabled(tool) is True
def test_filtering_pattern(self):
"""Common pattern: filter list with is_enabled."""
tools = [
Tool(name="enabled", parameters={}),
Tool(name="disabled", parameters={}),
]
vis = Visibility(False, names={"disabled"})
marked_tools = [vis._mark_component(t) for t in tools]
visible = [t for t in marked_tools if is_enabled(t)]
assert [t.name for t in visible] == ["enabled"]
class TestMetadata:
"""Test metadata handling."""
def test_internal_metadata_stripped_by_get_meta(self):
"""Internal metadata is stripped when calling get_meta()."""
tool = Tool(name="foo", parameters={})
marked = Visibility(True, names={"foo"})._mark_component(tool)
# Raw meta has _internal
assert marked.meta is not None
assert "_internal" in marked.meta.get("fastmcp", {})
# get_meta() strips it
output = marked.get_meta()
assert "_internal" not in output.get("fastmcp", {})
def test_user_metadata_preserved(self):
"""User-provided metadata is not affected."""
tool = Tool(name="foo", parameters={}, meta={"custom": "value"})
marked = Visibility(False, names={"foo"})._mark_component(tool)
assert marked.meta is not None
assert marked.meta["custom"] == "value"
class TestRepr:
"""Test string representation."""
def test_repr_disable(self):
"""Repr shows disable action and criteria."""
t = Visibility(False, names={"foo"})
r = repr(t)
assert "disable" in r
assert "foo" in r
def test_repr_enable(self):
"""Repr shows enable action."""
t = Visibility(True, names={"foo"})
assert "enable" in repr(t)
def test_repr_match_all(self):
"""Repr shows match_all."""
t = Visibility(False, match_all=True)
assert "match_all=True" in repr(t)
class TestTransformChain:
"""Test Visibility in async transform chains."""
@pytest.fixture
def tools(self):
return [
Tool(name="public", parameters={}, tags={"public"}),
Tool(name="internal", parameters={}, tags={"internal"}),
Tool(name="safe_internal", parameters={}, tags={"internal", "safe"}),
]
async def test_list_tools_marks_matching(self, tools):
"""list_tools applies marks to matching components."""
disable_internal = Visibility(False, tags=set({"internal"}))
result = await disable_internal.list_tools(tools)
assert len(result) == 3
assert is_enabled(result[0]) # public
assert not is_enabled(result[1]) # internal
assert not is_enabled(result[2]) # safe_internal
async def test_later_transform_overrides(self, tools):
"""Later transforms in chain override earlier ones."""
disable_internal = Visibility(False, tags=set({"internal"}))
enable_safe = Visibility(True, tags=set({"safe"}))
# Apply transforms sequentially
after_disable = await disable_internal.list_tools(tools)
result = await enable_safe.list_tools(after_disable)
enabled = [t for t in result if is_enabled(t)]
# public: never disabled
# internal: disabled, stays disabled
# safe_internal: disabled then re-enabled
assert {t.name for t in enabled} == {"public", "safe_internal"}
async def test_allowlist_pattern(self, tools):
"""Disable all, then enable specific = allowlist."""
disable_all = Visibility(False, match_all=True)
enable_public = Visibility(True, tags=set({"public"}))
# Apply transforms sequentially
after_disable = await disable_all.list_tools(tools)
result = await enable_public.list_tools(after_disable)
enabled = [t for t in result if is_enabled(t)]
assert [t.name for t in enabled] == ["public"]