Agent Trust Lab · Reliability Explorer V1

Browse measured selection evidence

Measured historical tool-selection reliability from frozen benchmark evidence.

This Explorer is an evidence browser. It does not create a universal score, select a winner, or turn historical measurements into a claim about every task.

30subjects with measured selection evidence

12multi-batch subjects

24S2-backed subjects

9subjects with observed semantic misses

How to read this evidence

Selection evidence measures whether the model chose the intended tool in a frozen benchmark.
S2-backed records use external independent gold; each independent batch stays separate.
Observed semantic misses are preserved by benchmark, batch, and case; provider failures are separate.
These are historical measurements under frozen conditions, not current endpoint-health checks.

Open the complete machine-readable evidence view →

Want your MCP measured? Request an evaluation.

Subjects

30 subjects shownDefault order is alphabetical; no accuracy leaderboard is used.

Compare 2–5 subjects using evidence facts side by side. No automatic winner is selected.

0 selected

Cloudflare Docs MCP

cloudflare-docs-mcp

Multi-batchS2-backedMixed provenance

Mixed live and version-bound evidence

Independent batches: 5
Measured cases: 51
Evidence levels: S1, S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →

Context7

context7

Single-batchCurrent live

Current live tools-list snapshot

Independent batches: 1
Measured cases: 24
Evidence levels: S1
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-10 13:23:12.077611 UTC

Select for comparison

View immutable batch history and miss details →

data.gouv.fr

datagouv-mcp

Multi-batchS2-backedObserved missesMixed provenance

Mixed live and version-bound evidence

Independent batches: 6
Measured cases: 39
Evidence levels: S2
Observed semantic misses: 1
Observed strict accuracy: 83.3%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →

DeepWiki MCP

deepwiki-mcp

Multi-batchS2-backedObserved missesMixed provenance

Mixed live and version-bound evidence

Independent batches: 6
Measured cases: 52
Evidence levels: S1, S2
Observed semantic misses: 5
Observed strict accuracy: 57.1%–100.0%
Latest measurement: 2026-09-10 19:13:49.842728 UTC

Select for comparison

View immutable batch history and miss details →

DEX Paprika MCP (source snapshot)

dex-paprika-mcp-source-snapshot

Single-batchVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 24
Evidence levels: S1
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-10 13:23:12.077611 UTC

Select for comparison

View immutable batch history and miss details →

Exa MCP

exa-mcp

Multi-batchS2-backedMixed provenance

Mixed live and version-bound evidence

Independent batches: 6
Measured cases: 55
Evidence levels: S1, S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →

Context7

external-gold-v1:Context7

Single-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

DEX Paprika

external-gold-v1:DEX Paprika

Single-batchS2-backedObserved missesVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 1
Observed strict accuracy: 50.0%–50.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

Google Maps

external-gold-v1:Google Maps

Single-batchS2-backedObserved missesVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 2
Observed strict accuracy: 0.0%–0.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

Huge Icons

external-gold-v1:Huge Icons

Single-batchS2-backedObserved missesVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 1
Observed strict accuracy: 50.0%–50.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

Medical Calculator

external-gold-v1:Medical Calculator

Single-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

Metropolitan Museum

external-gold-v1:Metropolitan Museum

Single-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

National Parks

external-gold-v1:National Parks

Single-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

NixOS

external-gold-v1:NixOS

Single-batchS2-backedObserved missesVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 1
Observed strict accuracy: 50.0%–50.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

OKX Exchange

external-gold-v1:OKX Exchange

Single-batchS2-backedObserved missesVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 1
Observed strict accuracy: 50.0%–50.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

external-gold-v1:Reddit

Single-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

Scientific Computing

external-gold-v1:Scientific Computing

Single-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

Wikipedia

external-gold-v1:Wikipedia

Single-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 2
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-09 22:51:26.259023 UTC

Select for comparison

View immutable batch history and miss details →

GitMCP Docs

gitmcp-docs

Multi-batchS2-backedObserved missesMixed provenance

Mixed live and version-bound evidence

Independent batches: 3
Measured cases: 35
Evidence levels: S1, S2
Observed semantic misses: 3
Observed strict accuracy: 66.7%–100.0%
Latest measurement: 2026-09-10 17:45:38.245198 UTC

Select for comparison

View immutable batch history and miss details →

Google Maps

google-maps-mcp

Multi-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 2
Measured cases: 15
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →

Metropolitan Museum

metropolitan-museum-mcp

Multi-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 2
Measured cases: 15
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →

Metropolitan Museum MCP (source snapshot)

metropolitan-museum-mcp-source-snapshot

Single-batchVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 24
Evidence levels: S1
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-10 13:23:12.077611 UTC

Select for comparison

View immutable batch history and miss details →

Microsoft Learn

microsoft-learn

Multi-batchS2-backedMixed provenance

Mixed live and version-bound evidence

Independent batches: 5
Measured cases: 31
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →

Microsoft Release Communications

microsoft-release-communications

Multi-batchS2-backedMixed provenance

Mixed live and version-bound evidence

Independent batches: 6
Measured cases: 37
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →

National Parks

national-parks-mcp

Multi-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 3
Measured cases: 21
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →

National Parks MCP (source snapshot)

national-parks-mcp-source-snapshot

Single-batchVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 24
Evidence levels: S1
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-10 13:23:12.077611 UTC

Select for comparison

View immutable batch history and miss details →

NixOS

nixos-mcp

Multi-batchS2-backedObserved missesVersion-bound

Version-bound source snapshot

Independent batches: 3
Measured cases: 21
Evidence levels: S2
Observed semantic misses: 1
Observed strict accuracy: 83.3%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →

NixOS MCP (source snapshot)

nixos-mcp-source-snapshot

Single-batchVersion-bound

Version-bound source snapshot

Independent batches: 1
Measured cases: 24
Evidence levels: S1
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-10 13:23:12.077611 UTC

Select for comparison

View immutable batch history and miss details →

UK Premises Licence MCP

uk-premises-licence-mcp

Single-batchCurrent live

Current live tools-list snapshot

Independent batches: 1
Measured cases: 24
Evidence levels: S1
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-10 13:23:12.077611 UTC

Select for comparison

View immutable batch history and miss details →

wikipedia-mcp-reference

wikipedia-mcp-reference

Multi-batchS2-backedVersion-bound

Version-bound source snapshot

Independent batches: 2
Measured cases: 15
Evidence levels: S2
Observed semantic misses: 0
Observed strict accuracy: 100.0%–100.0%
Latest measurement: 2026-09-11 00:07:39.419700 UTC

Select for comparison

View immutable batch history and miss details →