MCP Selection Lab MCP server
Benchmark MCP tool selection with metadata-only routing, collision, abstention, and holdout checks.
Little public usage data yet
Reviews
Write oneNobody has reviewed MCP Selection Lab yet.
If you have run it, two minutes of your experience saves the next person an afternoon.
MCP Selection Lab tools (3, 1 write)
write = sends, deletes, buys or postsget_selection_reportFreeRead and agent-enrich an existing public scan report by id; no new target request or model call.
scan_mcp_metadatawrite actionFreeCreate a free public report of MCP tool-description routing collisions. Reads discovery metadata (initialize/tools/list) only; never calls target business tools or spends funds. Use a public HTTP(S) URL without credentials, query or fragment. Results use at most 12 tools and 24 generated cases, not a real-model evaluation. The returned report is enriched with agent_plan candidate description-only edits and a machine-readable rerun instruction. Candidate edits are not untouched-holdout proof. Reports persist and are public by link. For an existing report use get_selection_report. Set internal_test=true for owner/CI validation so it is excluded from public scans. source is a self-reported referral bucket, not identity verification.
selection_lab_infoFreeGet free service capabilities, limits, privacy and connection details; does not scan a target.
Public scan report
scanner v0.1.9 · 2026-09-20 · same rubric, same numbers if you re-run it
- –Code scanremote-only server, no package to scann/a
- Live reliabilityremote reachable in 831ms20/20
- Tool poisoning3 tool descriptions checked15/15
- Auth qualityopen endpoint exposes 1 write-action tools with no auth3/15
- Maintenancerepository not readable: repo not found3/15
- Maintainer identityno repository or website to verify2/10
Findings (1)
- highWrite-action tools reachable without authentication
auth.open-write
Install directly
claude mcp add --transport http mcp-selection-lab https://mcp-selection-lab-production.up.railway.app/mcp
MCP Selection Lab: common questions
- Is MCP Selection Lab MCP server safe?
- With care: it is graded C, so read the findings first (57/100). Read the MCP Selection Lab safety report
- How do I install MCP Selection Lab?
- It runs remotely at mcp-selection-lab-production.up.railway.app. Add it to Claude Code, Claude Desktop or Cursor with the snippets above, or call it through the mcp.market gateway without installing anything.
- Does MCP Selection Lab need an API key?
- Not as far as the registry entry and our scan can tell: no credentials are declared or required.
- Is MCP Selection Lab maintained?
- The latest release is v0.5.1.
- Is MCP Selection Lab up?
- 100% of our last 5 checks got an answer. We check remote servers about four times a day.